2024-05-11T00:49:56.714 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-11T00:49:56.714 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule} --archive /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036 --verbose --owner scheduled_mchangir@teuthology --name mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi -- /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/orig.config.yaml 2024-05-11T00:49:56.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-11T00:49:56.864 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036 branch: wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule} email: mchangir@redhat.com first_in_suite: false job_id: '7702036' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 10380055a1fc5e7d3b37b252af7045f5c2c8ba29 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 10380055a1fc5e7d3b37b252af7045f5c2c8ba29 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds sha1: 10380055a1fc5e7d3b37b252af7045f5c2c8ba29 owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3672 sha1: 10380055a1fc5e7d3b37b252af7045f5c2c8ba29 sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 10380055a1fc5e7d3b37b252af7045f5c2c8ba29 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrl1ef1mykH3JmopPQYUOHANK2FNT2VPlDanLPwS/38zsUIJPpWIQCNfJVThPWaml25/0XDRt8fa1qi5pfFTAM= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIR8r7mTzb9ZSsVOoWptUVmB++iCaQVMToqhneGELl0ckVN8qjpy7L0LrTOHG+H6fUc+dqfX80AglV2eKpDbwmc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-11_00:39:26 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-11T00:49:56.864 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa; will attempt to use it 2024-05-11T00:49:56.865 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks 2024-05-11T00:49:56.865 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-11T00:49:56.867 INFO:teuthology.task.internal:Checking packages... 2024-05-11T00:49:56.893 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '10380055a1fc5e7d3b37b252af7045f5c2c8ba29' 2024-05-11T00:49:56.893 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-11T00:49:56.893 INFO:teuthology.packaging:ref: None 2024-05-11T00:49:56.894 INFO:teuthology.packaging:tag: None 2024-05-11T00:49:56.894 INFO:teuthology.packaging:branch: wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds 2024-05-11T00:49:56.894 INFO:teuthology.packaging:sha1: 10380055a1fc5e7d3b37b252af7045f5c2c8ba29 2024-05-11T00:49:56.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds 2024-05-11T00:49:57.174 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3570.g10380055 2024-05-11T00:49:57.175 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-11T00:49:57.184 INFO:teuthology.task.internal:no buildpackages task found 2024-05-11T00:49:57.184 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-11T00:49:57.259 INFO:teuthology.task.internal:Saving configuration 2024-05-11T00:49:57.277 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-11T00:49:57.286 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-11T00:49:57.309 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-11 00:45:03.740363', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrl1ef1mykH3JmopPQYUOHANK2FNT2VPlDanLPwS/38zsUIJPpWIQCNfJVThPWaml25/0XDRt8fa1qi5pfFTAM='} 2024-05-11T00:49:57.332 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-11 00:45:03.738910', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIR8r7mTzb9ZSsVOoWptUVmB++iCaQVMToqhneGELl0ckVN8qjpy7L0LrTOHG+H6fUc+dqfX80AglV2eKpDbwmc='} 2024-05-11T00:49:57.333 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-11T00:49:57.343 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-11T00:49:57.344 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-11T00:49:57.344 INFO:teuthology.run_tasks:Running task console_log... 2024-05-11T00:49:57.431 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7f3da1ff70>, signals=[15]) 2024-05-11T00:49:57.432 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-11T00:49:57.442 INFO:teuthology.task.internal:Opening connections... 2024-05-11T00:49:57.442 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T00:49:57.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:49:57.529 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T00:49:57.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:49:57.604 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-11T00:49:57.613 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-05-11T00:49:57.632 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-05-11T00:49:57.632 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-05-11T00:49:57.690 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-05-11T00:49:57.690 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-05-11T00:49:57.690 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-05-11T00:49:57.690 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-05-11T00:49:57.690 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-05-11T00:49:57.690 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-05-11T00:49:57.691 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-11T00:49:57.691 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-05-11T00:49:57.691 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-05-11T00:49:57.691 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-11T00:49:57.691 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-05-11T00:49:57.691 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-11T00:49:57.691 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-11T00:49:57.691 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-11T00:49:57.692 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-05-11T00:49:57.717 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-05-11T00:49:57.735 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-05-11T00:49:57.735 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-05-11T00:49:57.792 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-11T00:49:57.793 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-11T00:49:57.794 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-05-11T00:49:57.826 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-11T00:49:57.837 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-11T00:49:57.847 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-11T00:49:57.848 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-05-11T00:49:57.852 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-05-11T00:49:57.868 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-11T00:49:57.878 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-11T00:49:57.878 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-05-11T00:49:57.909 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-05-11T00:49:58.011 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-11T00:49:58.074 INFO:teuthology.run_tasks:Running task kernel... 2024-05-11T00:49:58.092 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-11T00:49:58.092 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-11T00:49:58.092 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-11T00:49:58.092 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-11T00:49:58.093 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-11T00:49:58.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T00:49:58.111 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-05-11T00:49:58.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T00:49:58.112 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-05-11T00:49:58.172 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-437.el9.x86_64 2024-05-11T00:49:58.172 INFO:teuthology.task.kernel:Running kernel on smithi174: 5.14.0-437.el9.x86_64 2024-05-11T00:49:58.172 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2024-05-11T00:49:58.173 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-437.el9.x86_64 2024-05-11T00:49:58.173 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.14.0-437.el9.x86_64 2024-05-11T00:49:58.173 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2024-05-11T00:50:00.320 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-11T00:50:00.384 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-11T00:50:03.172 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-05-11T00:50:07.713 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.2 MB 00:00 2024-05-11T00:50:09.389 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-05-11T00:50:12.734 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 21 MB 00:03 2024-05-11T00:50:17.973 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-05-11T00:50:19.225 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:17 2024-05-11T00:50:19.938 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-11T00:50:19.938 INFO:teuthology.orchestra.run.smithi174.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-11T00:50:20.028 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-11T00:50:20.036 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-11T00:50:20.036 INFO:teuthology.orchestra.run.smithi174.stdout: Package Architecture Version Repository Size 2024-05-11T00:50:20.036 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-11T00:50:20.036 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-11T00:50:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-11T00:50:20.037 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-11T00:50:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-11T00:50:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-11T00:50:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-11T00:50:20.037 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:50:20.037 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-11T00:50:20.037 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2024-05-11T00:50:20.038 INFO:teuthology.orchestra.run.smithi174.stdout:Install 4 Packages 2024-05-11T00:50:20.038 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:50:20.038 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 78 M 2024-05-11T00:50:20.038 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 123 M 2024-05-11T00:50:20.038 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-11T00:50:21.049 INFO:teuthology.orchestra.run.smithi174.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 514 kB/s | 484 kB 00:00 2024-05-11T00:50:21.616 INFO:teuthology.orchestra.run.smithi174.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 10 MB/s | 15 MB 00:01 2024-05-11T00:50:22.283 INFO:teuthology.orchestra.run.smithi174.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 16 MB/s | 34 MB 00:02 2024-05-11T00:50:23.251 INFO:teuthology.orchestra.run.smithi174.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 13 MB/s | 28 MB 00:02 2024-05-11T00:50:23.251 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-11T00:50:23.251 INFO:teuthology.orchestra.run.smithi174.stdout:Total 24 MB/s | 78 MB 00:03 2024-05-11T00:50:23.367 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-11T00:50:23.928 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-11T00:50:24.270 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-11T00:50:24.270 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-11T00:50:24.851 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-05-11T00:50:25.210 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-11T00:50:25.211 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-11T00:50:26.380 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-05-11T00:50:27.607 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-11T00:50:28.518 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-11T00:50:28.599 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-11T00:50:31.259 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-11T00:50:31.399 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-11T00:50:31.685 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-11T00:50:33.733 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-11T00:50:33.734 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-11T00:50:33.832 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-05-11T00:50:33.840 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-11T00:50:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-05-11T00:50:33.840 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-11T00:50:33.840 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-05-11T00:50:33.840 INFO:teuthology.orchestra.run.smithi016.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-11T00:50:33.840 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-05-11T00:50:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-11T00:50:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-11T00:50:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-11T00:50:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:50:33.841 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-05-11T00:50:33.841 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-05-11T00:50:33.841 INFO:teuthology.orchestra.run.smithi016.stdout:Install 4 Packages 2024-05-11T00:50:33.841 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:50:33.842 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 78 M 2024-05-11T00:50:33.842 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 123 M 2024-05-11T00:50:33.842 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-05-11T00:50:34.564 INFO:teuthology.orchestra.run.smithi016.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 709 kB/s | 484 kB 00:00 2024-05-11T00:50:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-11T00:50:36.135 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:50:40.886 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:50:48.037 INFO:teuthology.orchestra.run.smithi016.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.1 MB/s | 15 MB 00:14 2024-05-11T00:51:06.193 INFO:teuthology.orchestra.run.smithi016.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 905 kB/s | 28 MB 00:31 2024-05-11T00:51:10.343 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:51:10.387 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:51:10.786 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:51:10.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-11T00:51:10.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-11T00:51:10.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-11T00:51:11.528 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:51:11.528 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:51:11.528 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-11T00:51:11.528 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-11T00:51:11.528 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-11T00:51:11.528 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-11T00:51:11.528 INFO:teuthology.orchestra.run.smithi174.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-11T00:51:11.528 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:51:11.529 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-11T00:51:11.853 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-05-11T00:51:11.984 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-11T00:51:11.984 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-11T00:51:11.984 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-11T00:51:11.984 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-11T00:51:11.984 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-11T00:51:11.984 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-11T00:51:11.985 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2024-05-11T00:51:11.985 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q kernel | sort -rV | head -n 1 2024-05-11T00:51:12.034 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-11T00:51:12.035 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-11T00:51:12.035 DEBUG:teuthology.orchestra.run.smithi174:> sudo rpm -qi grub2-tools 2024-05-11T00:51:12.073 INFO:teuthology.orchestra.run.smithi174.stdout:Name : grub2-tools 2024-05-11T00:51:12.073 INFO:teuthology.orchestra.run.smithi174.stdout:Epoch : 1 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Version : 2.06 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Release : 68.el9 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: x86_64 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Group : Unspecified 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Size : 8264254 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:License : GPLv3+ 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Packager : builder@centos.org 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:Vendor : CentOS 2024-05-11T00:51:12.074 INFO:teuthology.orchestra.run.smithi174.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout:Summary : Support tools for GRUB. 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout:Description : 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout:hardware devices. 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:51:12.075 INFO:teuthology.orchestra.run.smithi174.stdout:This subpackage provides tools for support of all platforms. 2024-05-11T00:51:12.076 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-11T00:51:12.076 INFO:teuthology.task.kernel:Updating grub on smithi174 to boot 5.14.0-444.el9.x86_64 2024-05-11T00:51:12.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-11T00:51:12.678 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2024-05-11T00:51:13.995 INFO:teuthology.orchestra.run.smithi174.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-11T00:51:14.035 INFO:teuthology.orchestra.run.smithi174.stderr:done 2024-05-11T00:51:14.038 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-05-11T00:51:14.056 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.lxiFJATiOb 2024-05-11T00:51:14.057 DEBUG:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lxiFJATiOb 2024-05-11T00:51:14.124 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.lxiFJATiOb 2024-05-11T00:51:14.257 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.lxiFJATiOb is 6KB 2024-05-11T00:51:14.305 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.lxiFJATiOb 2024-05-11T00:51:14.319 DEBUG:teuthology.orchestra.run.smithi174:> sudo /bin/ls /boot/loader/entries || true 2024-05-11T00:51:14.382 INFO:teuthology.orchestra.run.smithi174.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-11T00:51:14.382 INFO:teuthology.orchestra.run.smithi174.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-11T00:51:14.382 INFO:teuthology.orchestra.run.smithi174.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-11T00:51:14.382 INFO:teuthology.orchestra.run.smithi174.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-11T00:51:14.383 DEBUG:teuthology.orchestra.run.smithi174:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-11T00:51:14.529 DEBUG:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2024-05-11T00:51:18.342 INFO:teuthology.orchestra.run.smithi016.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 781 kB/s | 34 MB 00:44 2024-05-11T00:51:18.342 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-05-11T00:51:18.342 INFO:teuthology.orchestra.run.smithi016.stdout:Total 1.7 MB/s | 78 MB 00:44 2024-05-11T00:51:19.042 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-05-11T00:51:19.432 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-05-11T00:51:19.432 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-05-11T00:51:20.387 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-05-11T00:51:20.387 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-05-11T00:51:22.923 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-05-11T00:51:23.591 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-11T00:51:23.676 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-11T00:51:26.496 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-11T00:51:26.629 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-11T00:51:31.698 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-11T00:51:31.740 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:51:36.829 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:51:44.532 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-11T00:51:44.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-11T00:51:44.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:52:02.974 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-05-11T00:52:08.026 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:52:08.066 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:52:08.404 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:52:08.404 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-11T00:52:08.404 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-11T00:52:08.405 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-11T00:52:09.231 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-11T00:52:09.231 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:52:09.232 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-05-11T00:52:09.232 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-11T00:52:09.232 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-11T00:52:09.232 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-11T00:52:09.232 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-11T00:52:09.233 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:52:09.233 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-05-11T00:52:09.610 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-05-11T00:52:09.674 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-11T00:52:09.674 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-11T00:52:09.674 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-11T00:52:09.674 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-11T00:52:09.675 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-11T00:52:09.675 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-11T00:52:09.675 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2024-05-11T00:52:09.675 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-05-11T00:52:09.726 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-11T00:52:09.726 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-11T00:52:09.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -qi grub2-tools 2024-05-11T00:52:09.765 INFO:teuthology.orchestra.run.smithi016.stdout:Name : grub2-tools 2024-05-11T00:52:09.765 INFO:teuthology.orchestra.run.smithi016.stdout:Epoch : 1 2024-05-11T00:52:09.765 INFO:teuthology.orchestra.run.smithi016.stdout:Version : 2.06 2024-05-11T00:52:09.765 INFO:teuthology.orchestra.run.smithi016.stdout:Release : 68.el9 2024-05-11T00:52:09.765 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: x86_64 2024-05-11T00:52:09.765 INFO:teuthology.orchestra.run.smithi016.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Group : Unspecified 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Size : 8264254 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:License : GPLv3+ 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Packager : builder@centos.org 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Vendor : CentOS 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-11T00:52:09.766 INFO:teuthology.orchestra.run.smithi016.stdout:Summary : Support tools for GRUB. 2024-05-11T00:52:09.767 INFO:teuthology.orchestra.run.smithi016.stdout:Description : 2024-05-11T00:52:09.767 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:52:09.767 INFO:teuthology.orchestra.run.smithi016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-11T00:52:09.767 INFO:teuthology.orchestra.run.smithi016.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-11T00:52:09.767 INFO:teuthology.orchestra.run.smithi016.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-11T00:52:09.767 INFO:teuthology.orchestra.run.smithi016.stdout:hardware devices. 2024-05-11T00:52:09.767 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:52:09.767 INFO:teuthology.orchestra.run.smithi016.stdout:This subpackage provides tools for support of all platforms. 2024-05-11T00:52:09.768 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-11T00:52:09.768 INFO:teuthology.task.kernel:Updating grub on smithi016 to boot 5.14.0-444.el9.x86_64 2024-05-11T00:52:09.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-11T00:52:10.432 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-05-11T00:52:11.946 INFO:teuthology.orchestra.run.smithi016.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-11T00:52:11.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-11T00:52:11.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:52:11.994 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-05-11T00:52:11.997 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-05-11T00:52:12.012 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.pRpzth7oA4 2024-05-11T00:52:12.012 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pRpzth7oA4 2024-05-11T00:52:12.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.pRpzth7oA4 2024-05-11T00:52:12.214 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.pRpzth7oA4 is 6KB 2024-05-11T00:52:12.263 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.pRpzth7oA4 2024-05-11T00:52:12.278 DEBUG:teuthology.orchestra.run.smithi016:> sudo /bin/ls /boot/loader/entries || true 2024-05-11T00:52:12.340 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-11T00:52:12.341 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-11T00:52:12.341 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-11T00:52:12.341 INFO:teuthology.orchestra.run.smithi016.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-11T00:52:12.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-11T00:52:12.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-05-11T00:52:15.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-05-11T00:52:27.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-11T00:52:27.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:52:42.490 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-11T00:52:42.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-11T00:52:42.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:52:58.905 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-05-11T00:52:59.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-11T00:52:59.452 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-444.el9.x86_64"... 2024-05-11T00:52:59.453 DEBUG:teuthology.orchestra.run.smithi174:> uname -r 2024-05-11T00:52:59.467 INFO:teuthology.orchestra.run.smithi174.stdout:5.14.0-444.el9.x86_64 2024-05-11T00:52:59.468 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-11T00:52:59.468 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-11T00:52:59.468 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-11T00:53:00.468 DEBUG:teuthology.parallel:result is None 2024-05-11T00:53:00.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-05-11T00:53:09.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-11T00:53:09.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:53:12.894 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-05-11T00:53:24.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-11T00:53:24.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:53:27.970 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-05-11T00:53:42.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-11T00:53:42.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:54:14.948 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-05-11T00:54:15.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-11T00:54:15.316 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-11T00:54:15.316 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-05-11T00:54:15.332 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-444.el9.x86_64 2024-05-11T00:54:15.332 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-11T00:54:15.332 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-11T00:54:15.332 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-11T00:54:16.333 DEBUG:teuthology.parallel:result is None 2024-05-11T00:54:16.334 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-11T00:54:16.341 INFO:teuthology.task.internal:Creating test directory... 2024-05-11T00:54:16.341 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-11T00:54:16.344 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-11T00:54:16.365 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-11T00:54:16.371 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-11T00:54:16.381 INFO:teuthology.task.internal:Creating archive directory... 2024-05-11T00:54:16.382 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-11T00:54:16.402 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-11T00:54:16.444 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-11T00:54:16.450 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-11T00:54:16.451 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-11T00:54:16.468 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-11T00:54:16.534 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-11T00:54:16.564 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-11T00:54:16.564 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-11T00:54:16.619 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-11T00:54:16.621 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-11T00:54:16.628 INFO:teuthology.task.internal:Configuring sudo... 2024-05-11T00:54:16.629 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-11T00:54:16.633 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-11T00:54:16.663 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-11T00:54:16.675 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-11T00:54:16.675 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-11T00:54:16.707 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-11T00:54:16.724 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-11T00:54:16.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-11T00:54:16.848 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-11T00:54:16.929 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-11T00:54:16.972 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T00:54:16.972 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-11T00:54:17.038 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-11T00:54:17.082 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-11T00:54:17.146 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-11T00:54:17.191 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-11T00:54:17.233 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T00:54:17.233 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-11T00:54:17.300 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-05-11T00:54:17.302 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-05-11T00:54:17.378 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-11T00:54:17.387 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-11T00:54:17.717 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-11T00:54:17.724 INFO:teuthology.task.internal:Starting timer... 2024-05-11T00:54:17.724 INFO:teuthology.run_tasks:Running task pcp... 2024-05-11T00:54:17.734 INFO:teuthology.run_tasks:Running task selinux... 2024-05-11T00:54:17.742 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-11T00:54:17.742 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2024-05-11T00:54:17.848 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2024-05-11T00:54:17.856 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-05-11T00:54:17.903 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-05-11T00:54:17.905 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-11T00:54:17.905 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2024-05-11T00:54:17.942 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2024-05-11T00:54:17.942 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-05-11T00:54:17.974 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-05-11T00:54:17.975 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-05-11T00:54:17.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-11T00:54:18.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T00:54:18.036 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-11T00:54:18.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T00:54:18.061 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-11T00:54:18.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2024-05-11T00:54:18.440 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-05-11T00:54:18.468 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-11T00:54:18.479 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-11T00:54:18.498 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-11T00:54:18.500 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-11T00:58:22.964 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-05-11T00:58:22.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-11T00:58:22.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:58:23.044 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-05-11T00:58:23.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-05-11T00:58:23.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-11T00:58:23.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-11T00:58:23.202 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-05-11T00:58:23.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-05-11T00:58:23.291 INFO:teuthology.run_tasks:Running task clock... 2024-05-11T00:58:23.301 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-11T00:58:23.301 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-11T00:58:23.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-11T00:58:23.304 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-11T00:58:23.304 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-11T00:58:23.338 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-11T00:58:23.351 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-11T00:58:23.361 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-11T00:58:23.375 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-11T00:58:23.378 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2024-05-11T00:58:23.390 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2024-05-11T00:58:23.405 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-11T00:58:23.411 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-05-11T00:58:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-11T00:58:23.423 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-05-11T00:58:23.438 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-11T00:58:23.453 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-11T00:58:23.480 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-05-11T00:58:23.484 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-11T00:58:23.484 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-05-11T00:58:23.484 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T00:58:23.484 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T00:58:23.484 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T00:58:23.485 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T00:58:23.506 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-05-11T00:58:23.509 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-11T00:58:23.509 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-05-11T00:58:23.509 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T00:58:23.509 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T00:58:23.509 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T00:58:23.509 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T00:58:23.510 INFO:teuthology.run_tasks:Running task install... 2024-05-11T00:58:23.519 DEBUG:teuthology.task.install:project ceph 2024-05-11T00:58:23.519 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29'}} 2024-05-11T00:58:23.519 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29'} 2024-05-11T00:58:23.519 INFO:teuthology.task.install:Using flavor: default 2024-05-11T00:58:23.525 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-11T00:58:23.525 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-11T00:58:23.525 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29', 'tag': None, 'wait_for_package': False} 2024-05-11T00:58:23.526 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=10380055a1fc5e7d3b37b252af7045f5c2c8ba29 2024-05-11T00:58:23.528 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29', 'tag': None, 'wait_for_package': False} 2024-05-11T00:58:23.528 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=10380055a1fc5e7d3b37b252af7045f5c2c8ba29 2024-05-11T00:58:23.667 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/centos/9/flavors/default/ 2024-05-11T00:58:23.667 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3570.g10380055 2024-05-11T00:58:23.671 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/centos/9/flavors/default/ 2024-05-11T00:58:23.672 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3570.g10380055 2024-05-11T00:58:23.851 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-11T00:58:23.852 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T00:58:23.852 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-11T00:58:23.877 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-11T00:58:23.878 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-11T00:58:23.895 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-11T00:58:23.895 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T00:58:23.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-11T00:58:23.925 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-11T00:58:23.925 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/10380055a1fc5e7d3b37b252af7045f5c2c8ba29/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-11T00:58:23.944 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-11T00:58:23.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-11T00:58:24.020 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-11T00:58:24.074 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-11T00:58:24.084 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-05-11T00:58:24.086 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-05-11T00:58:24.143 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2024-05-11T00:58:24.144 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2024-05-11T00:58:24.328 INFO:teuthology.orchestra.run.smithi174.stdout:54 files removed 2024-05-11T00:58:24.357 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-11T00:58:24.392 INFO:teuthology.orchestra.run.smithi016.stdout:54 files removed 2024-05-11T00:58:24.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-11T00:58:25.114 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-05-11T00:58:25.598 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 27 kB/s | 12 kB 00:00 2024-05-11T00:58:25.990 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-05-11T00:58:26.354 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 51 kB/s | 84 kB 00:01 2024-05-11T00:58:26.854 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 27 kB/s | 12 kB 00:00 2024-05-11T00:58:28.372 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 1.3 kB/s | 1.9 kB 00:01 2024-05-11T00:58:28.913 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-11T00:58:30.756 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-05-11T00:58:31.681 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.1 MB 00:05 2024-05-11T00:58:34.899 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 19 MB 00:02 2024-05-11T00:58:36.541 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.2 MB 00:02 2024-05-11T00:58:38.833 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.2 MB 00:00 2024-05-11T00:58:39.033 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-05-11T00:58:40.584 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 16 kB 00:00 2024-05-11T00:58:42.488 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-11T00:58:43.413 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 21 MB 00:04 2024-05-11T00:58:47.635 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-11T00:58:48.685 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-05-11T00:58:49.987 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-11T00:58:49.988 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-11T00:58:49.999 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-11T00:58:50.000 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-11T00:58:50.001 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-11T00:58:50.001 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-11T00:58:50.003 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-11T00:58:50.005 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-11T00:58:50.006 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-11T00:58:50.068 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-05-11T00:58:50.092 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-05-11T00:58:50.092 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-05-11T00:58:50.092 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-05-11T00:58:50.092 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-05-11T00:58:50.092 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.0.0-3570.g10380055.el9 ceph 6.6 k 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.0.0-3570.g10380055.el9 ceph 5.4 M 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.0.0-3570.g10380055.el9 ceph 890 k 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3570.g10380055.el9 ceph 145 k 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.0.0-3570.g10380055.el9 ceph 1.5 M 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 142 k 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 3.5 M 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 7.4 M 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 49 k 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.0.0-3570.g10380055.el9 ceph 11 M 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.0.0-3570.g10380055.el9 ceph 49 M 2024-05-11T00:58:50.093 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 273 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 763 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.0.0-3570.g10380055.el9 ceph 224 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.0.0-3570.g10380055.el9 ceph 27 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 18 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.0.0-3570.g10380055.el9 ceph 32 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.0.0-3570.g10380055.el9 ceph 747 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.0.0-3570.g10380055.el9 ceph 127 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-11T00:58:50.094 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.0.0-3570.g10380055.el9 ceph 161 k 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.0.0-3570.g10380055.el9 ceph 321 k 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.0.0-3570.g10380055.el9 ceph 300 k 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.0.0-3570.g10380055.el9 ceph 99 k 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.0.0-3570.g10380055.el9 ceph 85 k 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.0.0-3570.g10380055.el9 ceph 3.1 M 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.0.0-3570.g10380055.el9 ceph 170 k 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-11T00:58:50.095 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.0.0-3570.g10380055.el9 ceph 3.4 M 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.0.0-3570.g10380055.el9 ceph 3.1 M 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.0.0-3570.g10380055.el9 ceph 21 M 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 34 k 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.0.0-3570.g10380055.el9 ceph 2.4 M 2024-05-11T00:58:50.096 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 274 k 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.0.0-3570.g10380055.el9 ceph 4.7 M 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.0.0-3570.g10380055.el9 ceph 17 M 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 16 k 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.0.0-3570.g10380055.el9 ceph 25 k 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-11T00:58:50.097 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.0.0-3570.g10380055.el9 ceph 164 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.0.0-3570.g10380055.el9 ceph 501 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.0.0-3570.g10380055.el9 ceph 5.4 M 2024-05-11T00:58:50.098 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-11T00:58:50.099 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.0.0-3570.g10380055.el9 ceph 45 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.0.0-3570.g10380055.el9 ceph 135 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-11T00:58:50.100 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-11T00:58:50.101 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-11T00:58:50.102 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-11T00:58:50.103 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-05-11T00:58:50.104 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-05-11T00:58:50.105 INFO:teuthology.orchestra.run.smithi174.stdout:Install 148 Packages 2024-05-11T00:58:50.105 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 8 Packages 2024-05-11T00:58:50.105 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:58:50.105 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 226 M 2024-05-11T00:58:50.105 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-05-11T00:58:50.662 INFO:teuthology.orchestra.run.smithi174.stdout:(1/156): ceph-19.0.0-3570.g10380055.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-05-11T00:58:51.104 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-11T00:58:51.105 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-11T00:58:51.116 INFO:teuthology.orchestra.run.smithi016.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-11T00:58:51.117 INFO:teuthology.orchestra.run.smithi016.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-11T00:58:51.118 INFO:teuthology.orchestra.run.smithi016.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-11T00:58:51.119 INFO:teuthology.orchestra.run.smithi016.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-11T00:58:51.120 INFO:teuthology.orchestra.run.smithi016.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-11T00:58:51.123 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-11T00:58:51.123 INFO:teuthology.orchestra.run.smithi016.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-11T00:58:51.189 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-05-11T00:58:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-05-11T00:58:51.212 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-05-11T00:58:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-05-11T00:58:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-05-11T00:58:51.212 INFO:teuthology.orchestra.run.smithi016.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:19.0.0-3570.g10380055.el9 ceph 6.6 k 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:19.0.0-3570.g10380055.el9 ceph 5.4 M 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:19.0.0-3570.g10380055.el9 ceph 890 k 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3570.g10380055.el9 ceph 145 k 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:19.0.0-3570.g10380055.el9 ceph 1.5 M 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 142 k 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 3.5 M 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 7.4 M 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 49 k 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:19.0.0-3570.g10380055.el9 ceph 11 M 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:19.0.0-3570.g10380055.el9 ceph 49 M 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 273 k 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 763 k 2024-05-11T00:58:51.213 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror x86_64 2:19.0.0-3570.g10380055.el9 ceph 224 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell x86_64 2:19.0.0-3570.g10380055.el9 ceph 27 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 18 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:19.0.0-3570.g10380055.el9 ceph 32 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:19.0.0-3570.g10380055.el9 ceph 747 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:19.0.0-3570.g10380055.el9 ceph 127 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-11T00:58:51.214 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:19.0.0-3570.g10380055.el9 ceph 161 k 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:19.0.0-3570.g10380055.el9 ceph 321 k 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:19.0.0-3570.g10380055.el9 ceph 300 k 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:19.0.0-3570.g10380055.el9 ceph 99 k 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:19.0.0-3570.g10380055.el9 ceph 85 k 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:19.0.0-3570.g10380055.el9 ceph 3.1 M 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:19.0.0-3570.g10380055.el9 ceph 170 k 2024-05-11T00:58:51.215 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:19.0.0-3570.g10380055.el9 ceph 3.4 M 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:19.0.0-3570.g10380055.el9 ceph 3.1 M 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-11T00:58:51.216 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:19.0.0-3570.g10380055.el9 ceph 21 M 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 34 k 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:19.0.0-3570.g10380055.el9 ceph 2.4 M 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 274 k 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:19.0.0-3570.g10380055.el9 ceph 4.7 M 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:19.0.0-3570.g10380055.el9 ceph 17 M 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3570.g10380055.el9 ceph-noarch 16 k 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:19.0.0-3570.g10380055.el9 ceph 25 k 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-11T00:58:51.217 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-11T00:58:51.218 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-11T00:58:51.218 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-11T00:58:51.218 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-11T00:58:51.218 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-11T00:58:51.218 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:19.0.0-3570.g10380055.el9 ceph 164 k 2024-05-11T00:58:51.218 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-11T00:58:51.218 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:19.0.0-3570.g10380055.el9 ceph 501 k 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:19.0.0-3570.g10380055.el9 ceph 5.4 M 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-11T00:58:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-11T00:58:51.220 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse x86_64 2:19.0.0-3570.g10380055.el9 ceph 45 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:19.0.0-3570.g10380055.el9 ceph 135 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-11T00:58:51.221 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-11T00:58:51.222 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-11T00:58:51.222 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-11T00:58:51.222 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-11T00:58:51.222 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-11T00:58:51.222 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-11T00:58:51.222 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-11T00:58:51.222 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-11T00:58:51.222 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-11T00:58:51.223 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-11T00:58:51.224 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-11T00:58:51.225 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout:Installing weak dependencies: 2024-05-11T00:58:51.226 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-11T00:58:51.227 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:58:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-05-11T00:58:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================= 2024-05-11T00:58:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:Install 148 Packages 2024-05-11T00:58:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 8 Packages 2024-05-11T00:58:51.227 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:58:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 226 M 2024-05-11T00:58:51.228 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-05-11T00:58:51.645 INFO:teuthology.orchestra.run.smithi174.stdout:(2/156): ceph-fuse-19.0.0-3570.g10380055.el9.x8 906 kB/s | 890 kB 00:00 2024-05-11T00:58:51.871 INFO:teuthology.orchestra.run.smithi174.stdout:(3/156): ceph-immutable-object-cache-19.0.0-357 644 kB/s | 145 kB 00:00 2024-05-11T00:58:52.128 INFO:teuthology.orchestra.run.smithi016.stdout:(1/156): ceph-19.0.0-3570.g10380055.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-05-11T00:58:52.970 INFO:teuthology.orchestra.run.smithi016.stdout:(2/156): ceph-fuse-19.0.0-3570.g10380055.el9.x8 1.0 MB/s | 890 kB 00:00 2024-05-11T00:58:53.095 INFO:teuthology.orchestra.run.smithi016.stdout:(3/156): ceph-base-19.0.0-3570.g10380055.el9.x8 3.7 MB/s | 5.4 MB 00:01 2024-05-11T00:58:53.120 INFO:teuthology.orchestra.run.smithi016.stdout:(4/156): ceph-immutable-object-cache-19.0.0-357 964 kB/s | 145 kB 00:00 2024-05-11T00:58:53.462 INFO:teuthology.orchestra.run.smithi016.stdout:(5/156): ceph-mds-19.0.0-3570.g10380055.el9.x86 6.4 MB/s | 2.4 MB 00:00 2024-05-11T00:58:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:(6/156): ceph-mgr-19.0.0-3570.g10380055.el9.x86 2.0 MB/s | 1.5 MB 00:00 2024-05-11T00:58:54.065 INFO:teuthology.orchestra.run.smithi016.stdout:(7/156): ceph-mon-19.0.0-3570.g10380055.el9.x86 7.8 MB/s | 4.7 MB 00:00 2024-05-11T00:58:55.047 INFO:teuthology.orchestra.run.smithi016.stdout:(8/156): ceph-radosgw-19.0.0-3570.g10380055.el9 11 MB/s | 11 MB 00:00 2024-05-11T00:58:55.114 INFO:teuthology.orchestra.run.smithi016.stdout:(9/156): ceph-selinux-19.0.0-3570.g10380055.el9 378 kB/s | 25 kB 00:00 2024-05-11T00:58:55.187 INFO:teuthology.orchestra.run.smithi174.stdout:(4/156): ceph-mds-19.0.0-3570.g10380055.el9.x86 730 kB/s | 2.4 MB 00:03 2024-05-11T00:58:55.329 INFO:teuthology.orchestra.run.smithi174.stdout:(5/156): ceph-base-19.0.0-3570.g10380055.el9.x8 1.1 MB/s | 5.4 MB 00:04 2024-05-11T00:58:57.296 INFO:teuthology.orchestra.run.smithi174.stdout:(6/156): ceph-mgr-19.0.0-3570.g10380055.el9.x86 735 kB/s | 1.5 MB 00:02 2024-05-11T00:58:58.913 INFO:teuthology.orchestra.run.smithi174.stdout:(7/156): ceph-mon-19.0.0-3570.g10380055.el9.x86 1.3 MB/s | 4.7 MB 00:03 2024-05-11T00:58:59.297 INFO:teuthology.orchestra.run.smithi016.stdout:(10/156): ceph-test-19.0.0-3570.g10380055.el9.x 12 MB/s | 49 MB 00:04 2024-05-11T00:58:59.329 INFO:teuthology.orchestra.run.smithi174.stdout:(8/156): ceph-common-19.0.0-3570.g10380055.el9. 2.4 MB/s | 21 MB 00:08 2024-05-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi016.stdout:(11/156): cephfs-mirror-19.0.0-3570.g10380055.e 3.3 MB/s | 224 kB 00:00 2024-05-11T00:58:59.388 INFO:teuthology.orchestra.run.smithi174.stdout:(9/156): ceph-selinux-19.0.0-3570.g10380055.el9 433 kB/s | 25 kB 00:00 2024-05-11T00:58:59.422 INFO:teuthology.orchestra.run.smithi016.stdout:(12/156): cephfs-shell-19.0.0-3570.g10380055.el 463 kB/s | 27 kB 00:00 2024-05-11T00:58:59.472 INFO:teuthology.orchestra.run.smithi016.stdout:(13/156): libcephfs-devel-19.0.0-3570.g10380055 636 kB/s | 32 kB 00:00 2024-05-11T00:58:59.581 INFO:teuthology.orchestra.run.smithi016.stdout:(14/156): libcephfs2-19.0.0-3570.g10380055.el9. 6.7 MB/s | 747 kB 00:00 2024-05-11T00:58:59.640 INFO:teuthology.orchestra.run.smithi016.stdout:(15/156): libcephsqlite-19.0.0-3570.g10380055.e 2.8 MB/s | 164 kB 00:00 2024-05-11T00:58:59.715 INFO:teuthology.orchestra.run.smithi016.stdout:(16/156): librados-devel-19.0.0-3570.g10380055. 1.7 MB/s | 127 kB 00:00 2024-05-11T00:58:59.841 INFO:teuthology.orchestra.run.smithi016.stdout:(17/156): libradosstriper1-19.0.0-3570.g1038005 3.9 MB/s | 501 kB 00:00 2024-05-11T00:59:00.375 INFO:teuthology.orchestra.run.smithi016.stdout:(18/156): librgw2-19.0.0-3570.g10380055.el9.x86 10 MB/s | 5.4 MB 00:00 2024-05-11T00:59:00.441 INFO:teuthology.orchestra.run.smithi016.stdout:(19/156): python3-ceph-argparse-19.0.0-3570.g10 681 kB/s | 45 kB 00:00 2024-05-11T00:59:00.508 INFO:teuthology.orchestra.run.smithi016.stdout:(20/156): python3-ceph-common-19.0.0-3570.g1038 2.0 MB/s | 135 kB 00:00 2024-05-11T00:59:00.584 INFO:teuthology.orchestra.run.smithi016.stdout:(21/156): python3-cephfs-19.0.0-3570.g10380055. 2.1 MB/s | 161 kB 00:00 2024-05-11T00:59:00.667 INFO:teuthology.orchestra.run.smithi016.stdout:(22/156): python3-rados-19.0.0-3570.g10380055.e 3.8 MB/s | 321 kB 00:00 2024-05-11T00:59:00.751 INFO:teuthology.orchestra.run.smithi016.stdout:(23/156): python3-rbd-19.0.0-3570.g10380055.el9 3.5 MB/s | 300 kB 00:00 2024-05-11T00:59:00.801 INFO:teuthology.orchestra.run.smithi016.stdout:(24/156): python3-rgw-19.0.0-3570.g10380055.el9 1.9 MB/s | 99 kB 00:00 2024-05-11T00:59:00.877 INFO:teuthology.orchestra.run.smithi016.stdout:(25/156): rbd-fuse-19.0.0-3570.g10380055.el9.x8 1.1 MB/s | 85 kB 00:00 2024-05-11T00:59:01.410 INFO:teuthology.orchestra.run.smithi016.stdout:(26/156): ceph-common-19.0.0-3570.g10380055.el9 2.2 MB/s | 21 MB 00:09 2024-05-11T00:59:01.485 INFO:teuthology.orchestra.run.smithi016.stdout:(27/156): rbd-mirror-19.0.0-3570.g10380055.el9. 5.1 MB/s | 3.1 MB 00:00 2024-05-11T00:59:01.527 INFO:teuthology.orchestra.run.smithi016.stdout:(28/156): rbd-nbd-19.0.0-3570.g10380055.el9.x86 1.4 MB/s | 170 kB 00:00 2024-05-11T00:59:01.552 INFO:teuthology.orchestra.run.smithi016.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3570.g 513 kB/s | 34 kB 00:00 2024-05-11T00:59:01.569 INFO:teuthology.orchestra.run.smithi016.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3570.g1038005 3.3 MB/s | 142 kB 00:00 2024-05-11T00:59:01.870 INFO:teuthology.orchestra.run.smithi016.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3570.g10380 11 MB/s | 3.5 MB 00:00 2024-05-11T00:59:01.928 INFO:teuthology.orchestra.run.smithi016.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3570.g10 4.6 MB/s | 274 kB 00:00 2024-05-11T00:59:01.979 INFO:teuthology.orchestra.run.smithi016.stdout:(33/156): ceph-mgr-rook-19.0.0-3570.g10380055.e 988 kB/s | 49 kB 00:00 2024-05-11T00:59:02.029 INFO:teuthology.orchestra.run.smithi016.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3570.g1 330 kB/s | 16 kB 00:00 2024-05-11T00:59:02.104 INFO:teuthology.orchestra.run.smithi016.stdout:(35/156): ceph-volume-19.0.0-3570.g10380055.el9 3.6 MB/s | 273 kB 00:00 2024-05-11T00:59:02.196 INFO:teuthology.orchestra.run.smithi016.stdout:(36/156): cephadm-19.0.0-3570.g10380055.el9.noa 8.1 MB/s | 763 kB 00:00 2024-05-11T00:59:02.238 INFO:teuthology.orchestra.run.smithi016.stdout:(37/156): cephfs-top-19.0.0-3570.g10380055.el9. 438 kB/s | 18 kB 00:00 2024-05-11T00:59:02.297 INFO:teuthology.orchestra.run.smithi016.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-05-11T00:59:02.397 INFO:teuthology.orchestra.run.smithi016.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 7.9 MB/s | 803 kB 00:00 2024-05-11T00:59:02.473 INFO:teuthology.orchestra.run.smithi016.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-05-11T00:59:02.548 INFO:teuthology.orchestra.run.smithi016.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-05-11T00:59:02.657 INFO:teuthology.orchestra.run.smithi016.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-05-11T00:59:02.723 INFO:teuthology.orchestra.run.smithi016.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-11T00:59:02.790 INFO:teuthology.orchestra.run.smithi016.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-11T00:59:02.874 INFO:teuthology.orchestra.run.smithi016.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-11T00:59:02.946 INFO:teuthology.orchestra.run.smithi174.stdout:(10/156): ceph-radosgw-19.0.0-3570.g10380055.el 2.6 MB/s | 11 MB 00:04 2024-05-11T00:59:03.013 INFO:teuthology.orchestra.run.smithi174.stdout:(11/156): cephfs-mirror-19.0.0-3570.g10380055.e 3.3 MB/s | 224 kB 00:00 2024-05-11T00:59:03.016 INFO:teuthology.orchestra.run.smithi016.stdout:(46/156): ceph-mgr-diskprediction-local-19.0.0- 5.1 MB/s | 7.4 MB 00:01 2024-05-11T00:59:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-05-11T00:59:03.047 INFO:teuthology.orchestra.run.smithi174.stdout:(12/156): cephfs-shell-19.0.0-3570.g10380055.el 814 kB/s | 27 kB 00:00 2024-05-11T00:59:03.080 INFO:teuthology.orchestra.run.smithi174.stdout:(13/156): libcephfs-devel-19.0.0-3570.g10380055 955 kB/s | 32 kB 00:00 2024-05-11T00:59:03.239 INFO:teuthology.orchestra.run.smithi174.stdout:(14/156): libcephfs2-19.0.0-3570.g10380055.el9. 4.6 MB/s | 747 kB 00:00 2024-05-11T00:59:03.306 INFO:teuthology.orchestra.run.smithi174.stdout:(15/156): libcephsqlite-19.0.0-3570.g10380055.e 2.4 MB/s | 164 kB 00:00 2024-05-11T00:59:03.356 INFO:teuthology.orchestra.run.smithi174.stdout:(16/156): librados-devel-19.0.0-3570.g10380055. 2.5 MB/s | 127 kB 00:00 2024-05-11T00:59:03.492 INFO:teuthology.orchestra.run.smithi016.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 943 kB 00:00 2024-05-11T00:59:03.550 INFO:teuthology.orchestra.run.smithi016.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-05-11T00:59:03.609 INFO:teuthology.orchestra.run.smithi016.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 370 kB/s | 21 kB 00:00 2024-05-11T00:59:03.634 INFO:teuthology.orchestra.run.smithi016.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-05-11T00:59:03.693 INFO:teuthology.orchestra.run.smithi016.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-05-11T00:59:03.715 INFO:teuthology.orchestra.run.smithi174.stdout:(17/156): libradosstriper1-19.0.0-3570.g1038005 1.4 MB/s | 501 kB 00:00 2024-05-11T00:59:03.741 INFO:teuthology.orchestra.run.smithi016.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-05-11T00:59:03.802 INFO:teuthology.orchestra.run.smithi016.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 300 kB/s | 18 kB 00:00 2024-05-11T00:59:03.860 INFO:teuthology.orchestra.run.smithi016.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-05-11T00:59:03.919 INFO:teuthology.orchestra.run.smithi016.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-11T00:59:03.978 INFO:teuthology.orchestra.run.smithi016.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-05-11T00:59:04.145 INFO:teuthology.orchestra.run.smithi016.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-05-11T00:59:04.270 INFO:teuthology.orchestra.run.smithi016.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 4.6 MB/s | 582 kB 00:00 2024-05-11T00:59:04.329 INFO:teuthology.orchestra.run.smithi016.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 437 kB/s | 25 kB 00:00 2024-05-11T00:59:04.387 INFO:teuthology.orchestra.run.smithi016.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-05-11T00:59:04.504 INFO:teuthology.orchestra.run.smithi016.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-05-11T00:59:04.580 INFO:teuthology.orchestra.run.smithi016.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-05-11T00:59:04.623 INFO:teuthology.orchestra.run.smithi174.stdout:(18/156): librgw2-19.0.0-3570.g10380055.el9.x86 5.9 MB/s | 5.4 MB 00:00 2024-05-11T00:59:04.663 INFO:teuthology.orchestra.run.smithi016.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.1 MB/s | 3.0 MB 00:00 2024-05-11T00:59:04.665 INFO:teuthology.orchestra.run.smithi174.stdout:(19/156): python3-ceph-argparse-19.0.0-3570.g10 1.1 MB/s | 45 kB 00:00 2024-05-11T00:59:04.689 INFO:teuthology.orchestra.run.smithi016.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 325 kB/s | 35 kB 00:00 2024-05-11T00:59:04.716 INFO:teuthology.orchestra.run.smithi174.stdout:(20/156): python3-ceph-common-19.0.0-3570.g1038 2.6 MB/s | 135 kB 00:00 2024-05-11T00:59:04.782 INFO:teuthology.orchestra.run.smithi174.stdout:(21/156): python3-cephfs-19.0.0-3570.g10380055. 2.4 MB/s | 161 kB 00:00 2024-05-11T00:59:04.902 INFO:teuthology.orchestra.run.smithi174.stdout:(22/156): python3-rados-19.0.0-3570.g10380055.e 2.6 MB/s | 321 kB 00:00 2024-05-11T00:59:04.966 INFO:teuthology.orchestra.run.smithi174.stdout:(23/156): python3-rbd-19.0.0-3570.g10380055.el9 4.5 MB/s | 300 kB 00:00 2024-05-11T00:59:05.017 INFO:teuthology.orchestra.run.smithi174.stdout:(24/156): python3-rgw-19.0.0-3570.g10380055.el9 1.9 MB/s | 99 kB 00:00 2024-05-11T00:59:05.067 INFO:teuthology.orchestra.run.smithi174.stdout:(25/156): rbd-fuse-19.0.0-3570.g10380055.el9.x8 1.7 MB/s | 85 kB 00:00 2024-05-11T00:59:05.567 INFO:teuthology.orchestra.run.smithi174.stdout:(26/156): rbd-mirror-19.0.0-3570.g10380055.el9. 6.2 MB/s | 3.1 MB 00:00 2024-05-11T00:59:05.609 INFO:teuthology.orchestra.run.smithi174.stdout:(27/156): rbd-nbd-19.0.0-3570.g10380055.el9.x86 4.0 MB/s | 170 kB 00:00 2024-05-11T00:59:05.651 INFO:teuthology.orchestra.run.smithi174.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3570.g 823 kB/s | 34 kB 00:00 2024-05-11T00:59:05.702 INFO:teuthology.orchestra.run.smithi174.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3570.g1038005 2.8 MB/s | 142 kB 00:00 2024-05-11T00:59:05.781 INFO:teuthology.orchestra.run.smithi016.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 4.2 MB/s | 4.7 MB 00:01 2024-05-11T00:59:06.048 INFO:teuthology.orchestra.run.smithi016.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 6.0 MB/s | 1.6 MB 00:00 2024-05-11T00:59:06.256 INFO:teuthology.orchestra.run.smithi016.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2024-05-11T00:59:06.290 INFO:teuthology.orchestra.run.smithi016.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 911 kB 00:00 2024-05-11T00:59:06.310 INFO:teuthology.orchestra.run.smithi174.stdout:(30/156): ceph-test-19.0.0-3570.g10380055.el9.x 7.1 MB/s | 49 MB 00:06 2024-05-11T00:59:06.373 INFO:teuthology.orchestra.run.smithi016.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-05-11T00:59:06.511 INFO:teuthology.orchestra.run.smithi174.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3570.g10380 4.4 MB/s | 3.5 MB 00:00 2024-05-11T00:59:06.594 INFO:teuthology.orchestra.run.smithi174.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3570.g10 3.2 MB/s | 274 kB 00:00 2024-05-11T00:59:06.644 INFO:teuthology.orchestra.run.smithi174.stdout:(33/156): ceph-mgr-rook-19.0.0-3570.g10380055.e 990 kB/s | 49 kB 00:00 2024-05-11T00:59:06.695 INFO:teuthology.orchestra.run.smithi174.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3570.g1 328 kB/s | 16 kB 00:00 2024-05-11T00:59:06.770 INFO:teuthology.orchestra.run.smithi174.stdout:(35/156): ceph-volume-19.0.0-3570.g10380055.el9 3.6 MB/s | 273 kB 00:00 2024-05-11T00:59:06.773 INFO:teuthology.orchestra.run.smithi016.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-05-11T00:59:06.849 INFO:teuthology.orchestra.run.smithi016.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-05-11T00:59:06.895 INFO:teuthology.orchestra.run.smithi174.stdout:(36/156): cephadm-19.0.0-3570.g10380055.el9.noa 6.0 MB/s | 763 kB 00:00 2024-05-11T00:59:06.946 INFO:teuthology.orchestra.run.smithi174.stdout:(37/156): cephfs-top-19.0.0-3570.g10380055.el9. 365 kB/s | 18 kB 00:00 2024-05-11T00:59:07.071 INFO:teuthology.orchestra.run.smithi174.stdout:(38/156): ceph-mgr-diskprediction-local-19.0.0- 9.7 MB/s | 7.4 MB 00:00 2024-05-11T00:59:07.149 INFO:teuthology.orchestra.run.smithi016.stdout:(73/156): postgresql-server-13.14-1.el9.x86_64. 6.7 MB/s | 5.8 MB 00:00 2024-05-11T00:59:07.208 INFO:teuthology.orchestra.run.smithi016.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-05-11T00:59:07.221 INFO:teuthology.orchestra.run.smithi174.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 292 kB/s | 80 kB 00:00 2024-05-11T00:59:07.267 INFO:teuthology.orchestra.run.smithi016.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-05-11T00:59:07.305 INFO:teuthology.orchestra.run.smithi174.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-05-11T00:59:07.325 INFO:teuthology.orchestra.run.smithi016.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 440 kB/s | 26 kB 00:00 2024-05-11T00:59:07.384 INFO:teuthology.orchestra.run.smithi016.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-05-11T00:59:07.388 INFO:teuthology.orchestra.run.smithi174.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-05-11T00:59:07.414 INFO:teuthology.orchestra.run.smithi174.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 803 kB 00:00 2024-05-11T00:59:07.443 INFO:teuthology.orchestra.run.smithi016.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-11T00:59:07.472 INFO:teuthology.orchestra.run.smithi174.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-11T00:59:07.501 INFO:teuthology.orchestra.run.smithi016.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 598 kB/s | 35 kB 00:00 2024-05-11T00:59:07.514 INFO:teuthology.orchestra.run.smithi174.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-05-11T00:59:07.573 INFO:teuthology.orchestra.run.smithi174.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-11T00:59:07.640 INFO:teuthology.orchestra.run.smithi174.stdout:(46/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-11T00:59:07.673 INFO:teuthology.orchestra.run.smithi174.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-05-11T00:59:08.040 INFO:teuthology.orchestra.run.smithi174.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 689 kB 00:00 2024-05-11T00:59:08.076 INFO:teuthology.orchestra.run.smithi016.stdout:(80/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.9 MB/s | 5.1 MB 00:00 2024-05-11T00:59:08.107 INFO:teuthology.orchestra.run.smithi174.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 2.1 MB/s | 943 kB 00:00 2024-05-11T00:59:08.132 INFO:teuthology.orchestra.run.smithi174.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-05-11T00:59:08.135 INFO:teuthology.orchestra.run.smithi016.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-05-11T00:59:08.166 INFO:teuthology.orchestra.run.smithi174.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-05-11T00:59:08.202 INFO:teuthology.orchestra.run.smithi016.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-11T00:59:08.233 INFO:teuthology.orchestra.run.smithi174.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-05-11T00:59:08.258 INFO:teuthology.orchestra.run.smithi174.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-05-11T00:59:08.325 INFO:teuthology.orchestra.run.smithi174.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-05-11T00:59:08.378 INFO:teuthology.orchestra.run.smithi016.stdout:(83/156): ceph-osd-19.0.0-3570.g10380055.el9.x8 1.2 MB/s | 17 MB 00:14 2024-05-11T00:59:08.401 INFO:teuthology.orchestra.run.smithi174.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-05-11T00:59:08.402 INFO:teuthology.orchestra.run.smithi016.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 385 kB/s | 77 kB 00:00 2024-05-11T00:59:08.476 INFO:teuthology.orchestra.run.smithi174.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-05-11T00:59:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-05-11T00:59:08.551 INFO:teuthology.orchestra.run.smithi174.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 604 kB/s | 45 kB 00:00 2024-05-11T00:59:08.553 INFO:teuthology.orchestra.run.smithi016.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-11T00:59:08.578 INFO:teuthology.orchestra.run.smithi016.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 211 kB/s | 42 kB 00:00 2024-05-11T00:59:08.679 INFO:teuthology.orchestra.run.smithi016.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-05-11T00:59:08.762 INFO:teuthology.orchestra.run.smithi016.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 643 kB/s | 54 kB 00:00 2024-05-11T00:59:08.902 INFO:teuthology.orchestra.run.smithi174.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-05-11T00:59:09.038 INFO:teuthology.orchestra.run.smithi016.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 576 kB/s | 279 kB 00:00 2024-05-11T00:59:09.077 INFO:teuthology.orchestra.run.smithi174.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.5 MB/s | 3.0 MB 00:00 2024-05-11T00:59:09.119 INFO:teuthology.orchestra.run.smithi174.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 2.6 MB/s | 582 kB 00:00 2024-05-11T00:59:09.138 INFO:teuthology.orchestra.run.smithi016.stdout:(91/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.6 MB/s | 6.0 MB 00:02 2024-05-11T00:59:09.144 INFO:teuthology.orchestra.run.smithi174.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 382 kB/s | 25 kB 00:00 2024-05-11T00:59:09.163 INFO:teuthology.orchestra.run.smithi016.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 332 kB/s | 42 kB 00:00 2024-05-11T00:59:09.178 INFO:teuthology.orchestra.run.smithi174.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-05-11T00:59:09.199 INFO:teuthology.orchestra.run.smithi016.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-05-11T00:59:09.222 INFO:teuthology.orchestra.run.smithi016.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-11T00:59:09.245 INFO:teuthology.orchestra.run.smithi174.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-05-11T00:59:09.256 INFO:teuthology.orchestra.run.smithi016.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-05-11T00:59:09.270 INFO:teuthology.orchestra.run.smithi174.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-11T00:59:09.281 INFO:teuthology.orchestra.run.smithi016.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-05-11T00:59:09.304 INFO:teuthology.orchestra.run.smithi174.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-05-11T00:59:09.340 INFO:teuthology.orchestra.run.smithi016.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 995 kB/s | 58 kB 00:00 2024-05-11T00:59:09.398 INFO:teuthology.orchestra.run.smithi016.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-11T00:59:09.424 INFO:teuthology.orchestra.run.smithi016.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 1.8 MB/s | 305 kB 00:00 2024-05-11T00:59:09.474 INFO:teuthology.orchestra.run.smithi016.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 844 kB/s | 64 kB 00:00 2024-05-11T00:59:09.499 INFO:teuthology.orchestra.run.smithi016.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 592 kB/s | 45 kB 00:00 2024-05-11T00:59:09.633 INFO:teuthology.orchestra.run.smithi016.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 141 kB/s | 22 kB 00:00 2024-05-11T00:59:09.833 INFO:teuthology.orchestra.run.smithi016.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-05-11T00:59:10.050 INFO:teuthology.orchestra.run.smithi016.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.3 MB/s | 548 kB 00:00 2024-05-11T00:59:10.126 INFO:teuthology.orchestra.run.smithi016.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-05-11T00:59:10.217 INFO:teuthology.orchestra.run.smithi016.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 805 kB/s | 309 kB 00:00 2024-05-11T00:59:10.268 INFO:teuthology.orchestra.run.smithi016.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-05-11T00:59:10.318 INFO:teuthology.orchestra.run.smithi016.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 975 kB/s | 49 kB 00:00 2024-05-11T00:59:10.321 INFO:teuthology.orchestra.run.smithi174.stdout:(66/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:01 2024-05-11T00:59:10.385 INFO:teuthology.orchestra.run.smithi016.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-05-11T00:59:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2024-05-11T00:59:10.444 INFO:teuthology.orchestra.run.smithi016.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-05-11T00:59:10.578 INFO:teuthology.orchestra.run.smithi016.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-05-11T00:59:10.611 INFO:teuthology.orchestra.run.smithi016.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-05-11T00:59:10.637 INFO:teuthology.orchestra.run.smithi016.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-05-11T00:59:10.670 INFO:teuthology.orchestra.run.smithi016.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-05-11T00:59:10.679 INFO:teuthology.orchestra.run.smithi174.stdout:(67/156): ceph-osd-19.0.0-3570.g10380055.el9.x8 1.3 MB/s | 17 MB 00:13 2024-05-11T00:59:10.695 INFO:teuthology.orchestra.run.smithi016.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-05-11T00:59:10.738 INFO:teuthology.orchestra.run.smithi174.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.2 MB/s | 4.7 MB 00:01 2024-05-11T00:59:10.746 INFO:teuthology.orchestra.run.smithi016.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-11T00:59:10.771 INFO:teuthology.orchestra.run.smithi174.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-05-11T00:59:10.788 INFO:teuthology.orchestra.run.smithi016.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-05-11T00:59:10.822 INFO:teuthology.orchestra.run.smithi174.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-05-11T00:59:10.838 INFO:teuthology.orchestra.run.smithi016.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-05-11T00:59:10.872 INFO:teuthology.orchestra.run.smithi016.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-05-11T00:59:10.914 INFO:teuthology.orchestra.run.smithi016.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 2.7 MB/s | 206 kB 00:00 2024-05-11T00:59:11.006 INFO:teuthology.orchestra.run.smithi016.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-05-11T00:59:11.048 INFO:teuthology.orchestra.run.smithi016.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-05-11T00:59:11.098 INFO:teuthology.orchestra.run.smithi016.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-05-11T00:59:11.142 INFO:teuthology.orchestra.run.smithi016.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 193 kB/s | 18 kB 00:00 2024-05-11T00:59:11.173 INFO:teuthology.orchestra.run.smithi016.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-05-11T00:59:11.239 INFO:teuthology.orchestra.run.smithi174.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-05-11T00:59:11.298 INFO:teuthology.orchestra.run.smithi174.stdout:(72/156): postgresql-contrib-13.14-1.el9.x86_64 1.4 MB/s | 911 kB 00:00 2024-05-11T00:59:11.322 INFO:teuthology.orchestra.run.smithi174.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-05-11T00:59:11.366 INFO:teuthology.orchestra.run.smithi016.stdout:(127/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-05-11T00:59:11.391 INFO:teuthology.orchestra.run.smithi016.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 77 kB/s | 19 kB 00:00 2024-05-11T00:59:11.416 INFO:teuthology.orchestra.run.smithi016.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 81 kB/s | 20 kB 00:00 2024-05-11T00:59:11.431 INFO:teuthology.orchestra.run.smithi174.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-05-11T00:59:11.475 INFO:teuthology.orchestra.run.smithi016.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 798 kB/s | 46 kB 00:00 2024-05-11T00:59:11.500 INFO:teuthology.orchestra.run.smithi016.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 947 kB/s | 79 kB 00:00 2024-05-11T00:59:11.523 INFO:teuthology.orchestra.run.smithi174.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-05-11T00:59:11.533 INFO:teuthology.orchestra.run.smithi016.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 988 kB/s | 58 kB 00:00 2024-05-11T00:59:11.567 INFO:teuthology.orchestra.run.smithi016.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-11T00:59:11.581 INFO:teuthology.orchestra.run.smithi174.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-05-11T00:59:11.593 INFO:teuthology.orchestra.run.smithi016.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-05-11T00:59:11.626 INFO:teuthology.orchestra.run.smithi016.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-11T00:59:11.640 INFO:teuthology.orchestra.run.smithi174.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 329 kB/s | 19 kB 00:00 2024-05-11T00:59:11.668 INFO:teuthology.orchestra.run.smithi016.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-05-11T00:59:11.693 INFO:teuthology.orchestra.run.smithi016.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 461 kB/s | 31 kB 00:00 2024-05-11T00:59:11.735 INFO:teuthology.orchestra.run.smithi016.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-05-11T00:59:11.740 INFO:teuthology.orchestra.run.smithi174.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-05-11T00:59:11.761 INFO:teuthology.orchestra.run.smithi016.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 882 kB/s | 59 kB 00:00 2024-05-11T00:59:11.786 INFO:teuthology.orchestra.run.smithi016.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-05-11T00:59:11.799 INFO:teuthology.orchestra.run.smithi174.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-05-11T00:59:11.803 INFO:teuthology.orchestra.run.smithi016.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 533 kB/s | 36 kB 00:00 2024-05-11T00:59:11.820 INFO:teuthology.orchestra.run.smithi016.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 867 kB/s | 51 kB 00:00 2024-05-11T00:59:11.853 INFO:teuthology.orchestra.run.smithi016.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-05-11T00:59:11.879 INFO:teuthology.orchestra.run.smithi016.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-11T00:59:11.912 INFO:teuthology.orchestra.run.smithi016.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-05-11T00:59:11.929 INFO:teuthology.orchestra.run.smithi016.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-05-11T00:59:11.963 INFO:teuthology.orchestra.run.smithi016.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-05-11T00:59:12.047 INFO:teuthology.orchestra.run.smithi016.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-11T00:59:12.183 INFO:teuthology.orchestra.run.smithi174.stdout:(80/156): postgresql-server-13.14-1.el9.x86_64. 4.1 MB/s | 5.8 MB 00:01 2024-05-11T00:59:12.188 INFO:teuthology.orchestra.run.smithi016.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 16 MB/s | 2.3 MB 00:00 2024-05-11T00:59:12.266 INFO:teuthology.orchestra.run.smithi174.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-05-11T00:59:12.280 INFO:teuthology.orchestra.run.smithi016.stdout:(150/156): librbd1-19.0.0-3570.g10380055.el9.x8 9.9 MB/s | 3.1 MB 00:00 2024-05-11T00:59:12.339 INFO:teuthology.orchestra.run.smithi016.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 717 kB/s | 42 kB 00:00 2024-05-11T00:59:12.350 INFO:teuthology.orchestra.run.smithi174.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-05-11T00:59:12.375 INFO:teuthology.orchestra.run.smithi174.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-05-11T00:59:12.381 INFO:teuthology.orchestra.run.smithi016.stdout:(152/156): NetworkManager-libnm-1.47.5-1.el9.x8 9.5 MB/s | 1.8 MB 00:00 2024-05-11T00:59:12.417 INFO:teuthology.orchestra.run.smithi174.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-05-11T00:59:12.442 INFO:teuthology.orchestra.run.smithi174.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-05-11T00:59:12.448 INFO:teuthology.orchestra.run.smithi016.stdout:(153/156): NetworkManager-tui-1.47.5-1.el9.x86_ 2.2 MB/s | 248 kB 00:00 2024-05-11T00:59:12.501 INFO:teuthology.orchestra.run.smithi174.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-05-11T00:59:12.523 INFO:teuthology.orchestra.run.smithi016.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 9.5 MB/s | 1.3 MB 00:00 2024-05-11T00:59:12.526 INFO:teuthology.orchestra.run.smithi174.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-05-11T00:59:12.585 INFO:teuthology.orchestra.run.smithi174.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-05-11T00:59:12.602 INFO:teuthology.orchestra.run.smithi174.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-05-11T00:59:12.631 INFO:teuthology.orchestra.run.smithi016.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-05-11T00:59:12.644 INFO:teuthology.orchestra.run.smithi174.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-05-11T00:59:12.702 INFO:teuthology.orchestra.run.smithi174.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-05-11T00:59:12.778 INFO:teuthology.orchestra.run.smithi174.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 589 kB/s | 44 kB 00:00 2024-05-11T00:59:12.870 INFO:teuthology.orchestra.run.smithi174.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.4 MB/s | 221 kB 00:00 2024-05-11T00:59:12.945 INFO:teuthology.orchestra.run.smithi174.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-05-11T00:59:13.004 INFO:teuthology.orchestra.run.smithi174.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-05-11T00:59:13.071 INFO:teuthology.orchestra.run.smithi174.stdout:(96/156): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-11T00:59:13.129 INFO:teuthology.orchestra.run.smithi174.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 994 kB/s | 58 kB 00:00 2024-05-11T00:59:13.188 INFO:teuthology.orchestra.run.smithi174.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-11T00:59:13.246 INFO:teuthology.orchestra.run.smithi174.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-11T00:59:13.305 INFO:teuthology.orchestra.run.smithi174.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-05-11T00:59:13.372 INFO:teuthology.orchestra.run.smithi174.stdout:(101/156): python3-numpy-1.20.1-5.el9.x86_64.rp 3.2 MB/s | 5.1 MB 00:01 2024-05-11T00:59:13.431 INFO:teuthology.orchestra.run.smithi174.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-05-11T00:59:13.564 INFO:teuthology.orchestra.run.smithi174.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-05-11T00:59:14.032 INFO:teuthology.orchestra.run.smithi016.stdout:(156/156): librados2-19.0.0-3570.g10380055.el9. 1.6 MB/s | 3.4 MB 00:02 2024-05-11T00:59:14.035 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-05-11T00:59:14.036 INFO:teuthology.orchestra.run.smithi016.stdout:Total 9.9 MB/s | 226 MB 00:22 2024-05-11T00:59:14.106 INFO:teuthology.orchestra.run.smithi174.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 812 kB/s | 548 kB 00:00 2024-05-11T00:59:14.173 INFO:teuthology.orchestra.run.smithi174.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 507 kB/s | 309 kB 00:00 2024-05-11T00:59:14.206 INFO:teuthology.orchestra.run.smithi174.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-05-11T00:59:14.315 INFO:teuthology.orchestra.run.smithi174.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-05-11T00:59:14.424 INFO:teuthology.orchestra.run.smithi174.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 449 kB/s | 49 kB 00:00 2024-05-11T00:59:14.524 INFO:teuthology.orchestra.run.smithi174.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 673 kB/s | 67 kB 00:00 2024-05-11T00:59:14.649 INFO:teuthology.orchestra.run.smithi174.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-05-11T00:59:14.708 INFO:teuthology.orchestra.run.smithi174.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-05-11T00:59:14.825 INFO:teuthology.orchestra.run.smithi174.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-05-11T00:59:14.850 INFO:teuthology.orchestra.run.smithi174.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-05-11T00:59:14.926 INFO:teuthology.orchestra.run.smithi174.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-05-11T00:59:14.960 INFO:teuthology.orchestra.run.smithi174.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 295 kB/s | 32 kB 00:00 2024-05-11T00:59:15.027 INFO:teuthology.orchestra.run.smithi174.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-05-11T00:59:15.060 INFO:teuthology.orchestra.run.smithi174.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-05-11T00:59:15.135 INFO:teuthology.orchestra.run.smithi174.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-05-11T00:59:15.169 INFO:teuthology.orchestra.run.smithi174.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-05-11T00:59:15.228 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-05-11T00:59:15.361 INFO:teuthology.orchestra.run.smithi174.stdout:(120/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.9 MB/s | 16 MB 00:02 2024-05-11T00:59:15.378 INFO:teuthology.orchestra.run.smithi174.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 146 kB/s | 35 kB 00:00 2024-05-11T00:59:15.394 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-05-11T00:59:15.394 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-05-11T00:59:15.403 INFO:teuthology.orchestra.run.smithi174.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 879 kB/s | 206 kB 00:00 2024-05-11T00:59:15.487 INFO:teuthology.orchestra.run.smithi174.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-05-11T00:59:15.503 INFO:teuthology.orchestra.run.smithi174.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-05-11T00:59:15.579 INFO:teuthology.orchestra.run.smithi174.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-05-11T00:59:15.604 INFO:teuthology.orchestra.run.smithi174.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-05-11T00:59:15.679 INFO:teuthology.orchestra.run.smithi174.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-05-11T00:59:15.705 INFO:teuthology.orchestra.run.smithi174.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-05-11T00:59:15.805 INFO:teuthology.orchestra.run.smithi174.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 463 kB/s | 46 kB 00:00 2024-05-11T00:59:15.838 INFO:teuthology.orchestra.run.smithi174.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-05-11T00:59:15.905 INFO:teuthology.orchestra.run.smithi174.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2024-05-11T00:59:15.939 INFO:teuthology.orchestra.run.smithi174.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 576 kB/s | 58 kB 00:00 2024-05-11T00:59:16.006 INFO:teuthology.orchestra.run.smithi174.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-05-11T00:59:16.039 INFO:teuthology.orchestra.run.smithi174.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-05-11T00:59:16.098 INFO:teuthology.orchestra.run.smithi174.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 979 kB/s | 90 kB 00:00 2024-05-11T00:59:16.140 INFO:teuthology.orchestra.run.smithi174.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-05-11T00:59:16.215 INFO:teuthology.orchestra.run.smithi174.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.4 MB/s | 2.0 MB 00:00 2024-05-11T00:59:16.241 INFO:teuthology.orchestra.run.smithi174.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 216 kB/s | 31 kB 00:00 2024-05-11T00:59:16.274 INFO:teuthology.orchestra.run.smithi174.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-11T00:59:16.316 INFO:teuthology.orchestra.run.smithi174.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-05-11T00:59:16.341 INFO:teuthology.orchestra.run.smithi174.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-05-11T00:59:16.375 INFO:teuthology.orchestra.run.smithi174.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-05-11T00:59:16.419 INFO:teuthology.orchestra.run.smithi174.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-11T00:59:16.484 INFO:teuthology.orchestra.run.smithi174.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 631 kB/s | 90 kB 00:00 2024-05-11T00:59:16.518 INFO:teuthology.orchestra.run.smithi174.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-05-11T00:59:16.543 INFO:teuthology.orchestra.run.smithi174.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 158 kB/s | 20 kB 00:00 2024-05-11T00:59:16.585 INFO:teuthology.orchestra.run.smithi174.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-05-11T00:59:16.694 INFO:teuthology.orchestra.run.smithi174.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-05-11T00:59:16.927 INFO:teuthology.orchestra.run.smithi174.stdout:(149/156): librbd1-19.0.0-3570.g10380055.el9.x8 9.2 MB/s | 3.1 MB 00:00 2024-05-11T00:59:17.090 INFO:teuthology.orchestra.run.smithi174.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2024-05-11T00:59:17.145 INFO:teuthology.orchestra.run.smithi174.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 719 kB/s | 42 kB 00:00 2024-05-11T00:59:17.204 INFO:teuthology.orchestra.run.smithi174.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-05-11T00:59:17.270 INFO:teuthology.orchestra.run.smithi174.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 5.3 MB/s | 1.8 MB 00:00 2024-05-11T00:59:17.395 INFO:teuthology.orchestra.run.smithi174.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 7.0 MB/s | 1.3 MB 00:00 2024-05-11T00:59:17.612 INFO:teuthology.orchestra.run.smithi174.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 7.0 MB/s | 2.4 MB 00:00 2024-05-11T00:59:17.700 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-05-11T00:59:17.700 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-05-11T00:59:17.912 INFO:teuthology.orchestra.run.smithi174.stdout:(156/156): librados2-19.0.0-3570.g10380055.el9. 2.5 MB/s | 3.4 MB 00:01 2024-05-11T00:59:17.918 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-05-11T00:59:17.919 INFO:teuthology.orchestra.run.smithi174.stdout:Total 8.1 MB/s | 226 MB 00:27 2024-05-11T00:59:19.127 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-05-11T00:59:19.280 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-05-11T00:59:19.281 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-05-11T00:59:21.436 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-05-11T00:59:21.436 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-05-11T00:59:24.106 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-05-11T00:59:24.204 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-11T00:59:24.242 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-11T00:59:24.302 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-11T00:59:24.337 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-11T00:59:24.363 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-11T00:59:24.413 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-11T00:59:24.811 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-11T00:59:24.872 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:19.0.0-3570.g10380055.el9.x86_64 8/164 2024-05-11T00:59:24.997 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:19.0.0-3570.g10380055.el9.x86_64 8/164 2024-05-11T00:59:25.032 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:19.0.0-3570.g10380055.el9.x86_64 9/164 2024-05-11T00:59:25.124 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:19.0.0-3570.g10380055.el9.x86_64 9/164 2024-05-11T00:59:25.153 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:19.0.0-3570.g10380055.el9.x86_64 10/164 2024-05-11T00:59:25.338 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-11T00:59:25.387 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-11T00:59:25.411 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:19.0.0-3570.g10380055.el9.x86_64 13/164 2024-05-11T00:59:25.516 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3570.g10380055.el9.x86_64 13/164 2024-05-11T00:59:25.545 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:19.0.0-3570.g10380055.el9.x86 14/164 2024-05-11T00:59:25.608 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3570.g10380055.el9.x86 14/164 2024-05-11T00:59:25.637 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-11T00:59:25.662 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-11T00:59:25.841 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-11T00:59:26.017 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-11T00:59:26.160 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-11T00:59:26.204 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-11T00:59:26.324 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-11T00:59:26.388 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-11T00:59:26.595 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-11T00:59:26.707 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-11T00:59:26.734 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-11T00:59:26.770 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-11T00:59:26.837 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-11T00:59:26.877 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-11T00:59:26.921 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-11T00:59:26.954 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-11T00:59:26.980 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-11T00:59:27.053 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-11T00:59:27.104 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-11T00:59:27.142 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-11T00:59:27.186 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-11T00:59:27.264 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-11T00:59:27.297 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:19.0.0-3570.g10380055.el9. 32/164 2024-05-11T00:59:27.340 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:19.0.0-3570.g10380055.el 33/164 2024-05-11T00:59:27.368 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:19.0.0-3570.g10380055.el9.x86_6 34/164 2024-05-11T00:59:27.441 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-11T00:59:27.484 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-11T00:59:27.541 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-05-11T00:59:27.562 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-11T00:59:27.618 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-11T00:59:27.667 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-11T00:59:27.706 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-11T00:59:27.726 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-11T00:59:27.762 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-11T00:59:27.766 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-11T00:59:27.792 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-11T00:59:27.843 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-11T00:59:28.175 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-11T00:59:28.277 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.0.0-3570.g10380055.el9.x86_64 8/164 2024-05-11T00:59:28.319 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-11T00:59:28.404 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.0.0-3570.g10380055.el9.x86_64 8/164 2024-05-11T00:59:28.418 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-11T00:59:28.428 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.0.0-3570.g10380055.el9.x86_64 9/164 2024-05-11T00:59:28.452 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-11T00:59:28.504 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-11T00:59:28.520 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.0.0-3570.g10380055.el9.x86_64 9/164 2024-05-11T00:59:28.542 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:19.0.0-3570.g10380055.el9.x86_6 44/164 2024-05-11T00:59:28.549 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.0.0-3570.g10380055.el9.x86_64 10/164 2024-05-11T00:59:28.585 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-11T00:59:28.721 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-11T00:59:28.743 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-11T00:59:28.786 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-11T00:59:28.787 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-11T00:59:28.815 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.0.0-3570.g10380055.el9.x86_64 13/164 2024-05-11T00:59:28.882 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-11T00:59:28.919 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3570.g10380055.el9.x86_64 13/164 2024-05-11T00:59:28.944 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-11T00:59:28.950 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.0.0-3570.g10380055.el9.x86 14/164 2024-05-11T00:59:29.017 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-11T00:59:29.021 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3570.g10380055.el9.x86 14/164 2024-05-11T00:59:29.051 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-11T00:59:29.054 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-11T00:59:29.070 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-11T00:59:29.091 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-11T00:59:29.139 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-11T00:59:29.174 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-11T00:59:29.218 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-11T00:59:29.252 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-11T00:59:29.259 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-11T00:59:29.403 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-11T00:59:29.416 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-11T00:59:29.458 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-11T00:59:29.495 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-11T00:59:29.537 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-11T00:59:29.556 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-11T00:59:29.600 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-11T00:59:29.635 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-11T00:59:29.678 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-11T00:59:29.719 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-11T00:59:29.722 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-11T00:59:29.752 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-11T00:59:29.776 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-11T00:59:29.784 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-11T00:59:29.871 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-11T00:59:29.985 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-11T00:59:30.000 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-11T00:59:30.042 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-11T00:59:30.073 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-11T00:59:30.090 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-11T00:59:30.105 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-11T00:59:30.118 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-11T00:59:30.145 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-11T00:59:30.156 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-11T00:59:30.184 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-11T00:59:30.220 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-11T00:59:30.222 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-11T00:59:30.256 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-11T00:59:30.264 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-11T00:59:30.290 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-11T00:59:30.307 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-11T00:59:30.332 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-11T00:59:30.340 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-11T00:59:30.366 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-11T00:59:30.368 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-11T00:59:30.435 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-11T00:59:30.456 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-11T00:59:30.489 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-11T00:59:30.521 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-11T00:59:30.565 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-11T00:59:30.639 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-11T00:59:30.642 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-11T00:59:30.675 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.0.0-3570.g10380055.el9. 32/164 2024-05-11T00:59:30.719 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.0.0-3570.g10380055.el 33/164 2024-05-11T00:59:30.747 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.0.0-3570.g10380055.el9.x86_6 34/164 2024-05-11T00:59:30.815 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-11T00:59:30.827 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-11T00:59:30.862 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-11T00:59:30.926 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-11T00:59:30.935 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-11T00:59:31.036 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-11T00:59:31.066 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-11T00:59:31.088 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-11T00:59:31.114 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-11T00:59:31.638 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-11T00:59:31.718 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-11T00:59:31.747 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-11T00:59:31.781 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-11T00:59:31.819 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.0.0-3570.g10380055.el9.x86_6 44/164 2024-05-11T00:59:31.851 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-11T00:59:31.861 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-11T00:59:31.901 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-11T00:59:31.935 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-11T00:59:32.021 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-11T00:59:32.037 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-11T00:59:32.072 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-11T00:59:32.085 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-11T00:59:32.162 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-11T00:59:32.176 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-11T00:59:32.212 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-11T00:59:32.227 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-11T00:59:32.300 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-11T00:59:32.332 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-11T00:59:32.368 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-11T00:59:32.388 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-11T00:59:32.415 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-11T00:59:32.417 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-11T00:59:32.451 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-11T00:59:32.494 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-11T00:59:32.509 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-11T00:59:32.536 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-11T00:59:32.672 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-11T00:59:32.733 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-11T00:59:32.772 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-11T00:59:32.813 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-11T00:59:32.906 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-11T00:59:32.939 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-11T00:59:32.980 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-11T00:59:33.012 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-11T00:59:33.037 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-11T00:59:33.123 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-11T00:59:33.234 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-11T00:59:33.255 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-11T00:59:33.294 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-11T00:59:33.330 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-11T00:59:33.361 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-11T00:59:33.364 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-11T00:59:33.412 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-11T00:59:33.444 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-11T00:59:33.474 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-11T00:59:33.508 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-11T00:59:33.541 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-11T00:59:33.575 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-11T00:59:33.609 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-11T00:59:33.694 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-11T00:59:33.739 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-11T00:59:33.770 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-11T00:59:33.817 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-11T00:59:33.914 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-11T00:59:33.963 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-11T00:59:34.685 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-11T00:59:34.690 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-11T00:59:34.727 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-11T00:59:34.761 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-11T00:59:34.780 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-11T00:59:34.808 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-11T00:59:34.841 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-11T00:59:34.858 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-11T00:59:34.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-11T00:59:34.996 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-11T00:59:35.038 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-11T00:59:35.170 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-11T00:59:35.212 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:19.0.0-3570.g10380055.el9.x86_64 101/164 2024-05-11T00:59:35.224 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-11T00:59:35.252 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-11T00:59:35.286 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:19.0.0-3570.g10380055.el9.x86_64 101/164 2024-05-11T00:59:35.316 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:19.0.0-3570.g10380055.el9.x86_64 102/164 2024-05-11T00:59:35.331 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-11T00:59:35.353 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-11T00:59:35.861 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-11T00:59:35.890 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:19.0.0-3570.g10380055.el9.x86_64 105/164 2024-05-11T00:59:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:19.0.0-3570.g10380055.el9.x86_64 105/164 2024-05-11T00:59:35.984 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-11T00:59:35.991 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:19.0.0-3570.g10380055.el9.x86_64 106/164 2024-05-11T00:59:36.099 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-11T00:59:37.360 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-11T00:59:37.441 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-11T00:59:37.466 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-11T00:59:37.499 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-11T00:59:37.818 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-11T00:59:37.862 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.0.0-3570.g10380055.el9.x86_64 101/164 2024-05-11T00:59:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.0.0-3570.g10380055.el9.x86_64 101/164 2024-05-11T00:59:37.975 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.0.0-3570.g10380055.el9.x86_64 102/164 2024-05-11T00:59:38.021 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-11T00:59:38.384 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 107/164 2024-05-11T00:59:38.421 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 107/164 2024-05-11T00:59:38.501 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-11T00:59:38.540 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.0.0-3570.g10380055.el9.x86_64 105/164 2024-05-11T00:59:38.611 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.0.0-3570.g10380055.el9.x86_64 105/164 2024-05-11T00:59:38.633 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.0.0-3570.g10380055.el9.x86_64 106/164 2024-05-11T00:59:38.994 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 107/164 2024-05-11T00:59:39.033 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:19.0.0-3570.g10380055.el9.x86_64 108/164 2024-05-11T00:59:39.129 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:19.0.0-3570.g10380055.el9.x86_64 108/164 2024-05-11T00:59:39.129 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-11T00:59:39.129 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-11T00:59:39.130 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:39.168 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:19.0.0-3570.g10380055.el9.x86_64 109/164 2024-05-11T00:59:40.886 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 107/164 2024-05-11T00:59:40.921 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 107/164 2024-05-11T00:59:41.470 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 107/164 2024-05-11T00:59:41.508 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.0.0-3570.g10380055.el9.x86_64 108/164 2024-05-11T00:59:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.0.0-3570.g10380055.el9.x86_64 108/164 2024-05-11T00:59:41.599 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-11T00:59:41.599 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-11T00:59:41.599 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:59:41.634 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.0.0-3570.g10380055.el9.x86_64 109/164 2024-05-11T00:59:51.101 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3570.g10380055.el9.x86_64 109/164 2024-05-11T00:59:51.101 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2024-05-11T00:59:51.101 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2024-05-11T00:59:51.102 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2024-05-11T00:59:51.102 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2024-05-11T00:59:51.102 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2024-05-11T00:59:51.102 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /root 2024-05-11T00:59:51.102 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2024-05-11T00:59:51.102 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:51.275 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-volume-2:19.0.0-3570.g10380055.el9.noarch 110/164 2024-05-11T00:59:51.292 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-volume-2:19.0.0-3570.g10380055.el9.noarch 110/164 2024-05-11T00:59:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:51.292 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-11T00:59:51.292 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:52.836 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:19.0.0-3570.g10380055.el9.x86_64 111/164 2024-05-11T00:59:52.865 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:19.0.0-3570.g10380055.el9.x86_64 111/164 2024-05-11T00:59:52.865 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:52.865 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-11T00:59:52.865 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-11T00:59:52.865 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-11T00:59:52.865 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:53.000 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3570.g10380055.el9.x86_64 109/164 2024-05-11T00:59:53.000 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-05-11T00:59:53.000 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-05-11T00:59:53.000 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-05-11T00:59:53.001 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-05-11T00:59:53.001 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-05-11T00:59:53.001 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-05-11T00:59:53.001 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-05-11T00:59:53.001 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:59:53.104 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:19.0.0-3570.g10380055.el9.x86_64 112/164 2024-05-11T00:59:53.128 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:19.0.0-3570.g10380055.el9.x86_64 112/164 2024-05-11T00:59:53.128 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:53.129 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-11T00:59:53.129 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-11T00:59:53.129 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-11T00:59:53.129 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:53.173 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.0.0-3570.g10380055.el9.noarch 110/164 2024-05-11T00:59:53.190 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.0.0-3570.g10380055.el9.noarch 110/164 2024-05-11T00:59:53.190 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:53.190 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-11T00:59:53.190 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:59:53.596 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:19.0.0-3570.g10380055.el9.x86_64 113/164 2024-05-11T00:59:53.621 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:19.0.0-3570.g10380055.el9.x86_64 113/164 2024-05-11T00:59:53.621 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:53.621 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-11T00:59:53.621 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-11T00:59:53.622 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-11T00:59:53.622 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:53.735 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-11T00:59:53.794 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-11T00:59:53.857 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-11T00:59:54.060 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-11T00:59:54.106 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-11T00:59:54.186 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-11T00:59:54.284 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-11T00:59:54.443 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-11T00:59:54.494 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-11T00:59:54.530 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-11T00:59:54.557 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-11T00:59:54.684 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.0.0-3570.g10380055.el9.x86_64 111/164 2024-05-11T00:59:54.711 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.0.0-3570.g10380055.el9.x86_64 111/164 2024-05-11T00:59:54.711 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-11T00:59:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-11T00:59:54.712 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-11T00:59:54.712 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:59:54.935 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.0.0-3570.g10380055.el9.x86_64 112/164 2024-05-11T00:59:54.958 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.0.0-3570.g10380055.el9.x86_64 112/164 2024-05-11T00:59:54.958 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:54.958 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-11T00:59:54.958 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-11T00:59:54.958 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-11T00:59:54.959 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:59:55.005 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:19.0.0-3570.g10380055.el9.noarch 125/164 2024-05-11T00:59:55.030 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:19.0.0-3570.g10380055.el9.noarch 125/164 2024-05-11T00:59:55.063 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3570.g10380055.e 126/164 2024-05-11T00:59:55.127 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3570.g10380055. 127/164 2024-05-11T00:59:55.153 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3570.g10380055.el9.noa 128/164 2024-05-11T00:59:55.411 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.0.0-3570.g10380055.el9.x86_64 113/164 2024-05-11T00:59:55.434 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.0.0-3570.g10380055.el9.x86_64 113/164 2024-05-11T00:59:55.434 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:55.434 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-11T00:59:55.434 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-11T00:59:55.434 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-11T00:59:55.435 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:59:55.541 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-11T00:59:55.597 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-11T00:59:55.654 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-11T00:59:55.840 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-11T00:59:55.886 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-11T00:59:55.963 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-11T00:59:56.060 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-11T00:59:56.201 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-11T00:59:56.253 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3570.g10380055.el9.noa 128/164 2024-05-11T00:59:56.261 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-11T00:59:56.288 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3570.g10380055.el9.n 129/164 2024-05-11T00:59:56.294 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-11T00:59:56.320 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-11T00:59:56.767 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.0.0-3570.g10380055.el9.noarch 125/164 2024-05-11T00:59:56.793 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.0.0-3570.g10380055.el9.noarch 125/164 2024-05-11T00:59:56.826 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3570.g10380055.e 126/164 2024-05-11T00:59:56.887 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3570.g10380055. 127/164 2024-05-11T00:59:56.925 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3570.g10380055.el9.noa 128/164 2024-05-11T00:59:57.307 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3570.g10380055.el9.n 129/164 2024-05-11T00:59:57.339 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3570.g103 130/164 2024-05-11T00:59:57.455 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3570.g103 130/164 2024-05-11T00:59:57.616 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3570.g10380055.el 131/164 2024-05-11T00:59:57.650 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:19.0.0-3570.g10380055.el9.x86_64 132/164 2024-05-11T00:59:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3570.g10380055.el9.x86_64 132/164 2024-05-11T00:59:57.674 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:57.674 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-11T00:59:57.675 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-11T00:59:57.675 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-11T00:59:57.675 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:57.725 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:19.0.0-3570.g10380055.el9.noarch 133/164 2024-05-11T00:59:57.736 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3570.g10380055.el9.noarch 133/164 2024-05-11T00:59:57.838 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:19.0.0-3570.g10380055.el9.x86_64 134/164 2024-05-11T00:59:57.901 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:19.0.0-3570.g10380055.el9.x86_64 135/164 2024-05-11T00:59:57.964 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3570.g10380055.el9.noa 128/164 2024-05-11T00:59:57.993 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3570.g10380055.el9.n 129/164 2024-05-11T00:59:58.874 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-11T00:59:58.903 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:19.0.0-3570.g10380055.el9.x86_64 137/164 2024-05-11T00:59:58.928 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3570.g10380055.el9.x86_64 137/164 2024-05-11T00:59:58.928 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:58.928 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-11T00:59:58.928 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-11T00:59:58.928 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-11T00:59:58.928 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:58.959 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3570.g10380055.el9.n 129/164 2024-05-11T00:59:58.970 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3570.g10380 138/164 2024-05-11T00:59:58.985 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3570.g103 130/164 2024-05-11T00:59:58.994 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3570.g10380 138/164 2024-05-11T00:59:58.994 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:58.994 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-11T00:59:58.994 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:59.046 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-mirror-2:19.0.0-3570.g10380055.el9.x86_64 139/164 2024-05-11T00:59:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3570.g10380055.el9.x86_64 139/164 2024-05-11T00:59:59.070 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:59.070 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-11T00:59:59.070 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-11T00:59:59.070 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-11T00:59:59.070 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:59.095 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3570.g103 130/164 2024-05-11T00:59:59.255 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3570.g10380055.el 131/164 2024-05-11T00:59:59.279 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.0.0-3570.g10380055.el9.x86_64 132/164 2024-05-11T00:59:59.303 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3570.g10380055.el9.x86_64 132/164 2024-05-11T00:59:59.303 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:59.303 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-11T00:59:59.303 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-11T00:59:59.303 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-11T00:59:59.303 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T00:59:59.347 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.0.0-3570.g10380055.el9.noarch 133/164 2024-05-11T00:59:59.358 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3570.g10380055.el9.noarch 133/164 2024-05-11T00:59:59.388 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:19.0.0-3570.g10380055.el9.x86_64 140/164 2024-05-11T00:59:59.413 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3570.g10380055.el9.x86_64 140/164 2024-05-11T00:59:59.413 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T00:59:59.413 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-11T00:59:59.413 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-11T00:59:59.413 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-11T00:59:59.413 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T00:59:59.447 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.0.0-3570.g10380055.el9.x86_64 134/164 2024-05-11T00:59:59.503 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.0.0-3570.g10380055.el9.x86_64 135/164 2024-05-11T01:00:00.428 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-11T01:00:00.457 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.0.0-3570.g10380055.el9.x86_64 137/164 2024-05-11T01:00:00.492 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3570.g10380055.el9.x86_64 137/164 2024-05-11T01:00:00.492 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T01:00:00.493 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-11T01:00:00.493 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-11T01:00:00.493 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-11T01:00:00.493 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:00.533 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3570.g10380 138/164 2024-05-11T01:00:00.556 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3570.g10380 138/164 2024-05-11T01:00:00.557 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T01:00:00.557 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-11T01:00:00.557 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:00.608 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.0.0-3570.g10380055.el9.x86_64 139/164 2024-05-11T01:00:00.631 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3570.g10380055.el9.x86_64 139/164 2024-05-11T01:00:00.632 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T01:00:00.632 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-11T01:00:00.632 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-11T01:00:00.632 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-11T01:00:00.632 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:00.942 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.0.0-3570.g10380055.el9.x86_64 140/164 2024-05-11T01:00:00.965 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3570.g10380055.el9.x86_64 140/164 2024-05-11T01:00:00.966 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-11T01:00:00.966 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-11T01:00:00.966 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-11T01:00:00.966 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-11T01:00:00.966 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:04.309 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:19.0.0-3570.g10380055.el9.x86_64 141/164 2024-05-11T01:00:04.350 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:19.0.0-3570.g10380055.el9.x86_64 142/164 2024-05-11T01:00:04.392 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:19.0.0-3570.g10380055.el9.x86_64 143/164 2024-05-11T01:00:04.422 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-11T01:00:04.450 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-11T01:00:04.652 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-shell-2:19.0.0-3570.g10380055.el9.x86_64 146/164 2024-05-11T01:00:04.696 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-11T01:00:04.726 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:19.0.0-3570.g10380055.el9.x86_ 148/164 2024-05-11T01:00:04.756 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-11T01:00:04.794 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-11T01:00:05.429 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-11T01:00:05.475 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-11T01:00:05.496 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-11T01:00:05.613 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.0.0-3570.g10380055.el9.x86_64 141/164 2024-05-11T01:00:05.662 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.0.0-3570.g10380055.el9.x86_64 142/164 2024-05-11T01:00:05.702 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.0.0-3570.g10380055.el9.x86_64 143/164 2024-05-11T01:00:05.735 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-11T01:00:05.762 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-11T01:00:05.952 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.0.0-3570.g10380055.el9.x86_64 146/164 2024-05-11T01:00:05.991 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-11T01:00:06.021 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.0.0-3570.g10380055.el9.x86_ 148/164 2024-05-11T01:00:06.051 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-11T01:00:06.106 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-11T01:00:06.421 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephfs-top-2:19.0.0-3570.g10380055.el9.noarch 152/164 2024-05-11T01:00:06.513 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-11T01:00:06.564 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-11T01:00:06.659 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-11T01:00:06.674 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-11T01:00:06.691 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-11T01:00:06.714 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-11T01:00:06.726 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-11T01:00:06.726 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-11T01:00:06.732 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-11T01:00:06.835 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-11T01:00:06.867 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-11T01:00:06.868 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-11T01:00:06.944 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-11T01:00:06.969 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-11T01:00:06.974 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-11T01:00:06.975 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-11T01:00:07.163 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-11T01:00:07.163 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-11T01:00:07.259 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-11T01:00:07.356 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-11T01:00:07.560 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.0.0-3570.g10380055.el9.noarch 152/164 2024-05-11T01:00:07.649 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-11T01:00:07.698 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-11T01:00:07.789 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-11T01:00:07.818 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-11T01:00:07.844 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-11T01:00:07.845 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-11T01:00:07.929 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-11T01:00:07.962 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-11T01:00:07.962 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-11T01:00:08.046 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-11T01:00:08.071 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-11T01:00:08.077 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-11T01:00:08.077 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-11T01:00:08.264 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-11T01:00:08.264 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-11T01:00:08.349 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-11T01:00:08.422 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-11T01:00:12.961 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:19.0.0-3570.g10380055.el9.x86_64 1/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:19.0.0-3570.g10380055.el9.x86_64 2/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 3/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:19.0.0-3570.g10380055.el9.x86_64 4/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3570.g10380 5/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:19.0.0-3570.g10380055.el9.x86_64 6/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:19.0.0-3570.g10380055.el9.x86_64 7/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:19.0.0-3570.g10380055.el9.x86_64 8/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:19.0.0-3570.g10380055.el9.x86_64 9/164 2024-05-11T01:00:12.962 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:19.0.0-3570.g10380055.el9.x86_64 10/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:19.0.0-3570.g10380055.el9.x86_64 11/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:19.0.0-3570.g10380055.el9.x86_64 12/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-mirror-2:19.0.0-3570.g10380055.el9.x86_64 13/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-shell-2:19.0.0-3570.g10380055.el9.x86_64 14/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:19.0.0-3570.g10380055.el9.x86_ 15/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:19.0.0-3570.g10380055.el9.x86_64 16/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:19.0.0-3570.g10380055.el9.x86_64 17/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:19.0.0-3570.g10380055.el9.x86_6 18/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:19.0.0-3570.g10380055.el9.x86 19/164 2024-05-11T01:00:12.963 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:19.0.0-3570.g10380055.el9.x86_64 20/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3570.g10380055.el 21/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:19.0.0-3570.g10380055.el9. 22/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:19.0.0-3570.g10380055.el9.x86_6 23/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:19.0.0-3570.g10380055.el9.x86_64 24/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:19.0.0-3570.g10380055.el9.x86_64 25/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:19.0.0-3570.g10380055.el9.x86_64 26/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:19.0.0-3570.g10380055.el9.x86_64 27/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:19.0.0-3570.g10380055.el9.x86_64 28/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:19.0.0-3570.g10380055.el9.x86_64 29/164 2024-05-11T01:00:12.964 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3570.g10380055. 30/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3570.g10380055.el9.noa 31/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3570.g10380055.el9.n 32/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3570.g103 33/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3570.g10380055.el 34/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3570.g10380055.el9.noarch 35/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3570.g10380055.e 36/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-volume-2:19.0.0-3570.g10380055.el9.noarch 37/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:19.0.0-3570.g10380055.el9.noarch 38/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephfs-top-2:19.0.0-3570.g10380055.el9.noarch 39/164 2024-05-11T01:00:12.965 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-11T01:00:12.966 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-11T01:00:12.967 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-11T01:00:12.968 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-11T01:00:12.969 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-11T01:00:12.970 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-11T01:00:12.971 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-11T01:00:12.972 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-11T01:00:12.973 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-11T01:00:12.974 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-11T01:00:12.975 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:19.0.0-3570.g10380055.el9.x86_64 149/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:19.0.0-3570.g10380055.el9.x86_64 151/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-11T01:00:12.976 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-11T01:00:12.977 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.0.0-3570.g10380055.el9.x86_64 1/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.0.0-3570.g10380055.el9.x86_64 2/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 3/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.0.0-3570.g10380055.el9.x86_64 4/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3570.g10380 5/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.0.0-3570.g10380055.el9.x86_64 6/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.0.0-3570.g10380055.el9.x86_64 7/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.0.0-3570.g10380055.el9.x86_64 8/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.0.0-3570.g10380055.el9.x86_64 9/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.0.0-3570.g10380055.el9.x86_64 10/164 2024-05-11T01:00:13.777 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.0.0-3570.g10380055.el9.x86_64 11/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.0.0-3570.g10380055.el9.x86_64 12/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.0.0-3570.g10380055.el9.x86_64 13/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.0.0-3570.g10380055.el9.x86_64 14/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.0.0-3570.g10380055.el9.x86_ 15/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.0.0-3570.g10380055.el9.x86_64 16/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.0.0-3570.g10380055.el9.x86_64 17/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.0.0-3570.g10380055.el9.x86_6 18/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.0.0-3570.g10380055.el9.x86 19/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.0.0-3570.g10380055.el9.x86_64 20/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3570.g10380055.el 21/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.0.0-3570.g10380055.el9. 22/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.0.0-3570.g10380055.el9.x86_6 23/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.0.0-3570.g10380055.el9.x86_64 24/164 2024-05-11T01:00:13.778 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.0.0-3570.g10380055.el9.x86_64 25/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.0.0-3570.g10380055.el9.x86_64 26/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.0.0-3570.g10380055.el9.x86_64 27/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.0.0-3570.g10380055.el9.x86_64 28/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.0.0-3570.g10380055.el9.x86_64 29/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3570.g10380055. 30/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3570.g10380055.el9.noa 31/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3570.g10380055.el9.n 32/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3570.g103 33/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3570.g10380055.el 34/164 2024-05-11T01:00:13.779 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3570.g10380055.el9.noarch 35/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3570.g10380055.e 36/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.0.0-3570.g10380055.el9.noarch 37/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.0.0-3570.g10380055.el9.noarch 38/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.0.0-3570.g10380055.el9.noarch 39/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-11T01:00:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-11T01:00:13.781 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-11T01:00:13.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-11T01:00:13.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-11T01:00:13.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-11T01:00:13.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-11T01:00:13.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-11T01:00:13.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-11T01:00:13.782 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-11T01:00:13.783 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-11T01:00:13.784 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-11T01:00:13.785 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-11T01:00:13.786 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-11T01:00:13.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.0.0-3570.g10380055.el9.x86_64 149/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.0.0-3570.g10380055.el9.x86_64 151/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-11T01:00:13.788 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-11T01:00:13.789 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-11T01:00:15.735 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-11T01:00:15.735 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:15.735 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2024-05-11T01:00:15.735 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-11T01:00:15.735 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: automake-1.16.2-8.el9.noarch 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: bison-3.7.4-5.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.736 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.737 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-shell-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-top-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: flex-2.6.4-9.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-11T01:00:15.738 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-11T01:00:15.739 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: lua-5.4.4-4.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-11T01:00:15.740 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-13.14-1.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-11T01:00:15.741 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-11T01:00:15.742 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-11T01:00:15.742 INFO:teuthology.orchestra.run.smithi016.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-11T01:00:15.742 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-11T01:00:15.742 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-11T01:00:15.742 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-11T01:00:15.742 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.742 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.742 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-11T01:00:15.743 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-11T01:00:15.744 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply-3.11-14.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.745 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-11T01:00:15.746 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: re2-1:20211101-3.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-11T01:00:15.747 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-11T01:00:15.748 INFO:teuthology.orchestra.run.smithi016.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-11T01:00:15.748 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:15.748 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-05-11T01:00:16.168 DEBUG:teuthology.parallel:result is None 2024-05-11T01:00:16.573 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-11T01:00:16.573 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:16.573 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-05-11T01:00:16.573 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-11T01:00:16.573 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-11T01:00:16.574 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.575 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.576 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.0.0-3570.g10380055.el9.noarch 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-11T01:00:16.577 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.578 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-11T01:00:16.579 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.14-1.el9.x86_64 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-11T01:00:16.580 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-11T01:00:16.581 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-11T01:00:16.581 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.581 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.581 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.581 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-11T01:00:16.581 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-11T01:00:16.581 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-11T01:00:16.581 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-11T01:00:16.582 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-11T01:00:16.583 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-11T01:00:16.584 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-05-11T01:00:16.584 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-11T01:00:16.584 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-11T01:00:16.584 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-11T01:00:16.584 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-11T01:00:16.584 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-11T01:00:16.584 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-11T01:00:16.584 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-11T01:00:16.585 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.0.0-3570.g10380055.el9.x86_64 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-3.el9.x86_64 2024-05-11T01:00:16.586 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-11T01:00:16.587 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-11T01:00:16.587 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-11T01:00:16.587 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-11T01:00:16.587 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-11T01:00:16.587 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-11T01:00:16.587 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:16.587 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-05-11T01:00:17.076 DEBUG:teuthology.parallel:result is None 2024-05-11T01:00:17.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=10380055a1fc5e7d3b37b252af7045f5c2c8ba29 2024-05-11T01:00:17.251 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-11T01:00:17.278 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-3570.g10380055.el9 2024-05-11T01:00:17.279 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3570.g10380055.el9 2024-05-11T01:00:17.279 INFO:teuthology.task.install:The correct ceph version 19.0.0-3570.g10380055 is installed. 2024-05-11T01:00:17.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=10380055a1fc5e7d3b37b252af7045f5c2c8ba29 2024-05-11T01:00:17.459 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-11T01:00:17.483 INFO:teuthology.orchestra.run.smithi174.stdout:19.0.0-3570.g10380055.el9 2024-05-11T01:00:17.483 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3570.g10380055.el9 2024-05-11T01:00:17.483 INFO:teuthology.task.install:The correct ceph version 19.0.0-3570.g10380055 is installed. 2024-05-11T01:00:17.485 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-11T01:00:17.486 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:17.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-11T01:00:17.520 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:17.520 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-11T01:00:17.552 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-11T01:00:17.552 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:17.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-05-11T01:00:17.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-11T01:00:17.662 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:17.662 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-05-11T01:00:17.689 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-11T01:00:17.755 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-11T01:00:17.755 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:17.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-11T01:00:17.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-11T01:00:17.856 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:17.856 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-11T01:00:17.882 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-11T01:00:17.947 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-11T01:00:17.948 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:17.948 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-05-11T01:00:17.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-11T01:00:18.048 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:18.048 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-05-11T01:00:18.074 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-11T01:00:18.139 INFO:teuthology.run_tasks:Running task ceph... 2024-05-11T01:00:18.244 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-11T01:00:18.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-05-11T01:00:18.247 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2024-05-11T01:00:18.276 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-11T01:00:18.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-11T01:00:18.318 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-11T01:00:18.346 INFO:tasks.ceph:Creating extra log directories... 2024-05-11T01:00:18.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-11T01:00:18.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-11T01:00:18.433 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-11T01:00:18.433 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-11T01:00:18.433 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-11T01:00:18.434 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:18.434 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-11T01:00:18.485 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-11T01:00:18.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-11T01:00:18.645 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:18.645 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-11T01:00:18.676 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-11T01:00:18.819 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-11T01:00:18.855 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-11T01:00:18.855 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-11T01:00:18.855 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036', 'branch': 'wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7702036', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds', 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3672, 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrl1ef1mykH3JmopPQYUOHANK2FNT2VPlDanLPwS/38zsUIJPpWIQCNfJVThPWaml25/0XDRt8fa1qi5pfFTAM=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIR8r7mTzb9ZSsVOoWptUVmB++iCaQVMToqhneGELl0ckVN8qjpy7L0LrTOHG+H6fUc+dqfX80AglV2eKpDbwmc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '10380055a1fc5e7d3b37b252af7045f5c2c8ba29', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-11_00:39:26', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-11T01:00:18.856 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-11T01:00:18.869 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-11T01:00:18.908 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-05-11T01:00:18.934 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-05-11T01:00:18.978 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:18.978 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-05-11T01:00:19.021 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-11T01:00:19.021 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-05-11T01:00:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-11T01:00:19.084 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-11T01:00:19.084 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-11T01:00:19.084 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-11T01:00:19.085 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-05-11T01:00:19.085 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-11 01:00:07.715867405 +0000 2024-05-11T01:00:19.085 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-11 00:58:03.788231244 +0000 2024-05-11T01:00:19.085 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-11 00:58:03.788231244 +0000 2024-05-11T01:00:19.085 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-05-11 00:58:03.788231244 +0000 2024-05-11T01:00:19.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-11T01:00:19.163 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-11T01:00:19.163 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-11T01:00:19.163 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.00012331 s, 4.2 MB/s 2024-05-11T01:00:19.163 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-11T01:00:19.234 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-05-11T01:00:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-11T01:00:19.298 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-11T01:00:19.298 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-11T01:00:19.299 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-11T01:00:19.299 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-05-11T01:00:19.299 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-11 01:00:07.716867390 +0000 2024-05-11T01:00:19.299 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-11 00:58:04.129225977 +0000 2024-05-11T01:00:19.299 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-11 00:58:04.129225977 +0000 2024-05-11T01:00:19.299 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-05-11 00:58:04.129225977 +0000 2024-05-11T01:00:19.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-11T01:00:19.370 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-11T01:00:19.370 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-11T01:00:19.370 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000115486 s, 4.4 MB/s 2024-05-11T01:00:19.371 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-11T01:00:19.434 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-11 01:00:07.716867390 +0000 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-11 00:58:04.470220710 +0000 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-11 00:58:04.470220710 +0000 2024-05-11T01:00:19.494 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-05-11 00:58:04.470220710 +0000 2024-05-11T01:00:19.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-11T01:00:19.562 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-11T01:00:19.562 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-11T01:00:19.563 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000111789 s, 4.6 MB/s 2024-05-11T01:00:19.564 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-11T01:00:19.626 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-05-11T01:00:19.685 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-11T01:00:19.685 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-11T01:00:19.685 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-11T01:00:19.685 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-11T01:00:19.685 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-05-11T01:00:19.686 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-05-11 01:00:07.717867374 +0000 2024-05-11T01:00:19.686 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-05-11 00:58:04.798215643 +0000 2024-05-11T01:00:19.686 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-05-11 00:58:04.798215643 +0000 2024-05-11T01:00:19.686 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-05-11 00:58:04.798215643 +0000 2024-05-11T01:00:19.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-11T01:00:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-05-11T01:00:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-05-11T01:00:19.757 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000133435 s, 3.8 MB/s 2024-05-11T01:00:19.759 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-11T01:00:19.818 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:19.818 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:19.819 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-05-11T01:00:19.838 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-11T01:00:19.839 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-11 01:00:08.780793573 +0000 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-11 00:58:01.648956523 +0000 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-11 00:58:01.648956523 +0000 2024-05-11T01:00:19.897 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-11 00:58:01.648956523 +0000 2024-05-11T01:00:19.898 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-11T01:00:19.964 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-11T01:00:19.964 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-11T01:00:19.965 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000218132 s, 2.3 MB/s 2024-05-11T01:00:19.966 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-11T01:00:20.024 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-11 01:00:08.780793573 +0000 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-11 00:58:01.987952493 +0000 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-11 00:58:01.987952493 +0000 2024-05-11T01:00:20.082 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-11 00:58:01.987952493 +0000 2024-05-11T01:00:20.083 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-11T01:00:20.147 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-11T01:00:20.148 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-11T01:00:20.148 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000199127 s, 2.6 MB/s 2024-05-11T01:00:20.149 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-11T01:00:20.207 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-05-11T01:00:20.263 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-11T01:00:20.263 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-11T01:00:20.263 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-11T01:00:20.263 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-11T01:00:20.264 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-11T01:00:20.264 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-11 01:00:08.781793561 +0000 2024-05-11T01:00:20.264 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-11 00:58:02.323948499 +0000 2024-05-11T01:00:20.264 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-11 00:58:02.323948499 +0000 2024-05-11T01:00:20.264 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-11 00:58:02.323948499 +0000 2024-05-11T01:00:20.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-11T01:00:20.327 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-11T01:00:20.327 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-11T01:00:20.327 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000221458 s, 2.3 MB/s 2024-05-11T01:00:20.329 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-11T01:00:20.386 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-05-11 01:00:08.781793561 +0000 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-05-11 00:58:02.654944564 +0000 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-05-11 00:58:02.654944564 +0000 2024-05-11T01:00:20.442 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-05-11 00:58:02.654944564 +0000 2024-05-11T01:00:20.443 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-11T01:00:20.505 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-05-11T01:00:20.505 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-05-11T01:00:20.505 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00019281 s, 2.7 MB/s 2024-05-11T01:00:20.507 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-11T01:00:20.564 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:20.564 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-11T01:00:20.564 INFO:tasks.ceph:Generating config... 2024-05-11T01:00:20.565 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-11T01:00:20.565 INFO:tasks.ceph:[client] debug client = 20 2024-05-11T01:00:20.565 INFO:tasks.ceph:[client] debug ms = 1 2024-05-11T01:00:20.566 INFO:tasks.ceph:[client] pid file = 2024-05-11T01:00:20.566 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-11T01:00:20.566 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-11T01:00:20.566 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-11T01:00:20.566 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-11T01:00:20.567 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-11T01:00:20.567 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-11T01:00:20.567 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-11T01:00:20.567 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-11T01:00:20.567 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-11T01:00:20.567 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-11T01:00:20.567 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-11T01:00:20.568 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-11T01:00:20.568 INFO:tasks.ceph:Setting up mon.a... 2024-05-11T01:00:20.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-11T01:00:20.630 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-05-11T01:00:20.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-11T01:00:20.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-11T01:00:20.708 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.174'), ('mon.c', '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]')] 2024-05-11T01:00:20.708 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-11T01:00:20.709 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:20.709 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-11T01:00:20.765 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.174 --addv c '[v2:172.21.15.174:3301,v1:172.21.15.174:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:20.855 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 3d939707-6559-4ce1-a2ce-e98842b2ed86 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 3d939707-6559-4ce1-a2ce-e98842b2ed86 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-05-11T01:00:20.856644+0000 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-05-11T01:00:20.856644+0000 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] mon.c 2024-05-11T01:00:20.856 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-11T01:00:20.857 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-11T01:00:20.874 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3d939707-6559-4ce1-a2ce-e98842b2ed86... 2024-05-11T01:00:20.874 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-11T01:00:20.916 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-11T01:00:20.959 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-05-11T01:00:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-05-11T01:00:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-11T01:00:20.959 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-05-11T01:00:20.961 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-05-11T01:00:20.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on skipped message = False 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 3d939707-6559-4ce1-a2ce-e98842b2ed86 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-05-11T01:00:20.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-05-11T01:00:20.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-05-11T01:00:20.965 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-05-11T01:00:20.966 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug finisher = 20 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.967 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.968 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-05-11T01:00:20.969 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-05-11T01:00:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon down mkfs grace = 300 2024-05-11T01:00:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2024-05-11T01:00:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:20.970 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-05-11T01:00:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-05-11T01:00:20.970 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = "" 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-05-11T01:00:20.971 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2024-05-11T01:00:20.972 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2024-05-11T01:00:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2024-05-11T01:00:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2024-05-11T01:00:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-05-11T01:00:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-05-11T01:00:20.973 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-05-11T01:00:20.975 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-05-11T01:00:20.975 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-05-11T01:00:20.975 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.976 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-05-11T01:00:20.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.16,172.21.15.174,[v2:172.21.15.174:3301,v1:172.21.15.174:6790]" 2024-05-11T01:00:20.978 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on skipped message = False 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = 3d939707-6559-4ce1-a2ce-e98842b2ed86 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-05-11T01:00:20.979 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug trim objects = true 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-05-11T01:00:20.980 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: bdev async discard = True 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: bdev enable discard = True 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore allocator = bitmap 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 1/20 2024-05-11T01:00:20.981 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 1/20 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 4/10 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-05-11T01:00:20.982 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: debug finisher = 20 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-05-11T01:00:20.983 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-05-11T01:00:20.984 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: mon down mkfs grace = 300 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2024-05-11T01:00:20.985 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = "" 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2024-05-11T01:00:20.986 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds balancer = 20 2024-05-11T01:00:20.987 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-05-11T01:00:20.987 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2024-05-11T01:00:20.987 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2024-05-11T01:00:20.987 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2024-05-11T01:00:20.987 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2024-05-11T01:00:20.987 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-05-11T01:00:20.987 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-05-11T01:00:20.987 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-05-11T01:00:20.987 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-11T01:00:20.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-11T01:00:21.072 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-11T01:00:21.072 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:21.072 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-11T01:00:21.088 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:21.088 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-11T01:00:21.143 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:00:21.143 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:21.143 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-11T01:00:21.144 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-11T01:00:21.219 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:21.219 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:21.276 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:00:21.276 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:21.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-11T01:00:21.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-11T01:00:21.311 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:21.311 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:21.369 INFO:tasks.ceph:Setting up mon nodes... 2024-05-11T01:00:21.369 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-11T01:00:21.369 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-11T01:00:21.422 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-11T01:00:21.424 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-11T01:00:21.484 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-11T01:00:21.487 INFO:tasks.ceph:Setting up mds nodes... 2024-05-11T01:00:21.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-11T01:00:21.540 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-11T01:00:21.543 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-11T01:00:21.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-11T01:00:21.661 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-11T01:00:21.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-11T01:00:21.689 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-11T01:00:21.740 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-11T01:00:21.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-11T01:00:21.768 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-11T01:00:21.859 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-11T01:00:21.861 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-11T01:00:21.886 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-11T01:00:21.886 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-11T01:00:21.929 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-11T01:00:21.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-11T01:00:22.025 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-11T01:00:22.038 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-11T01:00:22.080 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-11T01:00:22.093 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-11T01:00:22.175 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-11T01:00:22.187 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-11T01:00:22.187 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-11T01:00:22.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-11T01:00:22.215 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:22.215 INFO:tasks.ceph:role: osd.0 2024-05-11T01:00:22.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:00:22.215 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-11T01:00:22.281 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-11T01:00:22.282 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-11T01:00:22.315 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-05-11T01:00:22.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-05-11T01:00:22.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-11T01:00:22.388 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-11T01:00:22.459 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-11T01:00:22.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:22.525 INFO:tasks.ceph:role: osd.1 2024-05-11T01:00:22.525 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:00:22.525 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-11T01:00:22.592 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-11T01:00:22.592 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-11T01:00:22.592 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-11T01:00:22.592 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-11T01:00:22.592 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-11T01:00:22.593 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-05-11T01:00:22.593 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-11T01:00:22.593 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-11T01:00:22.593 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-11T01:00:22.593 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-11T01:00:22.625 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-05-11T01:00:22.627 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-05-11T01:00:22.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-11T01:00:22.698 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-11T01:00:22.769 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-11T01:00:22.836 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:22.836 INFO:tasks.ceph:role: osd.2 2024-05-11T01:00:22.836 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:00:22.836 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-11T01:00:22.903 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-11T01:00:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-11T01:00:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-11T01:00:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-11T01:00:22.903 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-11T01:00:22.903 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-05-11T01:00:22.904 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-11T01:00:22.904 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-11T01:00:22.904 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-11T01:00:22.904 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-11T01:00:22.936 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-05-11T01:00:22.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-05-11T01:00:22.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-11T01:00:23.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-11T01:00:23.082 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-11T01:00:23.148 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:23.148 INFO:tasks.ceph:role: osd.3 2024-05-11T01:00:23.148 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:00:23.148 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-11T01:00:23.213 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-11T01:00:23.213 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-11T01:00:23.213 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-11T01:00:23.213 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-11T01:00:23.213 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-11T01:00:23.213 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-05-11T01:00:23.214 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-11T01:00:23.214 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-11T01:00:23.214 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-11T01:00:23.214 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-11T01:00:23.248 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-05-11T01:00:23.250 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-05-11T01:00:23.251 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-11T01:00:23.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-11T01:00:23.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:23.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:23.490+0000 7f182132c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-11T01:00:23.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:23.490+0000 7f182132c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-11T01:00:23.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:23.490+0000 7f182132c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-11T01:00:23.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:23.490+0000 7f182132c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-11T01:00:23.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:23.490+0000 7f182132c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-11T01:00:23.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:23.490+0000 7f182132c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-11T01:00:26.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-11T01:00:26.370 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:26.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:26.462+0000 7f6cf974c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-11T01:00:26.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:26.462+0000 7f6cf974c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-11T01:00:26.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:26.462+0000 7f6cf974c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-11T01:00:26.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:26.462+0000 7f6cf974c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-11T01:00:26.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:26.462+0000 7f6cf974c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-11T01:00:26.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:26.462+0000 7f6cf974c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-11T01:00:29.315 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-11T01:00:29.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:29.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:29.438+0000 7fe588bc4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-11T01:00:29.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:29.438+0000 7fe588bc4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-11T01:00:29.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:29.438+0000 7fe588bc4640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-11T01:00:29.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:29.438+0000 7fe588bc4640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-11T01:00:29.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:29.438+0000 7fe588bc4640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-11T01:00:29.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:29.439+0000 7fe588bc4640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-11T01:00:32.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-11T01:00:32.323 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:32.418+0000 7f31b73be640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-11T01:00:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:32.418+0000 7f31b73be640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-11T01:00:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:32.418+0000 7f31b73be640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-11T01:00:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:32.418+0000 7f31b73be640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-11T01:00:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:32.418+0000 7f31b73be640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-11T01:00:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:32.418+0000 7f31b73be640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-11T01:00:35.267 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-11T01:00:35.298 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-11T01:00:35.327 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:35.328 INFO:tasks.ceph:role: osd.4 2024-05-11T01:00:35.328 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:00:35.328 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-11T01:00:35.404 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-11T01:00:35.404 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-11T01:00:35.404 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-11T01:00:35.404 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-11T01:00:35.404 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-11T01:00:35.404 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-05-11T01:00:35.404 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-11T01:00:35.404 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-11T01:00:35.405 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-11T01:00:35.405 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-11T01:00:35.915 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-05-11T01:00:35.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-05-11T01:00:35.917 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-11T01:00:36.031 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-11T01:00:36.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-11T01:00:36.130 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:36.130 INFO:tasks.ceph:role: osd.5 2024-05-11T01:00:36.130 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:00:36.130 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-11T01:00:36.204 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-11T01:00:36.204 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-11T01:00:36.204 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-11T01:00:36.204 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-11T01:00:36.204 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-11T01:00:36.205 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-05-11T01:00:36.205 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-11T01:00:36.205 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-11T01:00:36.205 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-11T01:00:36.205 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-11T01:00:36.655 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-05-11T01:00:36.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-05-11T01:00:36.657 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-11T01:00:36.743 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-11T01:00:36.812 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-11T01:00:36.877 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:36.877 INFO:tasks.ceph:role: osd.6 2024-05-11T01:00:36.877 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:00:36.877 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-11T01:00:36.950 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-11T01:00:36.950 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-11T01:00:36.950 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-11T01:00:36.950 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-11T01:00:36.950 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-11T01:00:36.951 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-05-11T01:00:36.951 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-11T01:00:36.951 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-11T01:00:36.951 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-11T01:00:36.951 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-11T01:00:37.439 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-05-11T01:00:37.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-05-11T01:00:37.442 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-11T01:00:37.571 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-11T01:00:37.601 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-11T01:00:37.666 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-11T01:00:37.666 INFO:tasks.ceph:role: osd.7 2024-05-11T01:00:37.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:00:37.666 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-11T01:00:37.738 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-11T01:00:37.738 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-11T01:00:37.738 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-11T01:00:37.738 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-11T01:00:37.738 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-11T01:00:37.739 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-05-11T01:00:37.739 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-11T01:00:37.739 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-11T01:00:37.739 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-11T01:00:37.739 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-11T01:00:38.259 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-05-11T01:00:38.261 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-05-11T01:00:38.261 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-11T01:00:38.413 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-11T01:00:38.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:38.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:38.561+0000 7feecffc4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-11T01:00:38.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:38.561+0000 7feecffc4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-11T01:00:38.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:38.561+0000 7feecffc4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-11T01:00:38.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:38.561+0000 7feecffc4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-11T01:00:38.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:38.561+0000 7feecffc4640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-11T01:00:38.562 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:38.562+0000 7feecffc4640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-11T01:00:41.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-11T01:00:41.451 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:41.541 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:41.540+0000 7fee29bc2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-11T01:00:41.541 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:41.541+0000 7fee29bc2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-11T01:00:41.541 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:41.541+0000 7fee29bc2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-11T01:00:41.541 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:41.541+0000 7fee29bc2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-11T01:00:41.541 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:41.541+0000 7fee29bc2640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-11T01:00:41.542 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:41.541+0000 7fee29bc2640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-11T01:00:44.390 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-11T01:00:44.420 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:44.512 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:44.512+0000 7ff88181d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-11T01:00:44.513 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:44.512+0000 7ff88181d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-11T01:00:44.513 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:44.512+0000 7ff88181d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-11T01:00:44.513 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:44.512+0000 7ff88181d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-11T01:00:44.513 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:44.512+0000 7ff88181d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-11T01:00:44.513 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:44.513+0000 7ff88181d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-11T01:00:47.371 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-11T01:00:47.397 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:47.483 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:47.482+0000 7f9faa9b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-11T01:00:47.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:47.483+0000 7f9faa9b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-11T01:00:47.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:47.483+0000 7f9faa9b1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-11T01:00:47.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:47.483+0000 7f9faa9b1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-11T01:00:47.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:47.483+0000 7f9faa9b1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-11T01:00:47.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:47.483+0000 7f9faa9b1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-11T01:00:48.858 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:00:48.863 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:00:50.333 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-11T01:00:50.361 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-11T01:00:50.362 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:50.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-11T01:00:50.395 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:50.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-11T01:00:50.464 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:50.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-11T01:00:50.535 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:50.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-11T01:00:50.604 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:50.604 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-11T01:00:50.673 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:50.674 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-11T01:00:50.742 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:50.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-11T01:00:50.811 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:50.811 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-11T01:00:50.841 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:50.841 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-11T01:00:50.911 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:50.911 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-11T01:00:50.980 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:50.981 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-11T01:00:51.050 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:51.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-11T01:00:51.119 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:51.120 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-11T01:00:51.187 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:51.188 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-11T01:00:51.255 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:51.255 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-11T01:00:51.274 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:51.274 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-11T01:00:51.335 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:51.335 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-11T01:00:51.351 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:51.351 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-11T01:00:51.407 INFO:tasks.ceph:Adding keys to all mons... 2024-05-11T01:00:51.407 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-11T01:00:51.410 DEBUG:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-11T01:00:51.450 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-05-11T01:00:51.450 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5m45Y3GRAAxdsBni25ybahhd/vsNP/1A== 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5m18ZJIBAA7zAsyHoQQooYHziHMr9fUQ== 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5m6hODJxAAK9XmxeYzlY0MvVdtQD2bxQ== 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAnwz5m3HlEHRAA6Z8NONh+ZQzXoAjwLX+3xQ== 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAqwz5m55iZGxAA3NTF614jMZhlpM4tYEBKkQ== 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAtwz5m6VowGhAAmCPoZK5bb0bPWvTNHBRykQ== 2024-05-11T01:00:51.451 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAwwz5mbn/5GBAAFmx+UKt4TOsDDLu1NvO/xg== 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5mbhnwHBAAwY5+kkQlvHmV7umsy3EEFw== 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5mrUExLBAAN/gCmP67f9XLzKifNRagiw== 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5mn2dBMxAA38Wxx8t36Kww9TwJ+FFW8Q== 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQA2wz5mHW6LIRAAoJJJ04swD7SsPX1eEyWtwA== 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQA5wz5mlZlNIBAArpMYv4k/n2pfGYRpao6y9g== 2024-05-11T01:00:51.452 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQA8wz5m2QWbHhAAkG756Er+q0gg17SPmGEzeA== 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQA/wz5m3v3aHBAAoeD297XRIx25RQY6XMd4vA== 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5mBE92NxAAwjJJ4BDqTpd7qQZiD1YlYA== 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:[client.2] 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAmwz5mTECQARAAW1u1LX01lSAH9D0IFc52CA== 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAmwz5mpmDeBBAAoDYEIl6yNYSP6cecHiuAOA== 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout:[client.3] 2024-05-11T01:00:51.453 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAmwz5mVXd+ChAAPBYtXP8NrccAP8qppA3JnA== 2024-05-11T01:00:51.471 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2024-05-11T01:00:51.471 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAlwz5m45Y3GRAAxdsBni25ybahhd/vsNP/1A== 2024-05-11T01:00:51.471 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-05-11T01:00:51.471 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAlwz5m18ZJIBAA7zAsyHoQQooYHziHMr9fUQ== 2024-05-11T01:00:51.471 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAlwz5m6hODJxAAK9XmxeYzlY0MvVdtQD2bxQ== 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAnwz5m3HlEHRAA6Z8NONh+ZQzXoAjwLX+3xQ== 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAqwz5m55iZGxAA3NTF614jMZhlpM4tYEBKkQ== 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAtwz5m6VowGhAAmCPoZK5bb0bPWvTNHBRykQ== 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAwwz5mbn/5GBAAFmx+UKt4TOsDDLu1NvO/xg== 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAlwz5mbhnwHBAAwY5+kkQlvHmV7umsy3EEFw== 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-05-11T01:00:51.472 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAlwz5mrUExLBAAN/gCmP67f9XLzKifNRagiw== 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAlwz5mn2dBMxAA38Wxx8t36Kww9TwJ+FFW8Q== 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQA2wz5mHW6LIRAAoJJJ04swD7SsPX1eEyWtwA== 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQA5wz5mlZlNIBAArpMYv4k/n2pfGYRpao6y9g== 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQA8wz5m2QWbHhAAkG756Er+q0gg17SPmGEzeA== 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQA/wz5m3v3aHBAAoeD297XRIx25RQY6XMd4vA== 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAlwz5mBE92NxAAwjJJ4BDqTpd7qQZiD1YlYA== 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout:[client.2] 2024-05-11T01:00:51.473 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAmwz5mTECQARAAW1u1LX01lSAH9D0IFc52CA== 2024-05-11T01:00:51.474 INFO:teuthology.orchestra.run.smithi174.stdout:[client.1] 2024-05-11T01:00:51.474 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAmwz5mpmDeBBAAoDYEIl6yNYSP6cecHiuAOA== 2024-05-11T01:00:51.474 INFO:teuthology.orchestra.run.smithi174.stdout:[client.3] 2024-05-11T01:00:51.474 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAmwz5mVXd+ChAAPBYtXP8NrccAP8qppA3JnA== 2024-05-11T01:00:51.475 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-11T01:00:51.497 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-11T01:00:51.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-11T01:00:51.570 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-11T01:00:51.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-11T01:00:51.628 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-11T01:00:51.682 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:51.684 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:51.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:51.738 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:51.789 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:51.792 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:51.842 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:51.845 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:51.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-11T01:00:51.898 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-11T01:00:51.949 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-11T01:00:51.954 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-11T01:00:52.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-11T01:00:52.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-11T01:00:52.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:52.065 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:52.116 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:52.118 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:52.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:52.172 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:52.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:52.225 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-11T01:00:52.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-11T01:00:52.279 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-11T01:00:52.333 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-11T01:00:52.336 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-11T01:00:52.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-11T01:00:52.392 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-11T01:00:52.447 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-11T01:00:52.449 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-11T01:00:52.504 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-11T01:00:52.504 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-11T01:00:52.530 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-11T01:00:52.629 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-11T01:00:52.656 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-11T01:00:52.682 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-11T01:00:52.779 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-11T01:00:52.804 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-11T01:00:52.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-11T01:00:52.965 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-11T01:00:52.990 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:52.992 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-11T01:00:53.045 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-11T01:00:53.046 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-11T01:00:53.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-11T01:00:53.048 INFO:tasks.ceph.mon.a:Started 2024-05-11T01:00:53.048 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-11T01:00:53.048 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-11T01:00:53.088 INFO:tasks.ceph.mon.b:Started 2024-05-11T01:00:53.088 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-11T01:00:53.088 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-11T01:00:53.091 INFO:tasks.ceph.mon.c:Started 2024-05-11T01:00:53.091 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-11T01:00:53.091 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-11T01:00:53.091 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-11T01:00:53.096 INFO:tasks.ceph.mgr.y:Started 2024-05-11T01:00:53.096 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-11T01:00:53.096 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-11T01:00:53.098 INFO:tasks.ceph.mgr.x:Started 2024-05-11T01:00:53.098 INFO:tasks.ceph:Setting crush tunables to default 2024-05-11T01:00:53.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-05-11T01:00:53.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.203+0000 7ffab4e64640 1 Processor -- start 2024-05-11T01:00:53.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.203+0000 7ffab4e64640 1 -- start start 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffab4e64640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffab00d4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffab4e64640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffab00baba0 0x7ffab006d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffab4e64640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00d34e0 con 0x7ffab00bb000 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffab4e64640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ffab00d37c0 con 0x7ffab00baba0 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffab4e64640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffab00d3aa0 con 0x7ffab015f560 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffaae59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffab00d4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffaae59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffab00d4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:56618/0 (socket says 172.21.15.16:56618) 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffaae59c640 1 -- 172.21.15.16:0/4044277080 learned_addr learned my addr 172.21.15.16:0/4044277080 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffaadd9b640 1 --2- 172.21.15.16:0/4044277080 >> v2:172.21.15.174:3300/0 conn(0x7ffab00baba0 0x7ffab006d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffaae59c640 1 -- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 msgr2=0x7ffab00d4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-11T01:00:53.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffaae59c640 1 -- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 msgr2=0x7ffab00d4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-11T01:00:53.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.204+0000 7ffaae59c640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffab00d4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-11T01:00:53.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.205+0000 7ffaae59c640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffab00d4580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:00:53.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.205+0000 7ffaadd9b640 1 -- 172.21.15.16:0/4044277080 >> v2:172.21.15.174:3300/0 conn(0x7ffab00baba0 msgr2=0x7ffab006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-11T01:00:53.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.205+0000 7ffaadd9b640 1 -- 172.21.15.16:0/4044277080 >> v2:172.21.15.174:3300/0 conn(0x7ffab00baba0 msgr2=0x7ffab006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-11T01:00:53.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.205+0000 7ffaadd9b640 1 --2- 172.21.15.16:0/4044277080 >> v2:172.21.15.174:3300/0 conn(0x7ffab00baba0 0x7ffab006d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-11T01:00:53.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.205+0000 7ffaadd9b640 1 --2- 172.21.15.16:0/4044277080 >> v2:172.21.15.174:3300/0 conn(0x7ffab00baba0 0x7ffab006d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:00:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.356+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151705633 0 0) 0x7ffab00d34e0 con 0x7ffab00bb000 2024-05-11T01:00:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.356+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa98003520 con 0x7ffab00bb000 2024-05-11T01:00:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.356+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3155766347 0 0) 0x7ffa98003520 con 0x7ffab00bb000 2024-05-11T01:00:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.356+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 msgr2=0x7ffab00d4580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-11T01:00:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.356+0000 7ffaad59a640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffab00d4580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.356+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 >> v2:172.21.15.174:3300/0 conn(0x7ffab00baba0 msgr2=0x7ffab006d860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-11T01:00:53.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.356+0000 7ffaad59a640 1 --2- 172.21.15.16:0/4044277080 >> v2:172.21.15.174:3300/0 conn(0x7ffab00baba0 0x7ffab006d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.356+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab00d3d80 con 0x7ffab00bb000 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7ffaa8001a70 con 0x7ffab00bb000 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 >> v1:172.21.15.174:6789/0 conn(0x7ffab00bb000 legacy=0x7ffab00b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaad59a640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98003a00 0x7ffa98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaad59a640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa98004800 0x7ffa98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaad59a640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffa980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffab00d37c0 con 0x7ffa98003a00 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffab00d3aa0 con 0x7ffa98004800 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9800bb20 con 0x7ffab015f560 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaae59c640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98003a00 0x7ffa98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaaed9d640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffa980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaadd9b640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa98004800 0x7ffa98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaae59c640 1 -- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 msgr2=0x7ffa980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:53.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaae59c640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffab015f560 0x7ffa980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaae59c640 1 -- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa98004800 msgr2=0x7ffa98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaae59c640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa98004800 0x7ffa98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.357+0000 7ffaae59c640 1 -- 172.21.15.16:0/4044277080 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa98003520 con 0x7ffa98003a00 2024-05-11T01:00:53.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.358+0000 7ffaae59c640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98003a00 0x7ffa98003e20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009100 tx=0x7ffa98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee551b0671ab5b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.360+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0037070 con 0x7ffa98003a00 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.360+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa002aca0 con 0x7ffa98003a00 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.360+0000 7ffaad59a640 1 -- 172.21.15.16:0/4044277080 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000f040 con 0x7ffa98003a00 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.360+0000 7ffab4e64640 1 -- 172.21.15.16:0/4044277080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98003a00 msgr2=0x7ffa98003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.360+0000 7ffab4e64640 1 --2- 172.21.15.16:0/4044277080 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa98003a00 0x7ffa98003e20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009100 tx=0x7ffa98005830 comp rx=0 tx=0).stop 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.360+0000 7ffaaed9d640 1 -- 172.21.15.16:0/4044277080 reap_dead start 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.360+0000 7ffab4e64640 1 -- 172.21.15.16:0/4044277080 shutdown_connections 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.360+0000 7ffab4e64640 1 -- 172.21.15.16:0/4044277080 >> 172.21.15.16:0/4044277080 conn(0x7ffab0073f00 msgr2=0x7ffab0074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:53.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.361+0000 7ffab4e64640 1 -- 172.21.15.16:0/4044277080 shutdown_connections 2024-05-11T01:00:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.361+0000 7ffab4e64640 1 -- 172.21.15.16:0/4044277080 wait complete. 2024-05-11T01:00:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.362+0000 7ffab4e64640 1 Processor -- start 2024-05-11T01:00:53.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.362+0000 7ffab4e64640 1 -- start start 2024-05-11T01:00:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffab4e64640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa98003a00 0x7ffab0158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffab4e64640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffab0158da0 0x7ffab0147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffab4e64640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab0147bc0 0x7ffab0154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffab4e64640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffab00d5da0 con 0x7ffab0158da0 2024-05-11T01:00:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffab4e64640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffab015f940 con 0x7ffab0147bc0 2024-05-11T01:00:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffab4e64640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffab00d5f20 con 0x7ffa98003a00 2024-05-11T01:00:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaadd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffab0158da0 0x7ffab0147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:53.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaae59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa98003a00 0x7ffab0158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaadd9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffab0158da0 0x7ffab0147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49466/0 (socket says 172.21.15.16:49466) 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaadd9b640 1 -- 172.21.15.16:0/3892469178 learned_addr learned my addr 172.21.15.16:0/3892469178 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaaed9d640 1 --2- 172.21.15.16:0/3892469178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab0147bc0 0x7ffab0154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaadd9b640 1 -- 172.21.15.16:0/3892469178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa98003a00 msgr2=0x7ffab0158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaadd9b640 1 --2- 172.21.15.16:0/3892469178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa98003a00 0x7ffab0158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaadd9b640 1 -- 172.21.15.16:0/3892469178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab0147bc0 msgr2=0x7ffab0154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaadd9b640 1 --2- 172.21.15.16:0/3892469178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab0147bc0 0x7ffab0154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.363+0000 7ffaadd9b640 1 -- 172.21.15.16:0/3892469178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab0148000 con 0x7ffab0158da0 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.364+0000 7ffaadd9b640 1 --2- 172.21.15.16:0/3892469178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffab0158da0 0x7ffab0147680 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40108f0 tx=0x7ffaa4010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.364+0000 7ffa9effd640 1 -- 172.21.15.16:0/3892469178 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa401a020 con 0x7ffab0158da0 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.364+0000 7ffa9effd640 1 -- 172.21.15.16:0/3892469178 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa400e9c0 con 0x7ffab0158da0 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.364+0000 7ffa9effd640 1 -- 172.21.15.16:0/3892469178 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400edb0 con 0x7ffab0158da0 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.364+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab0161650 con 0x7ffab0158da0 2024-05-11T01:00:53.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.364+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab0161c10 con 0x7ffab0158da0 2024-05-11T01:00:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.365+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab006a5b0 con 0x7ffab0158da0 2024-05-11T01:00:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.366+0000 7ffa9effd640 1 -- 172.21.15.16:0/3892469178 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffaa401d020 con 0x7ffab0158da0 2024-05-11T01:00:53.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.366+0000 7ffa9effd640 1 -- 172.21.15.16:0/3892469178 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffaa4029660 con 0x7ffab0158da0 2024-05-11T01:00:53.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.368+0000 7ffa9effd640 1 -- 172.21.15.16:0/3892469178 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ffaa4024020 con 0x7ffab0158da0 2024-05-11T01:00:53.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.436+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ffab00cbb40 con 0x7ffab0158da0 2024-05-11T01:00:53.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.437+0000 7ffa9effd640 1 -- 172.21.15.16:0/3892469178 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ffaa4029860 con 0x7ffab0158da0 2024-05-11T01:00:53.438 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-05-11T01:00:53.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffab0158da0 msgr2=0x7ffab0147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:53.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 --2- 172.21.15.16:0/3892469178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffab0158da0 0x7ffab0147680 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40108f0 tx=0x7ffaa4010cf0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 shutdown_connections 2024-05-11T01:00:53.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 --2- 172.21.15.16:0/3892469178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffab0147bc0 0x7ffab0154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 --2- 172.21.15.16:0/3892469178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffab0158da0 0x7ffab0147680 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 --2- 172.21.15.16:0/3892469178 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa98003a00 0x7ffab0158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:53.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 >> 172.21.15.16:0/3892469178 conn(0x7ffab0073f00 msgr2=0x7ffab00d5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:53.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 shutdown_connections 2024-05-11T01:00:53.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:53.439+0000 7ffab4e64640 1 -- 172.21.15.16:0/3892469178 wait complete. 2024-05-11T01:00:53.450 INFO:tasks.ceph:check_enable_crimson: False 2024-05-11T01:00:53.450 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-11T01:00:53.451 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:53.451 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-11T01:00:53.477 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:53.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-11T01:00:53.479 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:53.479+0000 7f27aedee040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-11T01:00:53.497 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:53.497+0000 7fb141fea040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-11T01:00:53.505 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:53.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-11T01:00:53.571 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:00:53.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-11T01:00:53.637 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:53.637 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-11T01:00:53.651 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:53.651+0000 7fb141fea040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:00:53.662 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:53.662 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-11T01:00:53.682 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:53.682+0000 7f27aedee040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:00:53.707 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:53.707+0000 7fb141fea040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-11T01:00:53.727 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:53.727 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-11T01:00:53.738 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:53.738+0000 7f27aedee040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-11T01:00:53.792 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:00:53.792 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-11T01:00:53.858 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new e40b2639-d7e1-4bc8-9115-b276895b56f5 0 2024-05-11T01:00:53.970 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:53.969+0000 7fb141fea040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-11T01:00:53.989 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:53.990+0000 7f27aedee040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-11T01:00:53.998 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.998+0000 7f041f0c4640 1 Processor -- start 2024-05-11T01:00:53.998 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.998+0000 7f041f0c4640 1 -- start start 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f041f0c4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0418072860 0x7f04181600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f041f0c4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041806ecf0 con 0x7f0418162f90 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f041f0c4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f041806dc50 con 0x7f041806d700 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f041f0c4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f04181490a0 con 0x7f0418072860 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f041d661640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0418072860 0x7f04181600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f0417fff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f041806d700 0x7f041815f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:51738/0 (socket says 172.21.15.174:51738) 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f0417fff640 1 -- 172.21.15.174:0/2173937273 learned_addr learned my addr 172.21.15.174:0/2173937273 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f041d661640 1 -- 172.21.15.174:0/2173937273 >> v1:172.21.15.174:6789/0 conn(0x7f041806d700 legacy=0x7f041815f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.000 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f041d661640 1 -- 172.21.15.174:0/2173937273 >> v1:172.21.15.16:6789/0 conn(0x7f0418162f90 legacy=0x7f0418163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.001 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f04177fe640 1 -- 172.21.15.174:0/2173937273 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160877863 0 0) 0x7f041806dc50 con 0x7f041806d700 2024-05-11T01:00:54.001 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:53.999+0000 7f041d661640 1 -- 172.21.15.174:0/2173937273 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041806df30 con 0x7f0418072860 2024-05-11T01:00:54.002 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.000+0000 7f041d661640 1 --2- 172.21.15.174:0/2173937273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418072860 0x7f04181600a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0410009dc0 tx=0x7f041002a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a759699fa0e7df74 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.000+0000 7f04177fe640 1 -- 172.21.15.174:0/2173937273 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410007740 con 0x7f0418072860 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.000+0000 7f04177fe640 1 -- 172.21.15.174:0/2173937273 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04100078e0 con 0x7f0418072860 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.000+0000 7f04177fe640 1 -- 172.21.15.174:0/2173937273 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410007cb0 con 0x7f0418072860 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.001+0000 7f041f0c4640 1 -- 172.21.15.174:0/2173937273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418072860 msgr2=0x7f04181600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.001+0000 7f041f0c4640 1 --2- 172.21.15.174:0/2173937273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418072860 0x7f04181600a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0410009dc0 tx=0x7f041002a630 comp rx=0 tx=0).stop 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.001+0000 7f041f0c4640 1 -- 172.21.15.174:0/2173937273 shutdown_connections 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.001+0000 7f041f0c4640 1 --2- 172.21.15.174:0/2173937273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418072860 0x7f04181600a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.001+0000 7f041f0c4640 1 -- 172.21.15.174:0/2173937273 >> 172.21.15.174:0/2173937273 conn(0x7f04180b4e00 msgr2=0x7f04180b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.001+0000 7f041f0c4640 1 -- 172.21.15.174:0/2173937273 shutdown_connections 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.001+0000 7f041f0c4640 1 -- 172.21.15.174:0/2173937273 wait complete. 2024-05-11T01:00:54.003 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.002+0000 7f041f0c4640 1 Processor -- start 2024-05-11T01:00:54.004 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.002+0000 7f041f0c4640 1 -- start start 2024-05-11T01:00:54.007 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041f0c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f041806d700 0x7f0418162520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.009 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041f0c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0418072860 0x7f04180cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.009 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041f0c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418162f90 0x7f04180cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.009 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041f0c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f041806e7d0 con 0x7f0418072860 2024-05-11T01:00:54.009 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041f0c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f041806e4f0 con 0x7f0418162f90 2024-05-11T01:00:54.009 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041f0c4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0418072cd0 con 0x7f041806d700 2024-05-11T01:00:54.009 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041ce60640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f041806d700 0x7f0418162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.010 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041d661640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418162f90 0x7f04180cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.010 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041ce60640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f041806d700 0x7f0418162520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48814/0 (socket says 172.21.15.174:48814) 2024-05-11T01:00:54.010 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041d661640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418162f90 0x7f04180cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42078/0 (socket says 172.21.15.174:42078) 2024-05-11T01:00:54.010 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041ce60640 1 -- 172.21.15.174:0/2760157232 learned_addr learned my addr 172.21.15.174:0/2760157232 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.010 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f0417fff640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0418072860 0x7f04180cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.010 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041ce60640 1 -- 172.21.15.174:0/2760157232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418162f90 msgr2=0x7f04180cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.010 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041ce60640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418162f90 0x7f04180cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.010 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041ce60640 1 -- 172.21.15.174:0/2760157232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0418072860 msgr2=0x7f04180cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041ce60640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0418072860 0x7f04180cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041ce60640 1 -- 172.21.15.174:0/2760157232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04180cd430 con 0x7f041806d700 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.003+0000 7f041d661640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418162f90 0x7f04180cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.004+0000 7f041ce60640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f041806d700 0x7f0418162520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c730 tx=0x7f040c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.004+0000 7f04157fa640 1 -- 172.21.15.174:0/2760157232 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c017070 con 0x7f041806d700 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.004+0000 7f04157fa640 1 -- 172.21.15.174:0/2760157232 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c005290 con 0x7f041806d700 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.004+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04180cd710 con 0x7f041806d700 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.004+0000 7f04157fa640 1 -- 172.21.15.174:0/2760157232 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c00a880 con 0x7f041806d700 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.004+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04180cdcd0 con 0x7f041806d700 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.004+0000 7f04157fa640 1 -- 172.21.15.174:0/2760157232 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f040c01a070 con 0x7f041806d700 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.004+0000 7f04157fa640 1 -- 172.21.15.174:0/2760157232 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f040c01c440 con 0x7f041806d700 2024-05-11T01:00:54.011 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.005+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0418142c90 con 0x7f041806d700 2024-05-11T01:00:54.012 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.007+0000 7f04157fa640 1 -- 172.21.15.174:0/2760157232 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0418142c90 con 0x7f041806d700 2024-05-11T01:00:54.019 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:54.018+0000 7fb141fea040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-11T01:00:54.038 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:54.037+0000 7f27aedee040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-11T01:00:54.080 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.080+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e40b2639-d7e1-4bc8-9115-b276895b56f5", "id": 0} v 0) -- 0x7f041806a5b0 con 0x7f041806d700 2024-05-11T01:00:54.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.083+0000 7f04157fa640 1 -- 172.21.15.174:0/2760157232 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e40b2639-d7e1-4bc8-9115-b276895b56f5", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f040c021020 con 0x7f041806d700 2024-05-11T01:00:54.083 INFO:teuthology.orchestra.run.smithi174.stdout:0 2024-05-11T01:00:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f041806d700 msgr2=0x7f0418162520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f041806d700 0x7f0418162520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c730 tx=0x7f040c00cbf0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 shutdown_connections 2024-05-11T01:00:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0418162f90 0x7f04180cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0418072860 0x7f04180cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 --2- 172.21.15.174:0/2760157232 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f041806d700 0x7f0418162520 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 >> 172.21.15.174:0/2760157232 conn(0x7f04180b4e00 msgr2=0x7f0418145660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 shutdown_connections 2024-05-11T01:00:54.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.084+0000 7f041f0c4640 1 -- 172.21.15.174:0/2760157232 wait complete. 2024-05-11T01:00:54.095 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new bfd1b7f9-a497-4471-9f41-59f2fb72c5dd 1 2024-05-11T01:00:54.194 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.194+0000 7f8f88c9b640 1 Processor -- start 2024-05-11T01:00:54.195 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.194+0000 7f8f88c9b640 1 -- start start 2024-05-11T01:00:54.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f88c9b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f8415c3c0 0x7f8f840b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.197 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f88c9b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f840b6eb0 0x7f8f84071330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f88c9b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f840d1a50 con 0x7f8f840d12e0 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f88c9b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8f840708e0 con 0x7f8f8415c3c0 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f88c9b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8f84071870 con 0x7f8f840b6eb0 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f82d9d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f840b6eb0 0x7f8f84071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f8259c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8f8415c3c0 0x7f8f840b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f82d9d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f840b6eb0 0x7f8f84071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48824/0 (socket says 172.21.15.174:48824) 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f82d9d640 1 -- 172.21.15.174:0/2570353073 learned_addr learned my addr 172.21.15.174:0/2570353073 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f81d9b640 1 --1- 172.21.15.174:0/2570353073 >> v1:172.21.15.174:6789/0 conn(0x7f8f840d12e0 0x7f8f840b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:51746/0 (socket says 172.21.15.174:51746) 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f8259c640 1 -- 172.21.15.174:0/2570353073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f840b6eb0 msgr2=0x7f8f84071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f8259c640 1 --2- 172.21.15.174:0/2570353073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f840b6eb0 0x7f8f84071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f8259c640 1 -- 172.21.15.174:0/2570353073 >> v1:172.21.15.174:6789/0 conn(0x7f8f840d12e0 legacy=0x7f8f840b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.198 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f8159a640 1 -- 172.21.15.174:0/2570353073 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 332634222 0 0) 0x7f8f840d1a50 con 0x7f8f840d12e0 2024-05-11T01:00:54.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f8259c640 1 -- 172.21.15.174:0/2570353073 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f840d1d30 con 0x7f8f8415c3c0 2024-05-11T01:00:54.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.196+0000 7f8f82d9d640 1 --2- 172.21.15.174:0/2570353073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f840b6eb0 0x7f8f84071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:00:54.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.197+0000 7f8f8259c640 1 --2- 172.21.15.174:0/2570353073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f8415c3c0 0x7f8f840b5b80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f740097a0 tx=0x7f8f7402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8f78a04c331916e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.197+0000 7f8f8159a640 1 -- 172.21.15.174:0/2570353073 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74037070 con 0x7f8f8415c3c0 2024-05-11T01:00:54.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.197+0000 7f8f8159a640 1 -- 172.21.15.174:0/2570353073 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7402ae50 con 0x7f8f8415c3c0 2024-05-11T01:00:54.199 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.197+0000 7f8f8159a640 1 -- 172.21.15.174:0/2570353073 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f74032660 con 0x7f8f8415c3c0 2024-05-11T01:00:54.200 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.198+0000 7f8f88c9b640 1 -- 172.21.15.174:0/2570353073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f8415c3c0 msgr2=0x7f8f840b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.200 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.198+0000 7f8f88c9b640 1 --2- 172.21.15.174:0/2570353073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f8415c3c0 0x7f8f840b5b80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f740097a0 tx=0x7f8f7402a100 comp rx=0 tx=0).stop 2024-05-11T01:00:54.200 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.198+0000 7f8f88c9b640 1 -- 172.21.15.174:0/2570353073 shutdown_connections 2024-05-11T01:00:54.200 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.198+0000 7f8f88c9b640 1 --2- 172.21.15.174:0/2570353073 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f840b6eb0 0x7f8f84071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.198+0000 7f8f88c9b640 1 --2- 172.21.15.174:0/2570353073 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f8415c3c0 0x7f8f840b5b80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.198+0000 7f8f88c9b640 1 -- 172.21.15.174:0/2570353073 >> 172.21.15.174:0/2570353073 conn(0x7f8f840d20b0 msgr2=0x7f8f840d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.198+0000 7f8f88c9b640 1 -- 172.21.15.174:0/2570353073 shutdown_connections 2024-05-11T01:00:54.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.198+0000 7f8f88c9b640 1 -- 172.21.15.174:0/2570353073 wait complete. 2024-05-11T01:00:54.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.200+0000 7f8f88c9b640 1 Processor -- start 2024-05-11T01:00:54.201 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.200+0000 7f8f88c9b640 1 -- start start 2024-05-11T01:00:54.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f88c9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f840b6eb0 0x7f8f841f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f88c9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f840d12e0 0x7f8f8406f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f88c9b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8415c3c0 0x7f8f84154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f88c9b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8f84073470 con 0x7f8f840b6eb0 2024-05-11T01:00:54.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f88c9b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8f840d1720 con 0x7f8f840d12e0 2024-05-11T01:00:54.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f88c9b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8f840735f0 con 0x7f8f8415c3c0 2024-05-11T01:00:54.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f81d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f840d12e0 0x7f8f8406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.206 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f82d9d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8415c3c0 0x7f8f84154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f81d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f840d12e0 0x7f8f8406f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42104/0 (socket says 172.21.15.174:42104) 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f82d9d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8415c3c0 0x7f8f84154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48830/0 (socket says 172.21.15.174:48830) 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f81d9b640 1 -- 172.21.15.174:0/1170548087 learned_addr learned my addr 172.21.15.174:0/1170548087 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.201+0000 7f8f8259c640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f840b6eb0 0x7f8f841f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f81d9b640 1 -- 172.21.15.174:0/1170548087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8415c3c0 msgr2=0x7f8f84154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f81d9b640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8415c3c0 0x7f8f84154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f81d9b640 1 -- 172.21.15.174:0/1170548087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f840b6eb0 msgr2=0x7f8f841f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f81d9b640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f840b6eb0 0x7f8f841f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f81d9b640 1 -- 172.21.15.174:0/1170548087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f840c8650 con 0x7f8f840d12e0 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f82d9d640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8415c3c0 0x7f8f84154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f81d9b640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f840d12e0 0x7f8f8406f510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800d520 tx=0x7f8f7800d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f72ffd640 1 -- 172.21.15.174:0/1170548087 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78018070 con 0x7f8f840d12e0 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f72ffd640 1 -- 172.21.15.174:0/1170548087 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f78006e00 con 0x7f8f840d12e0 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f72ffd640 1 -- 172.21.15.174:0/1170548087 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780093b0 con 0x7f8f840d12e0 2024-05-11T01:00:54.207 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f840c8930 con 0x7f8f840d12e0 2024-05-11T01:00:54.208 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8415e080 con 0x7f8f840d12e0 2024-05-11T01:00:54.208 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f72ffd640 1 -- 172.21.15.174:0/1170548087 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f7801b070 con 0x7f8f840d12e0 2024-05-11T01:00:54.208 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.202+0000 7f8f72ffd640 1 -- 172.21.15.174:0/1170548087 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8f7801d440 con 0x7f8f840d12e0 2024-05-11T01:00:54.208 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.203+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8406a5b0 con 0x7f8f840d12e0 2024-05-11T01:00:54.208 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.207+0000 7f8f72ffd640 1 -- 172.21.15.174:0/1170548087 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8f78010070 con 0x7f8f840d12e0 2024-05-11T01:00:54.279 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.279+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bfd1b7f9-a497-4471-9f41-59f2fb72c5dd", "id": 1} v 0) -- 0x7f8f8415ff40 con 0x7f8f840d12e0 2024-05-11T01:00:54.282 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.282+0000 7f8f72ffd640 1 -- 172.21.15.174:0/1170548087 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfd1b7f9-a497-4471-9f41-59f2fb72c5dd", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8f78009640 con 0x7f8f840d12e0 2024-05-11T01:00:54.282 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-05-11T01:00:54.284 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.282+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f840d12e0 msgr2=0x7f8f8406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.284 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.282+0000 7f8f88c9b640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f840d12e0 0x7f8f8406f510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800d520 tx=0x7f8f7800d9e0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.284 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.282+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 shutdown_connections 2024-05-11T01:00:54.284 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.282+0000 7f8f88c9b640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8f8415c3c0 0x7f8f84154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.284 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.282+0000 7f8f88c9b640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8f840d12e0 0x7f8f8406f510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.284 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.282+0000 7f8f88c9b640 1 --2- 172.21.15.174:0/1170548087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f840b6eb0 0x7f8f841f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.284 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.282+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 >> 172.21.15.174:0/1170548087 conn(0x7f8f840d20b0 msgr2=0x7f8f840b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.284 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.283+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 shutdown_connections 2024-05-11T01:00:54.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.283+0000 7f8f88c9b640 1 -- 172.21.15.174:0/1170548087 wait complete. 2024-05-11T01:00:54.294 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new ae6f74d1-24a5-4d01-b129-506294a1f3f6 2 2024-05-11T01:00:54.394 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.393+0000 7f4520bdd640 1 Processor -- start 2024-05-11T01:00:54.394 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.393+0000 7f4520bdd640 1 -- start start 2024-05-11T01:00:54.395 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.394+0000 7f4520bdd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f451c159ae0 0x7f451c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.394+0000 7f4520bdd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f451c1605a0 0x7f451c0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.394+0000 7f4520bdd640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451c159ec0 con 0x7f451c15fa10 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f4520bdd640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f451c0b6e20 con 0x7f451c159ae0 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f4520bdd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f451c0b4dd0 con 0x7f451c1605a0 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f451ad9d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f451c1605a0 0x7f451c0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f4519d9b640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f451c15fa10 0x7f451c15fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:51760/0 (socket says 172.21.15.174:51760) 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f4519d9b640 1 -- 172.21.15.174:0/2847236658 learned_addr learned my addr 172.21.15.174:0/2847236658 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f451a59c640 1 --2- 172.21.15.174:0/2847236658 >> v2:172.21.15.16:3300/0 conn(0x7f451c159ae0 0x7f451c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f451ad9d640 1 -- 172.21.15.174:0/2847236658 >> v2:172.21.15.16:3300/0 conn(0x7f451c159ae0 msgr2=0x7f451c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f451ad9d640 1 --2- 172.21.15.174:0/2847236658 >> v2:172.21.15.16:3300/0 conn(0x7f451c159ae0 0x7f451c0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f451ad9d640 1 -- 172.21.15.174:0/2847236658 >> v1:172.21.15.174:6789/0 conn(0x7f451c15fa10 legacy=0x7f451c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f451ad9d640 1 -- 172.21.15.174:0/2847236658 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c0b08a0 con 0x7f451c1605a0 2024-05-11T01:00:54.396 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.395+0000 7f451959a640 1 -- 172.21.15.174:0/2847236658 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662558363 0 0) 0x7f451c159ec0 con 0x7f451c15fa10 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.396+0000 7f451ad9d640 1 --2- 172.21.15.174:0/2847236658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c1605a0 0x7f451c0b5260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f451c0b4710 tx=0x7f451402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddbed4c3400cfef5 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.396+0000 7f451959a640 1 -- 172.21.15.174:0/2847236658 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514007740 con 0x7f451c1605a0 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.396+0000 7f451959a640 1 -- 172.21.15.174:0/2847236658 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45140078e0 con 0x7f451c1605a0 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.396+0000 7f451959a640 1 -- 172.21.15.174:0/2847236658 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514007cb0 con 0x7f451c1605a0 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.396+0000 7f4520bdd640 1 -- 172.21.15.174:0/2847236658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c1605a0 msgr2=0x7f451c0b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.396+0000 7f4520bdd640 1 --2- 172.21.15.174:0/2847236658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c1605a0 0x7f451c0b5260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f451c0b4710 tx=0x7f451402a680 comp rx=0 tx=0).stop 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.397+0000 7f4520bdd640 1 -- 172.21.15.174:0/2847236658 shutdown_connections 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.397+0000 7f4520bdd640 1 --2- 172.21.15.174:0/2847236658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c1605a0 0x7f451c0b5260 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.397+0000 7f4520bdd640 1 --2- 172.21.15.174:0/2847236658 >> v2:172.21.15.16:3300/0 conn(0x7f451c159ae0 0x7f451c0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.398 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.397+0000 7f4520bdd640 1 -- 172.21.15.174:0/2847236658 >> 172.21.15.174:0/2847236658 conn(0x7f451c073bd0 msgr2=0x7f451c06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.399 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.397+0000 7f4520bdd640 1 -- 172.21.15.174:0/2847236658 shutdown_connections 2024-05-11T01:00:54.399 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.397+0000 7f4520bdd640 1 -- 172.21.15.174:0/2847236658 wait complete. 2024-05-11T01:00:54.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.398+0000 7f4520bdd640 1 Processor -- start 2024-05-11T01:00:54.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.398+0000 7f4520bdd640 1 -- start start 2024-05-11T01:00:54.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4520bdd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c159ae0 0x7f451c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4520bdd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f451c15fa10 0x7f451c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4520bdd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f451c1605a0 0x7f451c152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4520bdd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0b4a60 con 0x7f451c1605a0 2024-05-11T01:00:54.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4520bdd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0b0e60 con 0x7f451c159ae0 2024-05-11T01:00:54.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4520bdd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f451c0b57a0 con 0x7f451c15fa10 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f451a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c159ae0 0x7f451c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f451a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c159ae0 0x7f451c158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42120/0 (socket says 172.21.15.174:42120) 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4519d9b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f451c15fa10 0x7f451c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f451a59c640 1 -- 172.21.15.174:0/2290900479 learned_addr learned my addr 172.21.15.174:0/2290900479 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f451ad9d640 1 --2- 172.21.15.174:0/2290900479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f451c1605a0 0x7f451c152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4519d9b640 1 -- 172.21.15.174:0/2290900479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c159ae0 msgr2=0x7f451c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4519d9b640 1 --2- 172.21.15.174:0/2290900479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c159ae0 0x7f451c158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4519d9b640 1 -- 172.21.15.174:0/2290900479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f451c1605a0 msgr2=0x7f451c152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4519d9b640 1 --2- 172.21.15.174:0/2290900479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f451c1605a0 0x7f451c152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4519d9b640 1 -- 172.21.15.174:0/2290900479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c0ce090 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4519d9b640 1 --2- 172.21.15.174:0/2290900479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f451c15fa10 0x7f451c156af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f450400c400 tx=0x7f450400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4512ffd640 1 -- 172.21.15.174:0/2290900479 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45040074e0 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.399+0000 7f4512ffd640 1 -- 172.21.15.174:0/2290900479 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45040047e0 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.400+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c0ce370 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.400+0000 7f4512ffd640 1 -- 172.21.15.174:0/2290900479 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504004bf0 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.400+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c0ce930 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.400+0000 7f4512ffd640 1 -- 172.21.15.174:0/2290900479 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4504011070 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.400+0000 7f4512ffd640 1 -- 172.21.15.174:0/2290900479 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f45040137e0 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.400+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451c0cee20 con 0x7f451c15fa10 2024-05-11T01:00:54.403 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.402+0000 7f4512ffd640 1 -- 172.21.15.174:0/2290900479 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f45040133c0 con 0x7f451c15fa10 2024-05-11T01:00:54.476 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.476+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ae6f74d1-24a5-4d01-b129-506294a1f3f6", "id": 2} v 0) -- 0x7f451c068520 con 0x7f451c15fa10 2024-05-11T01:00:54.479 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.479+0000 7f4512ffd640 1 -- 172.21.15.174:0/2290900479 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae6f74d1-24a5-4d01-b129-506294a1f3f6", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f4504013a80 con 0x7f451c15fa10 2024-05-11T01:00:54.479 INFO:teuthology.orchestra.run.smithi174.stdout:2 2024-05-11T01:00:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.479+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f451c15fa10 msgr2=0x7f451c156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.479+0000 7f4520bdd640 1 --2- 172.21.15.174:0/2290900479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f451c15fa10 0x7f451c156af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f450400c400 tx=0x7f450400c8c0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.479+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 shutdown_connections 2024-05-11T01:00:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.479+0000 7f4520bdd640 1 --2- 172.21.15.174:0/2290900479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f451c1605a0 0x7f451c152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.479+0000 7f4520bdd640 1 --2- 172.21.15.174:0/2290900479 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f451c15fa10 0x7f451c156af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.479+0000 7f4520bdd640 1 --2- 172.21.15.174:0/2290900479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f451c159ae0 0x7f451c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.480 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.479+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 >> 172.21.15.174:0/2290900479 conn(0x7f451c073bd0 msgr2=0x7f451c162500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.481 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.480+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 shutdown_connections 2024-05-11T01:00:54.481 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.480+0000 7f4520bdd640 1 -- 172.21.15.174:0/2290900479 wait complete. 2024-05-11T01:00:54.490 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new f59e2557-65f7-4200-824f-cf1ed0ff82e7 3 2024-05-11T01:00:54.590 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.590+0000 7f79cfcd1640 1 Processor -- start 2024-05-11T01:00:54.590 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.590+0000 7f79cfcd1640 1 -- start start 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cfcd1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c8161750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cfcd1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79c8142250 0x7f79c81426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cfcd1640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c8161d70 con 0x7f79c80cfdd0 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cfcd1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f79c8140620 con 0x7f79c8142250 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cfcd1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f79c815e760 con 0x7f79c80d01b0 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cd26c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c8161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cd26c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c8161750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48840/0 (socket says 172.21.15.174:48840) 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cd26c640 1 -- 172.21.15.174:0/3931793552 learned_addr learned my addr 172.21.15.174:0/3931793552 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79ce26e640 1 --2- 172.21.15.174:0/3931793552 >> v2:172.21.15.16:3300/0 conn(0x7f79c8142250 0x7f79c81426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cd26c640 1 -- 172.21.15.174:0/3931793552 >> v2:172.21.15.16:3300/0 conn(0x7f79c8142250 msgr2=0x7f79c81426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cd26c640 1 --2- 172.21.15.174:0/3931793552 >> v2:172.21.15.16:3300/0 conn(0x7f79c8142250 0x7f79c81426c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.592 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cd26c640 1 -- 172.21.15.174:0/3931793552 >> v1:172.21.15.16:6789/0 conn(0x7f79c80cfdd0 legacy=0x7f79c8161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.593 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.591+0000 7f79cd26c640 1 -- 172.21.15.174:0/3931793552 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c815d9a0 con 0x7f79c80d01b0 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.592+0000 7f79cd26c640 1 --2- 172.21.15.174:0/3931793552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c8161750 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009870 tx=0x7f79b802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=267c613b45b5f6d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.592+0000 7f79cca6b640 1 -- 172.21.15.174:0/3931793552 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8037070 con 0x7f79c80d01b0 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.592+0000 7f79cca6b640 1 -- 172.21.15.174:0/3931793552 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b8032440 con 0x7f79c80d01b0 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.592+0000 7f79cca6b640 1 -- 172.21.15.174:0/3931793552 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8032810 con 0x7f79c80d01b0 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.593+0000 7f79cfcd1640 1 -- 172.21.15.174:0/3931793552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 msgr2=0x7f79c8161750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.593+0000 7f79cfcd1640 1 --2- 172.21.15.174:0/3931793552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c8161750 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009870 tx=0x7f79b802a270 comp rx=0 tx=0).stop 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.593+0000 7f79cfcd1640 1 -- 172.21.15.174:0/3931793552 shutdown_connections 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.593+0000 7f79cfcd1640 1 --2- 172.21.15.174:0/3931793552 >> v2:172.21.15.16:3300/0 conn(0x7f79c8142250 0x7f79c81426c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.594 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.593+0000 7f79cfcd1640 1 --2- 172.21.15.174:0/3931793552 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c8161750 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.595 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.593+0000 7f79cfcd1640 1 -- 172.21.15.174:0/3931793552 >> 172.21.15.174:0/3931793552 conn(0x7f79c80b4e00 msgr2=0x7f79c80b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.595 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.593+0000 7f79cfcd1640 1 -- 172.21.15.174:0/3931793552 shutdown_connections 2024-05-11T01:00:54.595 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.593+0000 7f79cfcd1640 1 -- 172.21.15.174:0/3931793552 wait complete. 2024-05-11T01:00:54.597 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.594+0000 7f79cfcd1640 1 Processor -- start 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.594+0000 7f79cfcd1640 1 -- start start 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cfcd1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79c80cfdd0 0x7f79c806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cfcd1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c80b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cfcd1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8142250 0x7f79c8153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cfcd1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79c815e240 con 0x7f79c80cfdd0 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cfcd1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79c815df60 con 0x7f79c8142250 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cfcd1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f79c81418e0 con 0x7f79c80d01b0 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cd26c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c80b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79ce26e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8142250 0x7f79c8153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cd26c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c80b7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48846/0 (socket says 172.21.15.174:48846) 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cd26c640 1 -- 172.21.15.174:0/2902658272 learned_addr learned my addr 172.21.15.174:0/2902658272 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.598 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79ce26e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8142250 0x7f79c8153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42124/0 (socket says 172.21.15.174:42124) 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cda6d640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79c80cfdd0 0x7f79c806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cd26c640 1 -- 172.21.15.174:0/2902658272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8142250 msgr2=0x7f79c8153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cd26c640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8142250 0x7f79c8153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cd26c640 1 -- 172.21.15.174:0/2902658272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79c80cfdd0 msgr2=0x7f79c806d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cd26c640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79c80cfdd0 0x7f79c806d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79cd26c640 1 -- 172.21.15.174:0/2902658272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c81f8990 con 0x7f79c80d01b0 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.595+0000 7f79ce26e640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8142250 0x7f79c8153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.596+0000 7f79cd26c640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c80b7240 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f79b802a2b0 tx=0x7f79b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.596+0000 7f79be7fc640 1 -- 172.21.15.174:0/2902658272 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8037040 con 0x7f79c80d01b0 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.596+0000 7f79be7fc640 1 -- 172.21.15.174:0/2902658272 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b8042070 con 0x7f79c80d01b0 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.596+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c81f8c70 con 0x7f79c80d01b0 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.596+0000 7f79be7fc640 1 -- 172.21.15.174:0/2902658272 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8030880 con 0x7f79c80d01b0 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.596+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c81f9230 con 0x7f79c80d01b0 2024-05-11T01:00:54.599 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.596+0000 7f79be7fc640 1 -- 172.21.15.174:0/2902658272 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f79b8030a20 con 0x7f79c80d01b0 2024-05-11T01:00:54.600 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.596+0000 7f79be7fc640 1 -- 172.21.15.174:0/2902658272 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f79b8047c10 con 0x7f79c80d01b0 2024-05-11T01:00:54.600 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.597+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c806a5b0 con 0x7f79c80d01b0 2024-05-11T01:00:54.600 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.599+0000 7f79be7fc640 1 -- 172.21.15.174:0/2902658272 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f79b8047460 con 0x7f79c80d01b0 2024-05-11T01:00:54.672 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.672+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f59e2557-65f7-4200-824f-cf1ed0ff82e7", "id": 3} v 0) -- 0x7f79c80b5b70 con 0x7f79c80d01b0 2024-05-11T01:00:54.675 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.675+0000 7f79be7fc640 1 -- 172.21.15.174:0/2902658272 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f59e2557-65f7-4200-824f-cf1ed0ff82e7", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f79b8047e10 con 0x7f79c80d01b0 2024-05-11T01:00:54.675 INFO:teuthology.orchestra.run.smithi174.stdout:3 2024-05-11T01:00:54.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 msgr2=0x7f79c80b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c80b7240 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f79b802a2b0 tx=0x7f79b80046c0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 shutdown_connections 2024-05-11T01:00:54.676 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79c8142250 0x7f79c8153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79c80d01b0 0x7f79c80b7240 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 --2- 172.21.15.174:0/2902658272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79c80cfdd0 0x7f79c806d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 >> 172.21.15.174:0/2902658272 conn(0x7f79c80b4e00 msgr2=0x7f79c8071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 shutdown_connections 2024-05-11T01:00:54.677 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.676+0000 7f79cfcd1640 1 -- 172.21.15.174:0/2902658272 wait complete. 2024-05-11T01:00:54.686 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 46528224-8949-4fc0-a3c0-9565a7c9c0ed 4 2024-05-11T01:00:54.786 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.786+0000 7fb25cd1c640 1 Processor -- start 2024-05-11T01:00:54.786 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.786+0000 7fb25cd1c640 1 -- start start 2024-05-11T01:00:54.789 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.786+0000 7fb25cd1c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb258162f90 0x7fb258072860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.789 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.786+0000 7fb25cd1c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb25806d700 0x7fb258163370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.789 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25cd1c640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25806ecf0 con 0x7fb2580b6100 2024-05-11T01:00:54.789 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25cd1c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb2581490a0 con 0x7fb25806d700 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25cd1c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fb258072da0 con 0x7fb258162f90 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25659c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb258162f90 0x7fb258072860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25659c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb258162f90 0x7fb258072860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42132/0 (socket says 172.21.15.174:42132) 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25659c640 1 -- 172.21.15.174:0/3470449683 learned_addr learned my addr 172.21.15.174:0/3470449683 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb24ffff640 1 --2- 172.21.15.174:0/3470449683 >> v2:172.21.15.16:3300/0 conn(0x7fb25806d700 0x7fb258163370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25659c640 1 -- 172.21.15.174:0/3470449683 >> v2:172.21.15.16:3300/0 conn(0x7fb25806d700 msgr2=0x7fb258163370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25659c640 1 --2- 172.21.15.174:0/3470449683 >> v2:172.21.15.16:3300/0 conn(0x7fb25806d700 0x7fb258163370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25659c640 1 -- 172.21.15.174:0/3470449683 >> v1:172.21.15.16:6789/0 conn(0x7fb2580b6100 legacy=0x7fb2580b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.787+0000 7fb25659c640 1 -- 172.21.15.174:0/3470449683 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2581638b0 con 0x7fb258162f90 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb25659c640 1 --2- 172.21.15.174:0/3470449683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 0x7fb258072860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb248009870 tx=0x7fb24802a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3ce90d32dfb549 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb255d9b640 1 -- 172.21.15.174:0/3470449683 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248037070 con 0x7fb258162f90 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb255d9b640 1 -- 172.21.15.174:0/3470449683 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb248032440 con 0x7fb258162f90 2024-05-11T01:00:54.790 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb255d9b640 1 -- 172.21.15.174:0/3470449683 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248032810 con 0x7fb258162f90 2024-05-11T01:00:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3470449683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 msgr2=0x7fb258072860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb25cd1c640 1 --2- 172.21.15.174:0/3470449683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 0x7fb258072860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb248009870 tx=0x7fb24802a2a0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3470449683 shutdown_connections 2024-05-11T01:00:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb25cd1c640 1 --2- 172.21.15.174:0/3470449683 >> v2:172.21.15.16:3300/0 conn(0x7fb25806d700 0x7fb258163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb25cd1c640 1 --2- 172.21.15.174:0/3470449683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 0x7fb258072860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.788+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3470449683 >> 172.21.15.174:0/3470449683 conn(0x7fb2580b4e00 msgr2=0x7fb2580b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.789+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3470449683 shutdown_connections 2024-05-11T01:00:54.791 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.789+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3470449683 wait complete. 2024-05-11T01:00:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.790+0000 7fb25cd1c640 1 Processor -- start 2024-05-11T01:00:54.793 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.790+0000 7fb25cd1c640 1 -- start start 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25cd1c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb25806d700 0x7fb25815a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25cd1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2580b6100 0x7fb2581f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25cd1c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 0x7fb258143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25cd1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb25806e210 con 0x7fb2580b6100 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25cd1c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb25806df30 con 0x7fb258162f90 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25cd1c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb25806e4f0 con 0x7fb25806d700 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25659c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb25806d700 0x7fb25815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb256d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 0x7fb258143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25659c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb25806d700 0x7fb25815a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48848/0 (socket says 172.21.15.174:48848) 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25659c640 1 -- 172.21.15.174:0/3855121367 learned_addr learned my addr 172.21.15.174:0/3855121367 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb24ffff640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2580b6100 0x7fb2581f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb256d9d640 1 -- 172.21.15.174:0/3855121367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb25806d700 msgr2=0x7fb25815a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb256d9d640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb25806d700 0x7fb25815a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.794 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb256d9d640 1 -- 172.21.15.174:0/3855121367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2580b6100 msgr2=0x7fb2581f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb256d9d640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2580b6100 0x7fb2581f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb256d9d640 1 -- 172.21.15.174:0/3855121367 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2581f7870 con 0x7fb258162f90 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25659c640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb25806d700 0x7fb25815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb256d9d640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 0x7fb258143510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c760 tx=0x7fb25000cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb24effd640 1 -- 172.21.15.174:0/3855121367 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250003b70 con 0x7fb258162f90 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb24effd640 1 -- 172.21.15.174:0/3855121367 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb250003d10 con 0x7fb258162f90 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb24effd640 1 -- 172.21.15.174:0/3855121367 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25000aa10 con 0x7fb258162f90 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.791+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2581f7b50 con 0x7fb258162f90 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.792+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2581f8110 con 0x7fb258162f90 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.792+0000 7fb24effd640 1 -- 172.21.15.174:0/3855121367 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb25000abb0 con 0x7fb258162f90 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.792+0000 7fb24effd640 1 -- 172.21.15.174:0/3855121367 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb250012470 con 0x7fb258162f90 2024-05-11T01:00:54.795 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.792+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25806a5b0 con 0x7fb258162f90 2024-05-11T01:00:54.796 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.795+0000 7fb24effd640 1 -- 172.21.15.174:0/3855121367 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb2500050d0 con 0x7fb258162f90 2024-05-11T01:00:54.806 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:54.807+0000 7f27aedee040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-11T01:00:54.845 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:54.844+0000 7fb141fea040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-11T01:00:54.867 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.867+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46528224-8949-4fc0-a3c0-9565a7c9c0ed", "id": 4} v 0) -- 0x7fb2580b5b70 con 0x7fb258162f90 2024-05-11T01:00:54.870 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.870+0000 7fb24effd640 1 -- 172.21.15.174:0/3855121367 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46528224-8949-4fc0-a3c0-9565a7c9c0ed", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb2500052b0 con 0x7fb258162f90 2024-05-11T01:00:54.870 INFO:teuthology.orchestra.run.smithi174.stdout:4 2024-05-11T01:00:54.871 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 msgr2=0x7fb258143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.871 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 0x7fb258143510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c760 tx=0x7fb25000cc20 comp rx=0 tx=0).stop 2024-05-11T01:00:54.872 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 shutdown_connections 2024-05-11T01:00:54.872 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb258162f90 0x7fb258143510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.872 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2580b6100 0x7fb2581f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.872 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 --2- 172.21.15.174:0/3855121367 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb25806d700 0x7fb25815a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.872 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 >> 172.21.15.174:0/3855121367 conn(0x7fb2580b4e00 msgr2=0x7fb258071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.872 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 shutdown_connections 2024-05-11T01:00:54.872 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.871+0000 7fb25cd1c640 1 -- 172.21.15.174:0/3855121367 wait complete. 2024-05-11T01:00:54.884 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 3d198061-6fd7-4758-a603-dd75b3a24413 5 2024-05-11T01:00:54.898 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:54.898+0000 7f27aedee040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-11T01:00:54.938 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:54.937+0000 7fb141fea040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-11T01:00:54.942 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:54.942+0000 7f27aedee040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-11T01:00:54.983 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:54.982+0000 7fb141fea040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-11T01:00:54.984 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.983+0000 7fefd5e3f640 1 Processor -- start 2024-05-11T01:00:54.984 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.983+0000 7fefd5e3f640 1 -- start start 2024-05-11T01:00:54.985 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.984+0000 7fefd5e3f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fefd00b02c0 0x7fefd0160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.985 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.984+0000 7fefd5e3f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fefd0160660 0x7fefd00b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.985 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.984+0000 7fefd5e3f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd0159ec0 con 0x7fefd0159ae0 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.984+0000 7fefd5e3f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fefd00b6e20 con 0x7fefd0160660 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.984+0000 7fefd5e3f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fefd00b4dd0 con 0x7fefd00b02c0 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.984+0000 7fefc7fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fefd00b02c0 0x7fefd0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.985+0000 7fefcf7fe640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fefd0159ae0 0x7fefd015fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:51764/0 (socket says 172.21.15.174:51764) 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.985+0000 7fefcf7fe640 1 -- 172.21.15.174:0/1191895 learned_addr learned my addr 172.21.15.174:0/1191895 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.985+0000 7fefcffff640 1 --2- 172.21.15.174:0/1191895 >> v2:172.21.15.16:3300/0 conn(0x7fefd0160660 0x7fefd00b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.985+0000 7fefc7fff640 1 -- 172.21.15.174:0/1191895 >> v2:172.21.15.16:3300/0 conn(0x7fefd0160660 msgr2=0x7fefd00b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.985+0000 7fefc7fff640 1 --2- 172.21.15.174:0/1191895 >> v2:172.21.15.16:3300/0 conn(0x7fefd0160660 0x7fefd00b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.985+0000 7fefc7fff640 1 -- 172.21.15.174:0/1191895 >> v1:172.21.15.174:6789/0 conn(0x7fefd0159ae0 legacy=0x7fefd015fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.985+0000 7fefc7fff640 1 -- 172.21.15.174:0/1191895 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd00b08a0 con 0x7fefd00b02c0 2024-05-11T01:00:54.986 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.985+0000 7fefceffd640 1 -- 172.21.15.174:0/1191895 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020250174 0 0) 0x7fefd0159ec0 con 0x7fefd0159ae0 2024-05-11T01:00:54.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefc7fff640 1 --2- 172.21.15.174:0/1191895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd00b02c0 0x7fefd0160120 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fefd00b7c40 tx=0x7fefb802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ece74dd757b58bef server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.987 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefceffd640 1 -- 172.21.15.174:0/1191895 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8037070 con 0x7fefd00b02c0 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefceffd640 1 -- 172.21.15.174:0/1191895 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb8032440 con 0x7fefd00b02c0 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefceffd640 1 -- 172.21.15.174:0/1191895 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8032810 con 0x7fefd00b02c0 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefd5e3f640 1 -- 172.21.15.174:0/1191895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd00b02c0 msgr2=0x7fefd0160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefd5e3f640 1 --2- 172.21.15.174:0/1191895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd00b02c0 0x7fefd0160120 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fefd00b7c40 tx=0x7fefb802a1a0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefd5e3f640 1 -- 172.21.15.174:0/1191895 shutdown_connections 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefd5e3f640 1 --2- 172.21.15.174:0/1191895 >> v2:172.21.15.16:3300/0 conn(0x7fefd0160660 0x7fefd00b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefd5e3f640 1 --2- 172.21.15.174:0/1191895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd00b02c0 0x7fefd0160120 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.986+0000 7fefd5e3f640 1 -- 172.21.15.174:0/1191895 >> 172.21.15.174:0/1191895 conn(0x7fefd0073bd0 msgr2=0x7fefd006c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.987+0000 7fefd5e3f640 1 -- 172.21.15.174:0/1191895 shutdown_connections 2024-05-11T01:00:54.988 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.987+0000 7fefd5e3f640 1 -- 172.21.15.174:0/1191895 wait complete. 2024-05-11T01:00:54.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.988+0000 7fefd5e3f640 1 Processor -- start 2024-05-11T01:00:54.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.988+0000 7fefd5e3f640 1 -- start start 2024-05-11T01:00:54.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.988+0000 7fefd5e3f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00b02c0 0x7fefd00cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefd5e3f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd0159ae0 0x7fefd01f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefd5e3f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefd0160660 0x7fefd01f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:54.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefd5e3f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fefd00b4a60 con 0x7fefd00b02c0 2024-05-11T01:00:54.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefd5e3f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fefd00b0e60 con 0x7fefd0159ae0 2024-05-11T01:00:54.991 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefd5e3f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fefd00b57a0 con 0x7fefd0160660 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefd0160660 0x7fefd01f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefc7fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd0159ae0 0x7fefd01f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefd0160660 0x7fefd01f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48852/0 (socket says 172.21.15.174:48852) 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 -- 172.21.15.174:0/3421269157 learned_addr learned my addr 172.21.15.174:0/3421269157 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcf7fe640 1 --2- 172.21.15.174:0/3421269157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00b02c0 0x7fefd00cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 -- 172.21.15.174:0/3421269157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd0159ae0 msgr2=0x7fefd01f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 --2- 172.21.15.174:0/3421269157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd0159ae0 0x7fefd01f5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 -- 172.21.15.174:0/3421269157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00b02c0 msgr2=0x7fefd00cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 --2- 172.21.15.174:0/3421269157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00b02c0 0x7fefd00cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:54.992 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 -- 172.21.15.174:0/3421269157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd00cf6b0 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefcffff640 1 --2- 172.21.15.174:0/3421269157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefd0160660 0x7fefd01f5ac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fefc800efc0 tx=0x7fefc800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefccff9640 1 -- 172.21.15.174:0/3421269157 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8018020 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefccff9640 1 -- 172.21.15.174:0/3421269157 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc8014480 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd00cf990 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefccff9640 1 -- 172.21.15.174:0/3421269157 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8009e60 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.989+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd00d0230 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.990+0000 7fefccff9640 1 -- 172.21.15.174:0/3421269157 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fefc8005d10 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.990+0000 7fefccff9640 1 -- 172.21.15.174:0/3421269157 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fefc801ddb0 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.990+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd006a5b0 con 0x7fefd0160660 2024-05-11T01:00:54.993 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:54.992+0000 7fefccff9640 1 -- 172.21.15.174:0/3421269157 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fefc8022030 con 0x7fefd0160660 2024-05-11T01:00:55.065 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.065+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3d198061-6fd7-4758-a603-dd75b3a24413", "id": 5} v 0) -- 0x7fefd0068520 con 0x7fefd0160660 2024-05-11T01:00:55.068 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.067+0000 7fefccff9640 1 -- 172.21.15.174:0/3421269157 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d198061-6fd7-4758-a603-dd75b3a24413", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fefc8010040 con 0x7fefd0160660 2024-05-11T01:00:55.068 INFO:teuthology.orchestra.run.smithi174.stdout:5 2024-05-11T01:00:55.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.068+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefd0160660 msgr2=0x7fefd01f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.068+0000 7fefd5e3f640 1 --2- 172.21.15.174:0/3421269157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefd0160660 0x7fefd01f5ac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fefc800efc0 tx=0x7fefc800c490 comp rx=0 tx=0).stop 2024-05-11T01:00:55.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.068+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 shutdown_connections 2024-05-11T01:00:55.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.068+0000 7fefd5e3f640 1 --2- 172.21.15.174:0/3421269157 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefd0160660 0x7fefd01f5ac0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.068+0000 7fefd5e3f640 1 --2- 172.21.15.174:0/3421269157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefd0159ae0 0x7fefd01f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.068+0000 7fefd5e3f640 1 --2- 172.21.15.174:0/3421269157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00b02c0 0x7fefd00cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.069 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.068+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 >> 172.21.15.174:0/3421269157 conn(0x7fefd0073bd0 msgr2=0x7fefd015fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:55.070 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.069+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 shutdown_connections 2024-05-11T01:00:55.070 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.069+0000 7fefd5e3f640 1 -- 172.21.15.174:0/3421269157 wait complete. 2024-05-11T01:00:55.080 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33 6 2024-05-11T01:00:55.125 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:55.125+0000 7f27aedee040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-11T01:00:55.160 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:55.160+0000 7fb141fea040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-11T01:00:55.174 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:55.174+0000 7f27aedee040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-11T01:00:55.180 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.180+0000 7fc13ae2a640 1 Processor -- start 2024-05-11T01:00:55.180 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.180+0000 7fc13ae2a640 1 -- start start 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc13ae2a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340cfdd0 0x7fc134161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc13ae2a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc1340d01b0 0x7fc134161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc13ae2a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc134161d70 con 0x7fc1341408d0 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc13ae2a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc134140620 con 0x7fc1340d01b0 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc13ae2a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc134161ac0 con 0x7fc1340cfdd0 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc138bc6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340cfdd0 0x7fc134161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc138bc6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340cfdd0 0x7fc134161040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48860/0 (socket says 172.21.15.174:48860) 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc138bc6640 1 -- 172.21.15.174:0/1953681655 learned_addr learned my addr 172.21.15.174:0/1953681655 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc133fff640 1 --2- 172.21.15.174:0/1953681655 >> v2:172.21.15.16:3300/0 conn(0x7fc1340d01b0 0x7fc134161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.182 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc138bc6640 1 -- 172.21.15.174:0/1953681655 >> v2:172.21.15.16:3300/0 conn(0x7fc1340d01b0 msgr2=0x7fc134161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:55.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc138bc6640 1 --2- 172.21.15.174:0/1953681655 >> v2:172.21.15.16:3300/0 conn(0x7fc1340d01b0 0x7fc134161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc138bc6640 1 -- 172.21.15.174:0/1953681655 >> v1:172.21.15.16:6789/0 conn(0x7fc1341408d0 legacy=0x7fc134140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.183 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.181+0000 7fc138bc6640 1 -- 172.21.15.174:0/1953681655 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13415e760 con 0x7fc1340cfdd0 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.182+0000 7fc138bc6640 1 --2- 172.21.15.174:0/1953681655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340cfdd0 0x7fc134161040 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc128009870 tx=0x7fc12802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=205738c97b45e992 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.182+0000 7fc1337fe640 1 -- 172.21.15.174:0/1953681655 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128037070 con 0x7fc1340cfdd0 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.182+0000 7fc1337fe640 1 -- 172.21.15.174:0/1953681655 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc128032440 con 0x7fc1340cfdd0 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.182+0000 7fc1337fe640 1 -- 172.21.15.174:0/1953681655 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128032810 con 0x7fc1340cfdd0 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.183+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1953681655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340cfdd0 msgr2=0x7fc134161040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.183+0000 7fc13ae2a640 1 --2- 172.21.15.174:0/1953681655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340cfdd0 0x7fc134161040 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc128009870 tx=0x7fc12802a270 comp rx=0 tx=0).stop 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.183+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1953681655 shutdown_connections 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.183+0000 7fc13ae2a640 1 --2- 172.21.15.174:0/1953681655 >> v2:172.21.15.16:3300/0 conn(0x7fc1340d01b0 0x7fc134161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.183+0000 7fc13ae2a640 1 --2- 172.21.15.174:0/1953681655 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340cfdd0 0x7fc134161040 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.184 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.183+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1953681655 >> 172.21.15.174:0/1953681655 conn(0x7fc1340b4e00 msgr2=0x7fc1340b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:55.185 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.183+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1953681655 shutdown_connections 2024-05-11T01:00:55.185 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.183+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1953681655 wait complete. 2024-05-11T01:00:55.187 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.184+0000 7fc13ae2a640 1 Processor -- start 2024-05-11T01:00:55.187 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.184+0000 7fc13ae2a640 1 -- start start 2024-05-11T01:00:55.187 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc13ae2a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1340cfdd0 0x7fc1340d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.187 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc13ae2a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340d01b0 0x7fc1340ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc13ae2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1341408d0 0x7fc1340cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc13ae2a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc13415df60 con 0x7fc1341408d0 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc13ae2a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc13415dc80 con 0x7fc1340cfdd0 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc13ae2a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc13415e240 con 0x7fc1340d01b0 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc138bc6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1340cfdd0 0x7fc1340d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc138bc6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1340cfdd0 0x7fc1340d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42174/0 (socket says 172.21.15.174:42174) 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc138bc6640 1 -- 172.21.15.174:0/1368366760 learned_addr learned my addr 172.21.15.174:0/1368366760 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc133fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340d01b0 0x7fc1340ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc1393c7640 1 --2- 172.21.15.174:0/1368366760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1341408d0 0x7fc1340cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc138bc6640 1 -- 172.21.15.174:0/1368366760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340d01b0 msgr2=0x7fc1340ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc138bc6640 1 --2- 172.21.15.174:0/1368366760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340d01b0 0x7fc1340ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc138bc6640 1 -- 172.21.15.174:0/1368366760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1341408d0 msgr2=0x7fc1340cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc138bc6640 1 --2- 172.21.15.174:0/1368366760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1341408d0 0x7fc1340cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.188 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.185+0000 7fc138bc6640 1 -- 172.21.15.174:0/1368366760 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1341f6b60 con 0x7fc1340cfdd0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.186+0000 7fc138bc6640 1 --2- 172.21.15.174:0/1368366760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1340cfdd0 0x7fc1340d2f00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc128000c00 tx=0x7fc1280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.186+0000 7fc1317fa640 1 -- 172.21.15.174:0/1368366760 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128037040 con 0x7fc1340cfdd0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.186+0000 7fc1317fa640 1 -- 172.21.15.174:0/1368366760 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc128042070 con 0x7fc1340cfdd0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.186+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13406d590 con 0x7fc1340cfdd0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.186+0000 7fc1317fa640 1 -- 172.21.15.174:0/1368366760 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128030880 con 0x7fc1340cfdd0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.186+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13406db50 con 0x7fc1340cfdd0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.186+0000 7fc1317fa640 1 -- 172.21.15.174:0/1368366760 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc128030a20 con 0x7fc1340cfdd0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.186+0000 7fc1317fa640 1 -- 172.21.15.174:0/1368366760 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc128047c10 con 0x7fc1340cfdd0 2024-05-11T01:00:55.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.187+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13406a5b0 con 0x7fc1340cfdd0 2024-05-11T01:00:55.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.189+0000 7fc1317fa640 1 -- 172.21.15.174:0/1368366760 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc128047460 con 0x7fc1340cfdd0 2024-05-11T01:00:55.211 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:55.211+0000 7fb141fea040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-11T01:00:55.229 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:55.229+0000 7f27aedee040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-11T01:00:55.262 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.262+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33", "id": 6} v 0) -- 0x7fc134141ea0 con 0x7fc1340cfdd0 2024-05-11T01:00:55.265 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.264+0000 7fc1317fa640 1 -- 172.21.15.174:0/1368366760 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc128047640 con 0x7fc1340cfdd0 2024-05-11T01:00:55.265 INFO:teuthology.orchestra.run.smithi174.stdout:6 2024-05-11T01:00:55.266 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.265+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1340cfdd0 msgr2=0x7fc1340d2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.266 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.265+0000 7fc13ae2a640 1 --2- 172.21.15.174:0/1368366760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1340cfdd0 0x7fc1340d2f00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc128000c00 tx=0x7fc1280046c0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.266 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.265+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 shutdown_connections 2024-05-11T01:00:55.266 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.265+0000 7fc13ae2a640 1 --2- 172.21.15.174:0/1368366760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1341408d0 0x7fc1340cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.266 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.265+0000 7fc13ae2a640 1 --2- 172.21.15.174:0/1368366760 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc1340d01b0 0x7fc1340ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.267 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.265+0000 7fc13ae2a640 1 --2- 172.21.15.174:0/1368366760 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1340cfdd0 0x7fc1340d2f00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.267 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.265+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 >> 172.21.15.174:0/1368366760 conn(0x7fc1340b4e00 msgr2=0x7fc1341421c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:55.267 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.266+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 shutdown_connections 2024-05-11T01:00:55.267 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.266+0000 7fc13ae2a640 1 -- 172.21.15.174:0/1368366760 wait complete. 2024-05-11T01:00:55.267 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:55.266+0000 7fb141fea040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-11T01:00:55.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo ceph --cluster ceph osd new 4bcf96b7-7cb6-4962-bffc-1705430867a8 7 2024-05-11T01:00:55.347 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:55.347+0000 7f27aedee040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:00:55.376 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.376+0000 7f10223b6640 1 Processor -- start 2024-05-11T01:00:55.377 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.376+0000 7f10223b6640 1 -- start start 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f10223b6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c15f560 0x7f101c06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f10223b6640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101c15f940 con 0x7f101c0b1140 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f10223b6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101c163f90 con 0x7f101c0b1790 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f10223b6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f101c0b5f50 con 0x7f101c15f560 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f1020953640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f101c0b1790 0x7f101c070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.174:51770/0 (socket says 172.21.15.174:51770) 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f1020953640 1 -- 172.21.15.174:0/2212281876 learned_addr learned my addr 172.21.15.174:0/2212281876 (peer_addr_for_me v1:172.21.15.174:0/0) 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f101bfff640 1 --2- 172.21.15.174:0/2212281876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c15f560 0x7f101c06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f101b7fe640 1 -- 172.21.15.174:0/2212281876 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843670398 0 0) 0x7f101c163f90 con 0x7f101c0b1790 2024-05-11T01:00:55.378 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f101b7fe640 1 -- 172.21.15.174:0/2212281876 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1008003520 con 0x7f101c0b1790 2024-05-11T01:00:55.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f101bfff640 1 -- 172.21.15.174:0/2212281876 >> v1:172.21.15.174:6789/0 conn(0x7f101c0b1790 legacy=0x7f101c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f101bfff640 1 -- 172.21.15.174:0/2212281876 >> v1:172.21.15.16:6789/0 conn(0x7f101c0b1140 legacy=0x7f101c0708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.379 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.377+0000 7f101bfff640 1 -- 172.21.15.174:0/2212281876 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c071700 con 0x7f101c15f560 2024-05-11T01:00:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.378+0000 7f101bfff640 1 --2- 172.21.15.174:0/2212281876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c15f560 0x7f101c06c3e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f100c0097d0 tx=0x7f100c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6cd64b69210052 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.378+0000 7f101b7fe640 1 -- 172.21.15.174:0/2212281876 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c037070 con 0x7f101c15f560 2024-05-11T01:00:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.378+0000 7f101b7fe640 1 -- 172.21.15.174:0/2212281876 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f100c032440 con 0x7f101c15f560 2024-05-11T01:00:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.378+0000 7f101b7fe640 1 -- 172.21.15.174:0/2212281876 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c032810 con 0x7f101c15f560 2024-05-11T01:00:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.379+0000 7f10223b6640 1 -- 172.21.15.174:0/2212281876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c15f560 msgr2=0x7f101c06c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.380 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.379+0000 7f10223b6640 1 --2- 172.21.15.174:0/2212281876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c15f560 0x7f101c06c3e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f100c0097d0 tx=0x7f100c02a180 comp rx=0 tx=0).stop 2024-05-11T01:00:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.379+0000 7f10223b6640 1 -- 172.21.15.174:0/2212281876 shutdown_connections 2024-05-11T01:00:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.379+0000 7f10223b6640 1 --2- 172.21.15.174:0/2212281876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c15f560 0x7f101c06c3e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.379+0000 7f10223b6640 1 -- 172.21.15.174:0/2212281876 >> 172.21.15.174:0/2212281876 conn(0x7f101c0d20b0 msgr2=0x7f101c0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.379+0000 7f10223b6640 1 -- 172.21.15.174:0/2212281876 shutdown_connections 2024-05-11T01:00:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.379+0000 7f10223b6640 1 -- 172.21.15.174:0/2212281876 wait complete. 2024-05-11T01:00:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.380+0000 7f10223b6640 1 Processor -- start 2024-05-11T01:00:55.381 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.380+0000 7f10223b6640 1 -- start start 2024-05-11T01:00:55.383 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f10223b6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f101c0b1140 0x7f101c154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.383 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f10223b6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c0b1790 0x7f101c1620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.383 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f10223b6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c15f560 0x7f101c157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f10223b6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f101c0b5c20 con 0x7f101c0b1140 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f10223b6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f101c163a60 con 0x7f101c15f560 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f10223b6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f101c074480 con 0x7f101c0b1790 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c0b1790 0x7f101c1620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1020953640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c15f560 0x7f101c157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c0b1790 0x7f101c1620b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.174:48894/0 (socket says 172.21.15.174:48894) 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1020953640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c15f560 0x7f101c157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:42178/0 (socket says 172.21.15.174:42178) 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 -- 172.21.15.174:0/359876631 learned_addr learned my addr 172.21.15.174:0/359876631 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f101bfff640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f101c0b1140 0x7f101c154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 -- 172.21.15.174:0/359876631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c15f560 msgr2=0x7f101c157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c15f560 0x7f101c157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 -- 172.21.15.174:0/359876631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f101c0b1140 msgr2=0x7f101c154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f101c0b1140 0x7f101c154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.384 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 -- 172.21.15.174:0/359876631 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c161010 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1020953640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c15f560 0x7f101c157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.381+0000 7f1013fff640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c0b1790 0x7f101c1620b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f100400c530 tx=0x7f100400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.382+0000 7f10197fa640 1 -- 172.21.15.174:0/359876631 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10040052d0 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.382+0000 7f10197fa640 1 -- 172.21.15.174:0/359876631 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1004005470 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.382+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c1612f0 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.382+0000 7f10197fa640 1 -- 172.21.15.174:0/359876631 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004012870 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.382+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c1618b0 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.382+0000 7f10197fa640 1 -- 172.21.15.174:0/359876631 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1004012a10 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.382+0000 7f10197fa640 1 -- 172.21.15.174:0/359876631 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f100401bab0 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.383+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f101c06a5b0 con 0x7f101c0b1790 2024-05-11T01:00:55.385 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.385+0000 7f10197fa640 1 -- 172.21.15.174:0/359876631 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f100401b450 con 0x7f101c0b1790 2024-05-11T01:00:55.388 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:55.388+0000 7fb141fea040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:00:55.457 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.457+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4bcf96b7-7cb6-4962-bffc-1705430867a8", "id": 7} v 0) -- 0x7f101c06e500 con 0x7f101c0b1790 2024-05-11T01:00:55.463 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.462+0000 7f10197fa640 1 -- 172.21.15.174:0/359876631 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4bcf96b7-7cb6-4962-bffc-1705430867a8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f100401b630 con 0x7f101c0b1790 2024-05-11T01:00:55.463 INFO:teuthology.orchestra.run.smithi174.stdout:7 2024-05-11T01:00:55.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c0b1790 msgr2=0x7f101c1620b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c0b1790 0x7f101c1620b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f100400c530 tx=0x7f100400c9f0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 shutdown_connections 2024-05-11T01:00:55.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f101c15f560 0x7f101c157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f101c0b1790 0x7f101c1620b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.464 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 --2- 172.21.15.174:0/359876631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f101c0b1140 0x7f101c154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 >> 172.21.15.174:0/359876631 conn(0x7f101c0d20b0 msgr2=0x7f101c0d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:55.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 shutdown_connections 2024-05-11T01:00:55.465 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:00:55.463+0000 7f10223b6640 1 -- 172.21.15.174:0/359876631 wait complete. 2024-05-11T01:00:55.474 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-11T01:00:55.475 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-11T01:00:55.477 INFO:tasks.ceph.osd.0:Started 2024-05-11T01:00:55.477 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-11T01:00:55.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-11T01:00:55.479 INFO:tasks.ceph.osd.1:Started 2024-05-11T01:00:55.479 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-11T01:00:55.479 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-11T01:00:55.481 INFO:tasks.ceph.osd.2:Started 2024-05-11T01:00:55.481 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-11T01:00:55.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-11T01:00:55.484 INFO:tasks.ceph.osd.3:Started 2024-05-11T01:00:55.484 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-11T01:00:55.485 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-11T01:00:55.486 INFO:tasks.ceph.osd.4:Started 2024-05-11T01:00:55.487 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-11T01:00:55.487 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-11T01:00:55.489 INFO:tasks.ceph.osd.5:Started 2024-05-11T01:00:55.489 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-11T01:00:55.489 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-11T01:00:55.491 INFO:tasks.ceph.osd.6:Started 2024-05-11T01:00:55.491 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-11T01:00:55.491 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-11T01:00:55.493 INFO:tasks.ceph.osd.7:Started 2024-05-11T01:00:55.494 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:00:55.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.627+0000 7f38bacc8640 1 Processor -- start 2024-05-11T01:00:55.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.627+0000 7f38bacc8640 1 -- start start 2024-05-11T01:00:55.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38bacc8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38b40d18b0 0x7f38b40d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38bacc8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b40cf510 con 0x7f38b40d2a40 2024-05-11T01:00:55.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38bacc8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b40cd810 con 0x7f38b41609b0 2024-05-11T01:00:55.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38bacc8640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f38b40cdaf0 con 0x7f38b40d18b0 2024-05-11T01:00:55.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b9265640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f38b40d2a40 0x7f38b40cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43634/0 (socket says 172.21.15.16:43634) 2024-05-11T01:00:55.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b9265640 1 -- 172.21.15.16:0/809283290 learned_addr learned my addr 172.21.15.16:0/809283290 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:00:55.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b3fff640 1 --2- 172.21.15.16:0/809283290 >> v2:172.21.15.174:3300/0 conn(0x7f38b40d18b0 0x7f38b40d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918563157 0 0) 0x7f38b40cf510 con 0x7f38b40d2a40 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38a4003520 con 0x7f38b40d2a40 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577515817 0 0) 0x7f38b40cd810 con 0x7f38b41609b0 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38b40cf510 con 0x7f38b41609b0 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2807932609 0 0) 0x7f38b40cf510 con 0x7f38b41609b0 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 >> v2:172.21.15.174:3300/0 conn(0x7f38b40d18b0 msgr2=0x7f38b40d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 --2- 172.21.15.16:0/809283290 >> v2:172.21.15.174:3300/0 conn(0x7f38b40d18b0 0x7f38b40d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 >> v1:172.21.15.16:6789/0 conn(0x7f38b40d2a40 legacy=0x7f38b40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b4161cb0 con 0x7f38b41609b0 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f38a80016d0 con 0x7f38b41609b0 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.628+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 >> v1:172.21.15.174:6789/0 conn(0x7f38b41609b0 legacy=0x7f38b40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b37fe640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a4004c90 0x7f38a4005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b37fe640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a40037a0 0x7f38a4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b37fe640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a4004160 0x7f38a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40cdaf0 con 0x7f38a40037a0 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f38a400c110 con 0x7f38a4004160 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f38a400c310 con 0x7f38a4004c90 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b3fff640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a40037a0 0x7f38a4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b8a64640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a4004c90 0x7f38a4005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b9265640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a4004160 0x7f38a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b9265640 1 -- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a4004c90 msgr2=0x7f38a4005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b9265640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a4004c90 0x7f38a4005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b9265640 1 -- 172.21.15.16:0/809283290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a40037a0 msgr2=0x7f38a4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b9265640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a40037a0 0x7f38a4003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b9265640 1 -- 172.21.15.16:0/809283290 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40cf510 con 0x7f38a4004160 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.629+0000 7f38b3fff640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a40037a0 0x7f38a4003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.630+0000 7f38b9265640 1 -- 172.21.15.16:0/809283290 reap_dead start 2024-05-11T01:00:55.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.630+0000 7f38b9265640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a4004160 0x7f38a400b9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00c490 tx=0x7f38a4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e16931cbfcfc47e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:55.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.630+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac032020 con 0x7f38a4004160 2024-05-11T01:00:55.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.630+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38ac02e620 con 0x7f38a4004160 2024-05-11T01:00:55.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.630+0000 7f38b37fe640 1 -- 172.21.15.16:0/809283290 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0009690 con 0x7f38a4004160 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.631+0000 7f38bacc8640 1 -- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a4004160 msgr2=0x7f38a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.631+0000 7f38bacc8640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a4004160 0x7f38a400b9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f38ac00c490 tx=0x7f38a4005830 comp rx=0 tx=0).stop 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.631+0000 7f38bacc8640 1 -- 172.21.15.16:0/809283290 shutdown_connections 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.631+0000 7f38bacc8640 1 --2- 172.21.15.16:0/809283290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a4004160 0x7f38a400b9c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.631+0000 7f38bacc8640 1 -- 172.21.15.16:0/809283290 >> 172.21.15.16:0/809283290 conn(0x7f38b4072b60 msgr2=0x7f38b40681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.631+0000 7f38bacc8640 1 -- 172.21.15.16:0/809283290 shutdown_connections 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.631+0000 7f38bacc8640 1 -- 172.21.15.16:0/809283290 wait complete. 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.632+0000 7f38bacc8640 1 Processor -- start 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.632+0000 7f38bacc8640 1 -- start start 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38bacc8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a4004160 0x7f38b41f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38bacc8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38b40b7e50 0x7f38b415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38bacc8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38b415d250 0x7f38b41546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38bacc8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38b41619c0 con 0x7f38a4004160 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38bacc8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4161840 con 0x7f38b40b7e50 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38bacc8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f38b40b5f70 con 0x7f38b415d250 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38b40b7e50 0x7f38b415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b3fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38b40b7e50 0x7f38b415cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:52730/0 (socket says 172.21.15.16:52730) 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b3fff640 1 -- 172.21.15.16:0/2715787981 learned_addr learned my addr 172.21.15.16:0/2715787981 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b8a64640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a4004160 0x7f38b41f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b9265640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38b415d250 0x7f38b41546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b3fff640 1 -- 172.21.15.16:0/2715787981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38b415d250 msgr2=0x7f38b41546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b3fff640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38b415d250 0x7f38b41546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b3fff640 1 -- 172.21.15.16:0/2715787981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a4004160 msgr2=0x7f38b41f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.633+0000 7f38b3fff640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a4004160 0x7f38b41f3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.634+0000 7f38b3fff640 1 -- 172.21.15.16:0/2715787981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40b6db0 con 0x7f38b40b7e50 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.634+0000 7f38b3fff640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38b40b7e50 0x7f38b415cd10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38a0011960 tx=0x7f38a0011e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:55.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.634+0000 7f38b17fa640 1 -- 172.21.15.16:0/2715787981 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0004020 con 0x7f38b40b7e50 2024-05-11T01:00:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.634+0000 7f38b17fa640 1 -- 172.21.15.16:0/2715787981 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a00041c0 con 0x7f38b40b7e50 2024-05-11T01:00:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.634+0000 7f38b17fa640 1 -- 172.21.15.16:0/2715787981 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a000f9d0 con 0x7f38b40b7e50 2024-05-11T01:00:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.634+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b40b7090 con 0x7f38b40b7e50 2024-05-11T01:00:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.634+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b40b7650 con 0x7f38b40b7e50 2024-05-11T01:00:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.634+0000 7f38b17fa640 1 -- 172.21.15.16:0/2715787981 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38a0012040 con 0x7f38b40b7e50 2024-05-11T01:00:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.635+0000 7f38b17fa640 1 -- 172.21.15.16:0/2715787981 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f38a0014de0 con 0x7f38b40b7e50 2024-05-11T01:00:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.635+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b406a5b0 con 0x7f38b40b7e50 2024-05-11T01:00:55.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.637+0000 7f38b17fa640 1 -- 172.21.15.16:0/2715787981 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f38a0019030 con 0x7f38b40b7e50 2024-05-11T01:00:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.700+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38b415d630 con 0x7f38b40b7e50 2024-05-11T01:00:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.701+0000 7f38b17fa640 1 -- 172.21.15.16:0/2715787981 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f38a0014710 con 0x7f38b40b7e50 2024-05-11T01:00:55.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:00:55.701 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:00:55.459284+0000","last_up_change":"0.000000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.701+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38b40b7e50 msgr2=0x7f38b415cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.701+0000 7f38bacc8640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38b40b7e50 0x7f38b415cd10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f38a0011960 tx=0x7f38a0011e20 comp rx=0 tx=0).stop 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.702+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 shutdown_connections 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.702+0000 7f38bacc8640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38b415d250 0x7f38b41546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.702+0000 7f38bacc8640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38b40b7e50 0x7f38b415cd10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.702+0000 7f38bacc8640 1 --2- 172.21.15.16:0/2715787981 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a4004160 0x7f38b41f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.702+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 >> 172.21.15.16:0/2715787981 conn(0x7f38b4072b60 msgr2=0x7f38b4160dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.702+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 shutdown_connections 2024-05-11T01:00:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:00:55.702+0000 7f38bacc8640 1 -- 172.21.15.16:0/2715787981 wait complete. 2024-05-11T01:00:55.712 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-11T01:00:55.713 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-11T01:00:55.777 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:55.777+0000 7f27aedee040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-11T01:00:55.788 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:55.788+0000 7fb141fea040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-11T01:00:55.922 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:55.922+0000 7f27aedee040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-11T01:00:55.929 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:55.929+0000 7fb141fea040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-11T01:00:56.086 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-11T01:00:56.086+0000 7fa54e812640 -1 Falling back to public interface 2024-05-11T01:00:56.090 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-05-11T01:00:56.090+0000 7fc361825640 -1 Falling back to public interface 2024-05-11T01:00:56.094 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-05-11T01:00:56.093+0000 7f60085cb640 -1 Falling back to public interface 2024-05-11T01:00:56.102 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-05-11T01:00:56.101+0000 7ff03a233640 -1 Falling back to public interface 2024-05-11T01:00:56.102 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-05-11T01:00:56.101+0000 7f5c08823640 -1 Falling back to public interface 2024-05-11T01:00:56.121 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-11T01:00:56.121+0000 7f6447e12640 -1 Falling back to public interface 2024-05-11T01:00:56.122 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-11T01:00:56.121+0000 7f554b00d640 -1 Falling back to public interface 2024-05-11T01:00:56.122 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-11T01:00:56.121+0000 7f644683b640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-05-11T01:00:56.126 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-11T01:00:56.126+0000 7fb05e5dc640 -1 Falling back to public interface 2024-05-11T01:00:56.191 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:56.190+0000 7fb141fea040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-11T01:00:56.195 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:56.195+0000 7f27aedee040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-11T01:00:56.243 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:56.242+0000 7fb141fea040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-11T01:00:56.249 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:56.249+0000 7f27aedee040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-11T01:00:56.358 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:56.358+0000 7fb141fea040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-11T01:00:56.371 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:56.371+0000 7f27aedee040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-11T01:00:56.518 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-11T01:00:56.613 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.613+0000 7f7fa97af640 1 Processor -- start 2024-05-11T01:00:56.613 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.613+0000 7f7fa97af640 1 -- start start 2024-05-11T01:00:56.614 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa97af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d4aa0 0x7f7fa40baf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:56.614 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa97af640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa40b9cf0 con 0x7f7fa40d2a70 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa97af640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa40b9fd0 con 0x7f7fa415f6f0 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa97af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa40ba2b0 con 0x7f7fa40d4aa0 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa27fc640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7fa40d2a70 0x7f7fa40b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43642/0 (socket says 172.21.15.16:43642) 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa27fc640 1 -- 172.21.15.16:0/2981351807 learned_addr learned my addr 172.21.15.16:0/2981351807 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa37fe640 1 --2- 172.21.15.16:0/2981351807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d4aa0 0x7f7fa40baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa1ffb640 1 -- 172.21.15.16:0/2981351807 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829004810 0 0) 0x7f7fa40b9cf0 con 0x7f7fa40d2a70 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa1ffb640 1 -- 172.21.15.16:0/2981351807 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f8c003520 con 0x7f7fa40d2a70 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa1ffb640 1 -- 172.21.15.16:0/2981351807 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439019690 0 0) 0x7f7fa40b9fd0 con 0x7f7fa415f6f0 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa1ffb640 1 -- 172.21.15.16:0/2981351807 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fa40b9cf0 con 0x7f7fa415f6f0 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa37fe640 1 -- 172.21.15.16:0/2981351807 >> v1:172.21.15.174:6789/0 conn(0x7f7fa415f6f0 legacy=0x7f7fa40d2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa37fe640 1 -- 172.21.15.16:0/2981351807 >> v1:172.21.15.16:6789/0 conn(0x7f7fa40d2a70 legacy=0x7f7fa40b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa1ffb640 1 -- 172.21.15.16:0/2981351807 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1875826077 0 0) 0x7f7f8c003520 con 0x7f7fa40d2a70 2024-05-11T01:00:56.615 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.614+0000 7f7fa37fe640 1 -- 172.21.15.16:0/2981351807 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa40ba590 con 0x7f7fa40d4aa0 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.615+0000 7f7fa37fe640 1 --2- 172.21.15.16:0/2981351807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d4aa0 0x7f7fa40baf40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009dc0 tx=0x7f7f9c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ba292b34e33d2b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.615+0000 7f7fa1ffb640 1 -- 172.21.15.16:0/2981351807 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980016f0 con 0x7f7fa40d4aa0 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.615+0000 7f7fa1ffb640 1 -- 172.21.15.16:0/2981351807 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c007540 con 0x7f7fa40d4aa0 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.615+0000 7f7fa1ffb640 1 -- 172.21.15.16:0/2981351807 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c007910 con 0x7f7fa40d4aa0 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.616+0000 7f7fa97af640 1 -- 172.21.15.16:0/2981351807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d4aa0 msgr2=0x7f7fa40baf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.616+0000 7f7fa97af640 1 --2- 172.21.15.16:0/2981351807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d4aa0 0x7f7fa40baf40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009dc0 tx=0x7f7f9c02a5d0 comp rx=0 tx=0).stop 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.616+0000 7f7fa97af640 1 -- 172.21.15.16:0/2981351807 shutdown_connections 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.616+0000 7f7fa97af640 1 --2- 172.21.15.16:0/2981351807 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d4aa0 0x7f7fa40baf40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.616+0000 7f7fa97af640 1 -- 172.21.15.16:0/2981351807 >> 172.21.15.16:0/2981351807 conn(0x7f7fa4073f10 msgr2=0x7f7fa4074320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:56.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.616+0000 7f7fa97af640 1 -- 172.21.15.16:0/2981351807 shutdown_connections 2024-05-11T01:00:56.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.616+0000 7f7fa97af640 1 -- 172.21.15.16:0/2981351807 wait complete. 2024-05-11T01:00:56.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.617+0000 7f7fa97af640 1 Processor -- start 2024-05-11T01:00:56.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.617+0000 7f7fa97af640 1 -- start start 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa97af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d2a70 0x7f7fa4153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa97af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fa40d4aa0 0x7f7fa415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa97af640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fa415f6f0 0x7f7fa41600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa97af640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa416a430 con 0x7f7fa415f6f0 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa97af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa416a2b0 con 0x7f7fa40d4aa0 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa97af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa416a5b0 con 0x7f7fa40d2a70 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fa415f6f0 0x7f7fa41600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fa415f6f0 0x7f7fa41600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49500/0 (socket says 172.21.15.16:49500) 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa37fe640 1 -- 172.21.15.16:0/2992134014 learned_addr learned my addr 172.21.15.16:0/2992134014 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:00:56.620 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa2ffd640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d2a70 0x7f7fa4153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa27fc640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fa40d4aa0 0x7f7fa415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa37fe640 1 -- 172.21.15.16:0/2992134014 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d2a70 msgr2=0x7f7fa4153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa37fe640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d2a70 0x7f7fa4153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa37fe640 1 -- 172.21.15.16:0/2992134014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fa40d4aa0 msgr2=0x7f7fa415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa37fe640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fa40d4aa0 0x7f7fa415fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.618+0000 7f7fa37fe640 1 -- 172.21.15.16:0/2992134014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa4158530 con 0x7f7fa415f6f0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.619+0000 7f7fa37fe640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fa415f6f0 0x7f7fa41600a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009ee0 tx=0x7f7f9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.619+0000 7f7f8b7fe640 1 -- 172.21.15.16:0/2992134014 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c040070 con 0x7f7fa415f6f0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.619+0000 7f7f8b7fe640 1 -- 172.21.15.16:0/2992134014 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c031bc0 con 0x7f7fa415f6f0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.619+0000 7f7f8b7fe640 1 -- 172.21.15.16:0/2992134014 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c009450 con 0x7f7fa415f6f0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.619+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa4160690 con 0x7f7fa415f6f0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.619+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa4160c50 con 0x7f7fa415f6f0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.619+0000 7f7f8b7fe640 1 -- 172.21.15.16:0/2992134014 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f9c039040 con 0x7f7fa415f6f0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.619+0000 7f7f8b7fe640 1 -- 172.21.15.16:0/2992134014 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7f9c045dc0 con 0x7f7fa415f6f0 2024-05-11T01:00:56.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.620+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa4050860 con 0x7f7fa415f6f0 2024-05-11T01:00:56.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.622+0000 7f7f8b7fe640 1 -- 172.21.15.16:0/2992134014 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7f9c054080 con 0x7f7fa415f6f0 2024-05-11T01:00:56.647 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:56.647+0000 7fb141fea040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-11T01:00:56.685 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.685+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fa41613b0 con 0x7f7fa415f6f0 2024-05-11T01:00:56.685 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.685+0000 7f7f8b7fe640 1 -- 172.21.15.16:0/2992134014 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7f9c03cb40 con 0x7f7fa415f6f0 2024-05-11T01:00:56.686 INFO:teuthology.misc.health.smithi016.stdout: 2024-05-11T01:00:56.686 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:00:55.459284+0000","last_up_change":"0.000000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:00:56.687 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fa415f6f0 msgr2=0x7f7fa41600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:00:56.687 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fa415f6f0 0x7f7fa41600a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009ee0 tx=0x7f7f9c004a40 comp rx=0 tx=0).stop 2024-05-11T01:00:56.687 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 shutdown_connections 2024-05-11T01:00:56.687 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fa415f6f0 0x7f7fa41600a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:56.687 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fa40d4aa0 0x7f7fa415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:56.687 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 --2- 172.21.15.16:0/2992134014 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7fa40d2a70 0x7f7fa4153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:00:56.687 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 >> 172.21.15.16:0/2992134014 conn(0x7f7fa4073f10 msgr2=0x7f7fa40d2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:00:56.687 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 shutdown_connections 2024-05-11T01:00:56.688 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:00:56.686+0000 7f7fa97af640 1 -- 172.21.15.16:0/2992134014 wait complete. 2024-05-11T01:00:56.688 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:56.687+0000 7f27aedee040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-11T01:00:56.696 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-11T01:00:56.696 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:56.695+0000 7fb141fea040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-11T01:00:56.737 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:56.737+0000 7f27aedee040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-11T01:00:56.849 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:56.848+0000 7fb141fea040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-11T01:00:56.901 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:56.901+0000 7f27aedee040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-11T01:00:56.985 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:56.985+0000 7fb141fea040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-11T01:00:57.034 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:57.034+0000 7fb141fea040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-11T01:00:57.045 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:57.045+0000 7f27aedee040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-11T01:00:57.096 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:57.097+0000 7f27aedee040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-11T01:00:57.103 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:57.102+0000 7fb141fea040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-11T01:00:57.147 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:57.147+0000 7fb141fea040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-11T01:00:57.170 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:57.170+0000 7f27aedee040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-11T01:00:57.217 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:57.217+0000 7f27aedee040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-11T01:00:57.624 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:57.625+0000 7fb141fea040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-11T01:00:57.718 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:57.718+0000 7f27aedee040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-11T01:00:57.740 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:57.741+0000 7fb141fea040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-11T01:00:57.840 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:00:57.841+0000 7f27aedee040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-11T01:00:58.756 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:58.756+0000 7fb0e2398640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-11T01:00:58.756 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:00:58.757+0000 7fb0e2398640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-11T01:00:59.574 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-11T01:00:59.574+0000 7fa54e812640 -1 osd.0 0 log_to_monitors true 2024-05-11T01:00:59.605 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-05-11T01:00:59.605+0000 7f5c08823640 -1 osd.6 0 log_to_monitors true 2024-05-11T01:00:59.613 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-05-11T01:00:59.614+0000 7f60085cb640 -1 osd.7 0 log_to_monitors true 2024-05-11T01:00:59.614 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-05-11T01:00:59.615+0000 7fc361825640 -1 osd.4 0 log_to_monitors true 2024-05-11T01:00:59.617 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-11T01:00:59.617+0000 7f554b00d640 -1 osd.2 0 log_to_monitors true 2024-05-11T01:00:59.618 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-05-11T01:00:59.619+0000 7ff03a233640 -1 osd.5 0 log_to_monitors true 2024-05-11T01:00:59.640 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-11T01:00:59.640+0000 7f6447e12640 -1 osd.1 0 log_to_monitors true 2024-05-11T01:00:59.649 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-11T01:00:59.649+0000 7fb05e5dc640 -1 osd.3 0 log_to_monitors true 2024-05-11T01:01:02.228 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-11T01:01:02.228+0000 7fa54aa65640 -1 osd.0 0 waiting for initial osdmap 2024-05-11T01:01:02.239 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-05-11T01:01:02.239+0000 7fa542071640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-11T01:01:02.251 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-11T01:01:02.252+0000 7fb05a572640 -1 osd.3 0 waiting for initial osdmap 2024-05-11T01:01:02.263 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-05-11T01:01:02.263+0000 7fb052392640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-11T01:01:02.274 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-11T01:01:02.274+0000 7f554724c640 -1 osd.2 0 waiting for initial osdmap 2024-05-11T01:01:02.288 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-05-11T01:01:02.288+0000 7f553e858640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-11T01:01:02.334 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-11T01:01:02.334+0000 7f6443822640 -1 osd.1 0 waiting for initial osdmap 2024-05-11T01:01:02.349 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-05-11T01:01:02.349+0000 7f643b642640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-11T01:01:02.820 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-05-11T01:01:02.820+0000 7f6004d75640 -1 osd.7 0 waiting for initial osdmap 2024-05-11T01:01:02.826 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-05-11T01:01:02.826+0000 7fc35da7b640 -1 osd.4 0 waiting for initial osdmap 2024-05-11T01:01:02.828 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-05-11T01:01:02.829+0000 7ff035780640 -1 osd.5 0 waiting for initial osdmap 2024-05-11T01:01:02.835 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-05-11T01:01:02.836+0000 7f5ffc381640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-11T01:01:02.843 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-05-11T01:01:02.844+0000 7fc355087640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-11T01:01:02.847 INFO:tasks.ceph.osd.5.smithi174.stderr:2024-05-11T01:01:02.848+0000 7ff02d5b1640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-11T01:01:02.865 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-05-11T01:01:02.866+0000 7f5c04267640 -1 osd.6 0 waiting for initial osdmap 2024-05-11T01:01:02.875 INFO:tasks.ceph.osd.6.smithi174.stderr:2024-05-11T01:01:02.876+0000 7f5bfc087640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-11T01:01:03.504 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:03.614 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.614+0000 7fdeefdac640 1 Processor -- start 2024-05-11T01:01:03.614 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.614+0000 7fdeefdac640 1 -- start start 2024-05-11T01:01:03.616 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeefdac640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdee815f870 0x7fdee806d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeefdac640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee806d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeefdac640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee80b55e0 con 0x7fdee80ae880 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeefdac640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fdee815fc50 con 0x7fdee815f870 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeefdac640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdee80b58c0 con 0x7fdee80d0c60 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeed347640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdee80ae880 0x7fdee80cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34064/0 (socket says 172.21.15.16:34064) 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeed347640 1 -- 172.21.15.16:0/1180987670 learned_addr learned my addr 172.21.15.16:0/1180987670 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeedb48640 1 --2- 172.21.15.16:0/1180987670 >> v2:172.21.15.174:3300/0 conn(0x7fdee815f870 0x7fdee806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeee349640 1 --2- 172.21.15.16:0/1180987670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee806d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.615+0000 7fdeecb46640 1 -- 172.21.15.16:0/1180987670 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884997602 0 0) 0x7fdee80b55e0 con 0x7fdee80ae880 2024-05-11T01:01:03.617 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.616+0000 7fdeecb46640 1 -- 172.21.15.16:0/1180987670 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fded4003520 con 0x7fdee80ae880 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.616+0000 7fdeee349640 1 -- 172.21.15.16:0/1180987670 >> v2:172.21.15.174:3300/0 conn(0x7fdee815f870 msgr2=0x7fdee806d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.616+0000 7fdeee349640 1 --2- 172.21.15.16:0/1180987670 >> v2:172.21.15.174:3300/0 conn(0x7fdee815f870 0x7fdee806d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.616+0000 7fdeee349640 1 -- 172.21.15.16:0/1180987670 >> v1:172.21.15.16:6789/0 conn(0x7fdee80ae880 legacy=0x7fdee80cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.616+0000 7fdeee349640 1 -- 172.21.15.16:0/1180987670 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee80b5ba0 con 0x7fdee80d0c60 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.616+0000 7fdeedb48640 1 --2- 172.21.15.16:0/1180987670 >> v2:172.21.15.174:3300/0 conn(0x7fdee815f870 0x7fdee806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.616+0000 7fdeee349640 1 --2- 172.21.15.16:0/1180987670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee806d940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009d90 tx=0x7fdee002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae875a15b64547f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeecb46640 1 -- 172.21.15.16:0/1180987670 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0031600 con 0x7fdee80d0c60 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeecb46640 1 -- 172.21.15.16:0/1180987670 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee00317a0 con 0x7fdee80d0c60 2024-05-11T01:01:03.618 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeecb46640 1 -- 172.21.15.16:0/1180987670 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0031b70 con 0x7fdee80d0c60 2024-05-11T01:01:03.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeefdac640 1 -- 172.21.15.16:0/1180987670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 msgr2=0x7fdee806d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1180987670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee806d940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009d90 tx=0x7fdee002a5d0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeefdac640 1 -- 172.21.15.16:0/1180987670 shutdown_connections 2024-05-11T01:01:03.621 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1180987670 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee806d940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1180987670 >> v2:172.21.15.174:3300/0 conn(0x7fdee815f870 0x7fdee806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeefdac640 1 -- 172.21.15.16:0/1180987670 >> 172.21.15.16:0/1180987670 conn(0x7fdee8072ca0 msgr2=0x7fdee8073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeefdac640 1 -- 172.21.15.16:0/1180987670 shutdown_connections 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.617+0000 7fdeefdac640 1 -- 172.21.15.16:0/1180987670 wait complete. 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.619+0000 7fdeefdac640 1 Processor -- start 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.619+0000 7fdeefdac640 1 -- start start 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeefdac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee80ae880 0x7fdee81f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeefdac640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee8070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeefdac640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdee815f870 0x7fdee815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeefdac640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80d13d0 con 0x7fdee80ae880 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeefdac640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80b6160 con 0x7fdee815f870 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeefdac640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdee81f9500 con 0x7fdee80d0c60 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee80ae880 0x7fdee81f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.622 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee80ae880 0x7fdee81f8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57604/0 (socket says 172.21.15.16:57604) 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 -- 172.21.15.16:0/1080817669 learned_addr learned my addr 172.21.15.16:0/1080817669 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeed347640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeee349640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdee815f870 0x7fdee815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 -- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 msgr2=0x7fdee8070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee8070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 -- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdee815f870 msgr2=0x7fdee815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdee815f870 0x7fdee815ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 -- 172.21.15.16:0/1080817669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee806f670 con 0x7fdee80ae880 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.620+0000 7fdeedb48640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee80ae880 0x7fdee81f8fc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdee400ec10 tx=0x7fdee400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:03.623 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.621+0000 7fdede7fc640 1 -- 172.21.15.16:0/1080817669 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4017070 con 0x7fdee80ae880 2024-05-11T01:01:03.624 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.621+0000 7fdede7fc640 1 -- 172.21.15.16:0/1080817669 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee400cc30 con 0x7fdee80ae880 2024-05-11T01:01:03.624 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.621+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee806f950 con 0x7fdee80ae880 2024-05-11T01:01:03.624 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.621+0000 7fdede7fc640 1 -- 172.21.15.16:0/1080817669 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4013470 con 0x7fdee80ae880 2024-05-11T01:01:03.624 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.621+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee806ff10 con 0x7fdee80ae880 2024-05-11T01:01:03.625 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.622+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee8050860 con 0x7fdee80ae880 2024-05-11T01:01:03.625 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.623+0000 7fdede7fc640 1 -- 172.21.15.16:0/1080817669 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fdee401a070 con 0x7fdee80ae880 2024-05-11T01:01:03.625 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.623+0000 7fdede7fc640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fdecc076240 0x7fdecc078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.625 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.623+0000 7fdede7fc640 1 -- 172.21.15.16:0/1080817669 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fdee4097300 con 0x7fdee80ae880 2024-05-11T01:01:03.625 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.623+0000 7fdeed347640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fdecc076240 0x7fdecc078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.625 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.624+0000 7fdeed347640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fdecc076240 0x7fdecc078700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fded8007a60 tx=0x7fded8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:03.627 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.628+0000 7fdede7fc640 1 -- 172.21.15.16:0/1080817669 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdee4061210 con 0x7fdee80ae880 2024-05-11T01:01:03.821 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.821+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdee8069990 con 0x7fdee80ae880 2024-05-11T01:01:03.822 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.821+0000 7fdede7fc640 1 -- 172.21.15.16:0/1080817669 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10885 (secure 0 0 0) 0x7fdee4069020 con 0x7fdee80ae880 2024-05-11T01:01:03.822 INFO:teuthology.misc.health.smithi016.stdout: 2024-05-11T01:01:03.823 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":13,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:03.236853+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:03.824 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fdecc076240 msgr2=0x7fdecc078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fdecc076240 0x7fdecc078700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fded8007a60 tx=0x7fded8009040 comp rx=0 tx=0).stop 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee80ae880 msgr2=0x7fdee81f8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee80ae880 0x7fdee81f8fc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdee400ec10 tx=0x7fdee400c520 comp rx=0 tx=0).stop 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 shutdown_connections 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fdecc076240 0x7fdecc078700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdee815f870 0x7fdee815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdee80d0c60 0x7fdee8070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 --2- 172.21.15.16:0/1080817669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdee80ae880 0x7fdee81f8fc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 >> 172.21.15.16:0/1080817669 conn(0x7fdee8072ca0 msgr2=0x7fdee815b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 shutdown_connections 2024-05-11T01:01:03.825 INFO:teuthology.misc.health.smithi016.stderr:2024-05-11T01:01:03.823+0000 7fdeefdac640 1 -- 172.21.15.16:0/1080817669 wait complete. 2024-05-11T01:01:03.835 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-11T01:01:03.835 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-11T01:01:03.835 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-11T01:01:03.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-11T01:01:03.838 INFO:tasks.ceph.mds.a:Started 2024-05-11T01:01:03.838 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-11T01:01:03.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-11T01:01:03.841 INFO:tasks.ceph.mds.c:Started 2024-05-11T01:01:03.841 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-11T01:01:03.842 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-11T01:01:03.844 INFO:tasks.ceph.mds.b:Started 2024-05-11T01:01:03.844 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-11T01:01:03.844 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-11T01:01:03.846 INFO:tasks.ceph.mds.d:Started 2024-05-11T01:01:03.847 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-11T01:01:03.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:03.917 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-05-11T01:01:03.918 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-05-11T01:01:03.932 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2024-05-11T01:01:03.933 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-05-11T01:01:03.933 INFO:tasks.ceph.mds.d.smithi174.stderr:2024-05-11T01:01:03.934+0000 7f6f1a0f0640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-05-11T01:01:03.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.958+0000 7f7aa2c93640 1 Processor -- start 2024-05-11T01:01:03.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.958+0000 7f7aa2c93640 1 -- start start 2024-05-11T01:01:03.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa2c93640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7a9c0d18b0 0x7f7a9c0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa2c93640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d2a40 0x7f7a9c0d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa2c93640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c0cf510 con 0x7f7a9c1609b0 2024-05-11T01:01:03.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa2c93640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7a9c0cd810 con 0x7f7a9c0d18b0 2024-05-11T01:01:03.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa2c93640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9c0cdaf0 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7a9bfff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7a9c0d18b0 0x7f7a9c0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa1230640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d2a40 0x7f7a9c0d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa0a2f640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7a9c1609b0 0x7f7a9c0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:56850/0 (socket says 172.21.15.16:56850) 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa1230640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d2a40 0x7f7a9c0d1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:40610/0 (socket says 172.21.15.16:40610) 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7aa0a2f640 1 -- 172.21.15.16:0/2274432796 learned_addr learned my addr 172.21.15.16:0/2274432796 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7a9bfff640 1 -- 172.21.15.16:0/2274432796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d2a40 msgr2=0x7f7a9c0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7a9bfff640 1 --2- 172.21.15.16:0/2274432796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d2a40 0x7f7a9c0d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7a9bfff640 1 -- 172.21.15.16:0/2274432796 >> v1:172.21.15.174:6789/0 conn(0x7f7a9c1609b0 legacy=0x7f7a9c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7a9bfff640 1 -- 172.21.15.16:0/2274432796 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c161cb0 con 0x7f7a9c0d18b0 2024-05-11T01:01:03.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.959+0000 7f7a9b7fe640 1 -- 172.21.15.16:0/2274432796 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440862999 0 0) 0x7f7a9c0cf510 con 0x7f7a9c1609b0 2024-05-11T01:01:03.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.960+0000 7f7a9bfff640 1 --2- 172.21.15.16:0/2274432796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d18b0 0x7f7a9c0d0cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a880097a0 tx=0x7f7a8802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac6a9d9466b72 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:03.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.960+0000 7f7a9b7fe640 1 -- 172.21.15.16:0/2274432796 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88037070 con 0x7f7a9c0d18b0 2024-05-11T01:01:03.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.960+0000 7f7a9b7fe640 1 -- 172.21.15.16:0/2274432796 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a88032440 con 0x7f7a9c0d18b0 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.960+0000 7f7a9b7fe640 1 -- 172.21.15.16:0/2274432796 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88032810 con 0x7f7a9c0d18b0 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.961+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2274432796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d18b0 msgr2=0x7f7a9c0d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.961+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2274432796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d18b0 0x7f7a9c0d0cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a880097a0 tx=0x7f7a8802a180 comp rx=0 tx=0).stop 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.961+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2274432796 shutdown_connections 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.961+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2274432796 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d2a40 0x7f7a9c0d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.961+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2274432796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d18b0 0x7f7a9c0d0cf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.961+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2274432796 >> 172.21.15.16:0/2274432796 conn(0x7f7a9c072b60 msgr2=0x7f7a9c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.961+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2274432796 shutdown_connections 2024-05-11T01:01:03.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.961+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2274432796 wait complete. 2024-05-11T01:01:03.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.962+0000 7f7aa2c93640 1 Processor -- start 2024-05-11T01:01:03.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.962+0000 7f7aa2c93640 1 -- start start 2024-05-11T01:01:03.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa2c93640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d18b0 0x7f7a9c1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa2c93640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d2a40 0x7f7a9c0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa2c93640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a9c1609b0 0x7f7a9c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa2c93640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c1619c0 con 0x7f7a9c1609b0 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa2c93640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9c161840 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa2c93640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9c0cf9f0 con 0x7f7a9c0d18b0 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa1230640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a9c1609b0 0x7f7a9c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa0a2f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d18b0 0x7f7a9c1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7a9bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d2a40 0x7f7a9c0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa0a2f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d18b0 0x7f7a9c1581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:40616/0 (socket says 172.21.15.16:40616) 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa1230640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a9c1609b0 0x7f7a9c0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57640/0 (socket says 172.21.15.16:57640) 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7a9bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d2a40 0x7f7a9c0cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:38506/0 (socket says 172.21.15.16:38506) 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7aa0a2f640 1 -- 172.21.15.16:0/2263567534 learned_addr learned my addr 172.21.15.16:0/2263567534 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.963+0000 7f7a9bfff640 1 -- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d18b0 msgr2=0x7f7a9c1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7a9bfff640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d18b0 0x7f7a9c1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7a9bfff640 1 -- 172.21.15.16:0/2263567534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a9c1609b0 msgr2=0x7f7a9c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7a9bfff640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a9c1609b0 0x7f7a9c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:03.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7a9bfff640 1 -- 172.21.15.16:0/2263567534 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c0b2c50 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7a9bfff640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d2a40 0x7f7a9c0cc570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a88031000 tx=0x7f7a880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:03.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7a997fa640 1 -- 172.21.15.16:0/2263567534 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88037050 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7a997fa640 1 -- 172.21.15.16:0/2263567534 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a88038040 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c0b2f30 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7a997fa640 1 -- 172.21.15.16:0/2263567534 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88004450 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.964+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9c0b34f0 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.965+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a9c06a5b0 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.966+0000 7f7a997fa640 1 -- 172.21.15.16:0/2263567534 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f7a8803c6d0 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.966+0000 7f7a997fa640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7a80076240 0x7f7a80078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:03.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.966+0000 7f7a997fa640 1 -- 172.21.15.16:0/2263567534 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f7a880b7890 con 0x7f7a9c0d2a40 2024-05-11T01:01:03.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.967+0000 7f7aa0a2f640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7a80076240 0x7f7a80078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:03.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.967+0000 7f7aa0a2f640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7a80076240 0x7f7a80078700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a90000f60 tx=0x7f7a90009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:03.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:03.971+0000 7f7a997fa640 1 -- 172.21.15.16:0/2263567534 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a88081150 con 0x7f7a9c0d2a40 2024-05-11T01:01:04.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.205+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a9c0d2490 con 0x7f7a9c0d2a40 2024-05-11T01:01:04.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.206+0000 7f7a997fa640 1 -- 172.21.15.16:0/2263567534 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f7a88085450 con 0x7f7a9c0d2a40 2024-05-11T01:01:04.207 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:04.208 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-11T01:01:04.208 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.208+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7a80076240 msgr2=0x7f7a80078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7a80076240 0x7f7a80078700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a90000f60 tx=0x7f7a90009040 comp rx=0 tx=0).stop 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d2a40 msgr2=0x7f7a9c0cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d2a40 0x7f7a9c0cc570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a88031000 tx=0x7f7a880046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 shutdown_connections 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7a80076240 0x7f7a80078700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a9c1609b0 0x7f7a9c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a9c0d2a40 0x7f7a9c0cc570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 --2- 172.21.15.16:0/2263567534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a9c0d18b0 0x7f7a9c1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 >> 172.21.15.16:0/2263567534 conn(0x7f7a9c072b60 msgr2=0x7f7a9c0cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:04.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 shutdown_connections 2024-05-11T01:01:04.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:04.209+0000 7f7aa2c93640 1 -- 172.21.15.16:0/2263567534 wait complete. 2024-05-11T01:01:06.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.326+0000 7f18efe37640 1 Processor -- start 2024-05-11T01:01:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.326+0000 7f18efe37640 1 -- start start 2024-05-11T01:01:06.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18efe37640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e80b6d70 0x7f18e80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18efe37640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f18e80bac10 0x7f18e806d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18efe37640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e8163e90 con 0x7f18e806d950 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18efe37640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f18e80cfad0 con 0x7f18e80bac10 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18efe37640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f18e80b7690 con 0x7f18e80b6d70 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18ed3d2640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f18e80bac10 0x7f18e806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18ee3d4640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f18e806d950 0x7f18e80d3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:56866/0 (socket says 172.21.15.16:56866) 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18ed3d2640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f18e80bac10 0x7f18e806d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:38520/0 (socket says 172.21.15.16:38520) 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18ee3d4640 1 -- 172.21.15.16:0/388015970 learned_addr learned my addr 172.21.15.16:0/388015970 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.327+0000 7f18edbd3640 1 --2- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e80b6d70 0x7f18e80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ed3d2640 1 -- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e80b6d70 msgr2=0x7f18e80b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ed3d2640 1 --2- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e80b6d70 0x7f18e80b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ed3d2640 1 -- 172.21.15.16:0/388015970 >> v1:172.21.15.174:6789/0 conn(0x7f18e806d950 legacy=0x7f18e80d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ecbd1640 1 -- 172.21.15.16:0/388015970 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203818936 0 0) 0x7f18e8163e90 con 0x7f18e806d950 2024-05-11T01:01:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ed3d2640 1 -- 172.21.15.16:0/388015970 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e8163310 con 0x7f18e80bac10 2024-05-11T01:01:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18edbd3640 1 --2- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e80b6d70 0x7f18e80b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ed3d2640 1 --2- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 0x7f18e806d410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18d80097a0 tx=0x7f18d802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d14067a271bf4fc server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ecbd1640 1 -- 172.21.15.16:0/388015970 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8037070 con 0x7f18e80bac10 2024-05-11T01:01:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ecbd1640 1 -- 172.21.15.16:0/388015970 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d802ae50 con 0x7f18e80bac10 2024-05-11T01:01:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.328+0000 7f18ecbd1640 1 -- 172.21.15.16:0/388015970 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8032660 con 0x7f18e80bac10 2024-05-11T01:01:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.329+0000 7f18efe37640 1 -- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 msgr2=0x7f18e806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.329+0000 7f18efe37640 1 --2- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 0x7f18e806d410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18d80097a0 tx=0x7f18d802a100 comp rx=0 tx=0).stop 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.329+0000 7f18efe37640 1 -- 172.21.15.16:0/388015970 shutdown_connections 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.329+0000 7f18efe37640 1 --2- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 0x7f18e806d410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.329+0000 7f18efe37640 1 --2- 172.21.15.16:0/388015970 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e80b6d70 0x7f18e80b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.329+0000 7f18efe37640 1 -- 172.21.15.16:0/388015970 >> 172.21.15.16:0/388015970 conn(0x7f18e8074140 msgr2=0x7f18e80d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.329+0000 7f18efe37640 1 -- 172.21.15.16:0/388015970 shutdown_connections 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.329+0000 7f18efe37640 1 -- 172.21.15.16:0/388015970 wait complete. 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.330+0000 7f18efe37640 1 Processor -- start 2024-05-11T01:01:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.330+0000 7f18efe37640 1 -- start start 2024-05-11T01:01:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18efe37640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e806d950 0x7f18e80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18efe37640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e80b6d70 0x7f18e8161d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18efe37640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 0x7f18e815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18efe37640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8163bb0 con 0x7f18e80b6d70 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18efe37640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18e81638d0 con 0x7f18e80bac10 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18efe37640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f18e815f830 con 0x7f18e806d950 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18ed3d2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e80b6d70 0x7f18e8161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18edbd3640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e806d950 0x7f18e80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18ed3d2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e80b6d70 0x7f18e8161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57650/0 (socket says 172.21.15.16:57650) 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18ed3d2640 1 -- 172.21.15.16:0/2685732687 learned_addr learned my addr 172.21.15.16:0/2685732687 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.331+0000 7f18ee3d4640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 0x7f18e815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18ed3d2640 1 -- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e806d950 msgr2=0x7f18e80ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18ed3d2640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e806d950 0x7f18e80ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18ed3d2640 1 -- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 msgr2=0x7f18e815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18ed3d2640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 0x7f18e815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18ed3d2640 1 -- 172.21.15.16:0/2685732687 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e81622b0 con 0x7f18e80b6d70 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18edbd3640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e806d950 0x7f18e80ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18ee3d4640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 0x7f18e815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18ed3d2640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e80b6d70 0x7f18e8161d70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18d8000c00 tx=0x7f18d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18de7fc640 1 -- 172.21.15.16:0/2685732687 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8037040 con 0x7f18e80b6d70 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18de7fc640 1 -- 172.21.15.16:0/2685732687 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d8004030 con 0x7f18e80b6d70 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e80cd440 con 0x7f18e80b6d70 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18de7fc640 1 -- 172.21.15.16:0/2685732687 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8004400 con 0x7f18e80b6d70 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.332+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e80cda00 con 0x7f18e80b6d70 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.333+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e806a5b0 con 0x7f18e80b6d70 2024-05-11T01:01:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.334+0000 7f18de7fc640 1 -- 172.21.15.16:0/2685732687 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f18d8003610 con 0x7f18e80b6d70 2024-05-11T01:01:06.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.334+0000 7f18de7fc640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18cc076240 0x7f18cc078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.334+0000 7f18de7fc640 1 -- 172.21.15.16:0/2685732687 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f18d80b7c60 con 0x7f18e80b6d70 2024-05-11T01:01:06.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.334+0000 7f18edbd3640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18cc076240 0x7f18cc078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.335+0000 7f18edbd3640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18cc076240 0x7f18cc078700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009560 tx=0x7f18e4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:06.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.339+0000 7f18de7fc640 1 -- 172.21.15.16:0/2685732687 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f18d8081430 con 0x7f18e80b6d70 2024-05-11T01:01:06.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.567+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18e815afa0 con 0x7f18e80b6d70 2024-05-11T01:01:06.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.567+0000 7f18de7fc640 1 -- 172.21.15.16:0/2685732687 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7f18d8085730 con 0x7f18e80b6d70 2024-05-11T01:01:06.569 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:06.569 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-11T01:01:06.569 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2024-05-11T01:01:06.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18cc076240 msgr2=0x7f18cc078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18cc076240 0x7f18cc078700 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009560 tx=0x7f18e4009190 comp rx=0 tx=0).stop 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e80b6d70 msgr2=0x7f18e8161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e80b6d70 0x7f18e8161d70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18d8000c00 tx=0x7f18d80046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 shutdown_connections 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18cc076240 0x7f18cc078700 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18e80bac10 0x7f18e815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18e80b6d70 0x7f18e8161d70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 --2- 172.21.15.16:0/2685732687 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18e806d950 0x7f18e80ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 >> 172.21.15.16:0/2685732687 conn(0x7f18e8074140 msgr2=0x7f18e80ba160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 shutdown_connections 2024-05-11T01:01:06.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.569+0000 7f18efe37640 1 -- 172.21.15.16:0/2685732687 wait complete. 2024-05-11T01:01:06.582 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-11T01:01:06.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.687+0000 7f77178fc640 1 Processor -- start 2024-05-11T01:01:06.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.687+0000 7f77178fc640 1 -- start start 2024-05-11T01:01:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f77178fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77100bac10 0x7f77100d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f77178fc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f77100d3ec0 0x7f77100d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f77178fc640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7710163e90 con 0x7f77100b6d70 2024-05-11T01:01:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f77178fc640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f77100cfad0 con 0x7f77100bac10 2024-05-11T01:01:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f77178fc640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7710163310 con 0x7f77100d3ec0 2024-05-11T01:01:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7714e97640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77100bac10 0x7f77100d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7714e97640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77100bac10 0x7f77100d3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57652/0 (socket says 172.21.15.16:57652) 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7714e97640 1 -- 172.21.15.16:0/3840537614 learned_addr learned my addr 172.21.15.16:0/3840537614 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7715e99640 1 --2- 172.21.15.16:0/3840537614 >> v2:172.21.15.174:3300/0 conn(0x7f77100d3ec0 0x7f77100d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7714e97640 1 -- 172.21.15.16:0/3840537614 >> v2:172.21.15.174:3300/0 conn(0x7f77100d3ec0 msgr2=0x7f77100d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7714e97640 1 --2- 172.21.15.16:0/3840537614 >> v2:172.21.15.174:3300/0 conn(0x7f77100d3ec0 0x7f77100d4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7714e97640 1 -- 172.21.15.16:0/3840537614 >> v1:172.21.15.174:6789/0 conn(0x7f77100b6d70 legacy=0x7f77100b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7714e97640 1 -- 172.21.15.16:0/3840537614 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77101635f0 con 0x7f77100bac10 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.688+0000 7f7715e99640 1 --2- 172.21.15.16:0/3840537614 >> v2:172.21.15.174:3300/0 conn(0x7f77100d3ec0 0x7f77100d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.689+0000 7f7714e97640 1 --2- 172.21.15.16:0/3840537614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100bac10 0x7f77100d3980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7700009870 tx=0x7f770002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453c0545ba0d6434 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.689+0000 7f7707fff640 1 -- 172.21.15.16:0/3840537614 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700037070 con 0x7f77100bac10 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.689+0000 7f7707fff640 1 -- 172.21.15.16:0/3840537614 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7700032440 con 0x7f77100bac10 2024-05-11T01:01:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.689+0000 7f7707fff640 1 -- 172.21.15.16:0/3840537614 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7700032810 con 0x7f77100bac10 2024-05-11T01:01:06.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.690+0000 7f77178fc640 1 -- 172.21.15.16:0/3840537614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100bac10 msgr2=0x7f77100d3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.690+0000 7f77178fc640 1 --2- 172.21.15.16:0/3840537614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100bac10 0x7f77100d3980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7700009870 tx=0x7f770002a210 comp rx=0 tx=0).stop 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.690+0000 7f77178fc640 1 -- 172.21.15.16:0/3840537614 shutdown_connections 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.690+0000 7f77178fc640 1 --2- 172.21.15.16:0/3840537614 >> v2:172.21.15.174:3300/0 conn(0x7f77100d3ec0 0x7f77100d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.690+0000 7f77178fc640 1 --2- 172.21.15.16:0/3840537614 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100bac10 0x7f77100d3980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.690+0000 7f77178fc640 1 -- 172.21.15.16:0/3840537614 >> 172.21.15.16:0/3840537614 conn(0x7f7710074140 msgr2=0x7f77100d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.690+0000 7f77178fc640 1 -- 172.21.15.16:0/3840537614 shutdown_connections 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.690+0000 7f77178fc640 1 -- 172.21.15.16:0/3840537614 wait complete. 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.691+0000 7f77178fc640 1 Processor -- start 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.691+0000 7f77178fc640 1 -- start start 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f77178fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100b6d70 0x7f771014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f77178fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77100bac10 0x7f77101609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f77178fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77100d3ec0 0x7f771015d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f77178fc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f771015f830 con 0x7f77100b6d70 2024-05-11T01:01:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f77178fc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7710163bb0 con 0x7f77100bac10 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f77178fc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7710162fc0 con 0x7f77100d3ec0 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100b6d70 0x7f771014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100b6d70 0x7f771014e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57662/0 (socket says 172.21.15.16:57662) 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 -- 172.21.15.16:0/2493980756 learned_addr learned my addr 172.21.15.16:0/2493980756 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7714e97640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77100bac10 0x7f77101609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715e99640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77100d3ec0 0x7f771015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 -- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77100d3ec0 msgr2=0x7f771015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77100d3ec0 0x7f771015d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 -- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77100bac10 msgr2=0x7f77101609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77100bac10 0x7f77101609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 -- 172.21.15.16:0/2493980756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771015fc00 con 0x7f77100b6d70 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7714e97640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77100bac10 0x7f77101609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7715698640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100b6d70 0x7f771014e690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c730 tx=0x7f770c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:06.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7705ffb640 1 -- 172.21.15.16:0/2493980756 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c003b70 con 0x7f77100b6d70 2024-05-11T01:01:06.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7705ffb640 1 -- 172.21.15.16:0/2493980756 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c003d30 con 0x7f77100b6d70 2024-05-11T01:01:06.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771015fee0 con 0x7f77100b6d70 2024-05-11T01:01:06.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.692+0000 7f7705ffb640 1 -- 172.21.15.16:0/2493980756 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c00aa90 con 0x7f77100b6d70 2024-05-11T01:01:06.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.693+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771015dc50 con 0x7f77100b6d70 2024-05-11T01:01:06.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.693+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771006a5b0 con 0x7f77100b6d70 2024-05-11T01:01:06.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.694+0000 7f7705ffb640 1 -- 172.21.15.16:0/2493980756 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f770c00ac30 con 0x7f77100b6d70 2024-05-11T01:01:06.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.694+0000 7f7705ffb640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f76f40762d0 0x7f76f4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:06.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.695+0000 7f7705ffb640 1 -- 172.21.15.16:0/2493980756 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f770c097160 con 0x7f77100b6d70 2024-05-11T01:01:06.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.695+0000 7f7714e97640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f76f40762d0 0x7f76f4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:06.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.695+0000 7f7714e97640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f76f40762d0 0x7f76f4078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7700034000 tx=0x7f770002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:06.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.699+0000 7f7705ffb640 1 -- 172.21.15.16:0/2493980756 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f770c060e10 con 0x7f77100b6d70 2024-05-11T01:01:06.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.890+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f77100b4a30 con 0x7f77100b6d70 2024-05-11T01:01:06.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.891+0000 7f7705ffb640 1 -- 172.21.15.16:0/2493980756 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f770c060710 con 0x7f77100b6d70 2024-05-11T01:01:06.892 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:06.892 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-05-11T01:01:06.892 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:06.892 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-05-11T01:01:06.892 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-05-11T01:01:06.892 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:06.893 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-05-11T01:01:06.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f76f40762d0 msgr2=0x7f76f4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f76f40762d0 0x7f76f4078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7700034000 tx=0x7f770002e000 comp rx=0 tx=0).stop 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100b6d70 msgr2=0x7f771014e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100b6d70 0x7f771014e690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c730 tx=0x7f770c00cbf0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 shutdown_connections 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f76f40762d0 0x7f76f4078790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77100d3ec0 0x7f771015d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77100bac10 0x7f77101609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 --2- 172.21.15.16:0/2493980756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77100b6d70 0x7f771014e690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 >> 172.21.15.16:0/2493980756 conn(0x7f7710074140 msgr2=0x7f77100b5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 shutdown_connections 2024-05-11T01:01:06.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:06.893+0000 7f77178fc640 1 -- 172.21.15.16:0/2493980756 wait complete. 2024-05-11T01:01:06.905 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-11T01:01:06.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-11T01:01:07.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.012+0000 7f0ab319d640 1 Processor -- start 2024-05-11T01:01:07.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.012+0000 7f0ab319d640 1 -- start start 2024-05-11T01:01:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab319d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0aac140000 0x7f0aac15e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab319d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac1403e0 0x7f0aac161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab319d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0aac161ac0 0x7f0aac0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab319d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac141570 con 0x7f0aac161ac0 2024-05-11T01:01:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab319d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac140960 con 0x7f0aac140000 2024-05-11T01:01:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab319d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac140c40 con 0x7f0aac1403e0 2024-05-11T01:01:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab173a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0aac161ac0 0x7f0aac0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab173a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0aac161ac0 0x7f0aac0b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57664/0 (socket says 172.21.15.16:57664) 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab173a640 1 -- 172.21.15.16:0/1927275504 learned_addr learned my addr 172.21.15.16:0/1927275504 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0aabfff640 1 --2- 172.21.15.16:0/1927275504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac1403e0 0x7f0aac161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab0f39640 1 --2- 172.21.15.16:0/1927275504 >> v2:172.21.15.174:3300/0 conn(0x7f0aac140000 0x7f0aac15e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab173a640 1 -- 172.21.15.16:0/1927275504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac1403e0 msgr2=0x7f0aac161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab173a640 1 --2- 172.21.15.16:0/1927275504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac1403e0 0x7f0aac161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab173a640 1 -- 172.21.15.16:0/1927275504 >> v2:172.21.15.174:3300/0 conn(0x7f0aac140000 msgr2=0x7f0aac15e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab173a640 1 --2- 172.21.15.16:0/1927275504 >> v2:172.21.15.174:3300/0 conn(0x7f0aac140000 0x7f0aac15e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab173a640 1 -- 172.21.15.16:0/1927275504 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac140f20 con 0x7f0aac161ac0 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.013+0000 7f0ab0f39640 1 --2- 172.21.15.16:0/1927275504 >> v2:172.21.15.174:3300/0 conn(0x7f0aac140000 0x7f0aac15e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.014+0000 7f0ab173a640 1 --2- 172.21.15.16:0/1927275504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac161ac0 0x7f0aac0b2ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0aac071a60 tx=0x7f0aa402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4420064814ae45a server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.014+0000 7f0aab7fe640 1 -- 172.21.15.16:0/1927275504 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4036070 con 0x7f0aac161ac0 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.014+0000 7f0aab7fe640 1 -- 172.21.15.16:0/1927275504 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa4031600 con 0x7f0aac161ac0 2024-05-11T01:01:07.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.014+0000 7f0aab7fe640 1 -- 172.21.15.16:0/1927275504 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40319d0 con 0x7f0aac161ac0 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 -- 172.21.15.16:0/1927275504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac161ac0 msgr2=0x7f0aac0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 --2- 172.21.15.16:0/1927275504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac161ac0 0x7f0aac0b2ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0aac071a60 tx=0x7f0aa402a610 comp rx=0 tx=0).stop 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 -- 172.21.15.16:0/1927275504 shutdown_connections 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 --2- 172.21.15.16:0/1927275504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac161ac0 0x7f0aac0b2ea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 --2- 172.21.15.16:0/1927275504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac1403e0 0x7f0aac161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 --2- 172.21.15.16:0/1927275504 >> v2:172.21.15.174:3300/0 conn(0x7f0aac140000 0x7f0aac15e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 -- 172.21.15.16:0/1927275504 >> 172.21.15.16:0/1927275504 conn(0x7f0aac06c5c0 msgr2=0x7f0aac06c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 -- 172.21.15.16:0/1927275504 shutdown_connections 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.015+0000 7f0ab319d640 1 -- 172.21.15.16:0/1927275504 wait complete. 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.016+0000 7f0ab319d640 1 Processor -- start 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.016+0000 7f0ab319d640 1 -- start start 2024-05-11T01:01:07.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab319d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac140000 0x7f0aac15c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab319d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac1403e0 0x7f0aac0abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab319d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aac161ac0 0x7f0aac0ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab319d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac161070 con 0x7f0aac1403e0 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab319d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac160ef0 con 0x7f0aac161ac0 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab319d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac0b33e0 con 0x7f0aac140000 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac1403e0 0x7f0aac0abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac1403e0 0x7f0aac0abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57668/0 (socket says 172.21.15.16:57668) 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 -- 172.21.15.16:0/4014243510 learned_addr learned my addr 172.21.15.16:0/4014243510 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab0f39640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac140000 0x7f0aac15c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab173a640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aac161ac0 0x7f0aac0ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 -- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac140000 msgr2=0x7f0aac15c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac140000 0x7f0aac15c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 -- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aac161ac0 msgr2=0x7f0aac0ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aac161ac0 0x7f0aac0ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 -- 172.21.15.16:0/4014243510 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac1f73f0 con 0x7f0aac1403e0 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0ab0f39640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac140000 0x7f0aac15c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aabfff640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac1403e0 0x7f0aac0abc40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800d800 tx=0x7f0a9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.017+0000 7f0aa97fa640 1 -- 172.21.15.16:0/4014243510 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800b6c0 con 0x7f0aac1403e0 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.018+0000 7f0aa97fa640 1 -- 172.21.15.16:0/4014243510 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a98019070 con 0x7f0aac1403e0 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.018+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac1f3000 con 0x7f0aac1403e0 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.018+0000 7f0aa97fa640 1 -- 172.21.15.16:0/4014243510 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800ba80 con 0x7f0aac1403e0 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.018+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac1f35c0 con 0x7f0aac1403e0 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.018+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac06a5b0 con 0x7f0aac1403e0 2024-05-11T01:01:07.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.019+0000 7f0aa97fa640 1 -- 172.21.15.16:0/4014243510 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a9800bc20 con 0x7f0aac1403e0 2024-05-11T01:01:07.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.020+0000 7f0aa97fa640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0a900762d0 0x7f0a90078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.020+0000 7f0aa97fa640 1 -- 172.21.15.16:0/4014243510 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0a98097670 con 0x7f0aac1403e0 2024-05-11T01:01:07.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.020+0000 7f0ab0f39640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0a900762d0 0x7f0a90078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.020+0000 7f0ab0f39640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0a900762d0 0x7f0a90078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0006fd0 tx=0x7f0aa0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:07.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.024+0000 7f0aa97fa640 1 -- 172.21.15.16:0/4014243510 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0a980613b0 con 0x7f0aac1403e0 2024-05-11T01:01:07.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.214+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0aac161280 con 0x7f0aac1403e0 2024-05-11T01:01:07.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.627+0000 7f0aa97fa640 1 -- 172.21.15.16:0/4014243510 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f0a98060cb0 con 0x7f0aac1403e0 2024-05-11T01:01:07.628 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0a900762d0 msgr2=0x7f0a90078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0a900762d0 0x7f0a90078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0006fd0 tx=0x7f0aa0008040 comp rx=0 tx=0).stop 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac1403e0 msgr2=0x7f0aac0abc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac1403e0 0x7f0aac0abc40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800d800 tx=0x7f0a9800dcc0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 shutdown_connections 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0a900762d0 0x7f0a90078790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0aac161ac0 0x7f0aac0ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0aac1403e0 0x7f0aac0abc40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 --2- 172.21.15.16:0/4014243510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0aac140000 0x7f0aac15c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.631+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 >> 172.21.15.16:0/4014243510 conn(0x7f0aac06c5c0 msgr2=0x7f0aac0b5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:07.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.632+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 shutdown_connections 2024-05-11T01:01:07.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.632+0000 7f0ab319d640 1 -- 172.21.15.16:0/4014243510 wait complete. 2024-05-11T01:01:07.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-11T01:01:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.763+0000 7f5efd514640 1 Processor -- start 2024-05-11T01:01:07.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.763+0000 7f5efd514640 1 -- start start 2024-05-11T01:01:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.764+0000 7f5efd514640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ef80b6290 0x7f5ef80b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.764+0000 7f5efd514640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef80d05d0 0x7f5ef80d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.764+0000 7f5efd514640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef80b6d50 con 0x7f5ef80733d0 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.764+0000 7f5efd514640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f5ef80cfaf0 con 0x7f5ef80b6290 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.764+0000 7f5efd514640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef80cfdd0 con 0x7f5ef80d05d0 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.764+0000 7f5ef6ffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5ef80733d0 0x7f5ef80737b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34068/0 (socket says 172.21.15.16:34068) 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.764+0000 7f5ef6ffd640 1 -- 172.21.15.16:0/1457612327 learned_addr learned my addr 172.21.15.16:0/1457612327 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548190841 0 0) 0x7f5ef80b6d50 con 0x7f5ef80733d0 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ee4003520 con 0x7f5ef80733d0 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef77fe640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef80d05d0 0x7f5ef80d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef67fc640 1 --2- 172.21.15.16:0/1457612327 >> v2:172.21.15.174:3300/0 conn(0x7f5ef80b6290 0x7f5ef80b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2983098773 0 0) 0x7f5ee4003520 con 0x7f5ef80733d0 2024-05-11T01:01:07.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef80d05d0 msgr2=0x7f5ef80d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef80d05d0 0x7f5ef80d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 >> v2:172.21.15.174:3300/0 conn(0x7f5ef80b6290 msgr2=0x7f5ef80b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 --2- 172.21.15.16:0/1457612327 >> v2:172.21.15.174:3300/0 conn(0x7f5ef80b6290 0x7f5ef80b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef80d00b0 con 0x7f5ef80733d0 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f5ef00016f0 con 0x7f5ef80733d0 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 >> v1:172.21.15.16:6789/0 conn(0x7f5ef80733d0 legacy=0x7f5ef80737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4003a00 0x7f5ee4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ee4004800 0x7f5ee4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef80d05d0 0x7f5ee40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef80cfaf0 con 0x7f5ee4004800 2024-05-11T01:01:07.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef80cfdd0 con 0x7f5ee4003a00 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee400b9f0 con 0x7f5ef80d05d0 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef67fc640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ee4004800 0x7f5ee4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef6ffd640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4003a00 0x7f5ee4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef77fe640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef80d05d0 0x7f5ee40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef67fc640 1 -- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef80d05d0 msgr2=0x7f5ee40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef67fc640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef80d05d0 0x7f5ee40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef67fc640 1 -- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4003a00 msgr2=0x7f5ee4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef67fc640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4003a00 0x7f5ee4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.765+0000 7f5ef67fc640 1 -- 172.21.15.16:0/1457612327 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee4003520 con 0x7f5ee4004800 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.766+0000 7f5ef67fc640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ee4004800 0x7f5ee4004c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009650 tx=0x7f5ee4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fae56273e80d25 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.766+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0038070 con 0x7f5ee4004800 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.766+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee0033400 con 0x7f5ee4004800 2024-05-11T01:01:07.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.766+0000 7f5ef5ffb640 1 -- 172.21.15.16:0/1457612327 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0009690 con 0x7f5ee4004800 2024-05-11T01:01:07.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.767+0000 7f5efd514640 1 -- 172.21.15.16:0/1457612327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ee4004800 msgr2=0x7f5ee4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.767+0000 7f5efd514640 1 --2- 172.21.15.16:0/1457612327 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ee4004800 0x7f5ee4004c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009650 tx=0x7f5ee4005830 comp rx=0 tx=0).stop 2024-05-11T01:01:07.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.767+0000 7f5ef77fe640 1 -- 172.21.15.16:0/1457612327 reap_dead start 2024-05-11T01:01:07.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.767+0000 7f5efd514640 1 -- 172.21.15.16:0/1457612327 shutdown_connections 2024-05-11T01:01:07.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.767+0000 7f5efd514640 1 -- 172.21.15.16:0/1457612327 >> 172.21.15.16:0/1457612327 conn(0x7f5ef80b3c70 msgr2=0x7f5ef80b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:07.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.767+0000 7f5efd514640 1 -- 172.21.15.16:0/1457612327 shutdown_connections 2024-05-11T01:01:07.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.767+0000 7f5efd514640 1 -- 172.21.15.16:0/1457612327 wait complete. 2024-05-11T01:01:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.768+0000 7f5efd514640 1 Processor -- start 2024-05-11T01:01:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.768+0000 7f5efd514640 1 -- start start 2024-05-11T01:01:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5efd514640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4004800 0x7f5ef815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5efd514640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef81f0c00 0x7f5ef815c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5efd514640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef815e8d0 0x7f5ef815ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5efd514640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef8146030 con 0x7f5ef81f0c00 2024-05-11T01:01:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5efd514640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef80cf7a0 con 0x7f5ee4004800 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5efd514640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef81461b0 con 0x7f5ef815e8d0 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef81f0c00 0x7f5ef815c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef81f0c00 0x7f5ef815c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57690/0 (socket says 172.21.15.16:57690) 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 -- 172.21.15.16:0/478205555 learned_addr learned my addr 172.21.15.16:0/478205555 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef77fe640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef815e8d0 0x7f5ef815ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef6ffd640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4004800 0x7f5ef815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 -- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef815e8d0 msgr2=0x7f5ef815ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef815e8d0 0x7f5ef815ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 -- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4004800 msgr2=0x7f5ef815bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4004800 0x7f5ef815bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 -- 172.21.15.16:0/478205555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef815e260 con 0x7f5ef81f0c00 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef77fe640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef815e8d0 0x7f5ef815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef6ffd640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4004800 0x7f5ef815bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.769+0000 7f5ef67fc640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef81f0c00 0x7f5ef815c8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009bb0 tx=0x7f5ee0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.770+0000 7f5eef7fe640 1 -- 172.21.15.16:0/478205555 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0043020 con 0x7f5ef81f0c00 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.770+0000 7f5eef7fe640 1 -- 172.21.15.16:0/478205555 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee003e470 con 0x7f5ef81f0c00 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.770+0000 7f5eef7fe640 1 -- 172.21.15.16:0/478205555 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0038040 con 0x7f5ef81f0c00 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.770+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef815d1c0 con 0x7f5ef81f0c00 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.770+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef815d780 con 0x7f5ef81f0c00 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.771+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef806a5b0 con 0x7f5ef81f0c00 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.771+0000 7f5eef7fe640 1 -- 172.21.15.16:0/478205555 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5ee0046020 con 0x7f5ef81f0c00 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.772+0000 7f5eef7fe640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5ed80762d0 0x7f5ed8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.772+0000 7f5eef7fe640 1 -- 172.21.15.16:0/478205555 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f5ee00b9890 con 0x7f5ef81f0c00 2024-05-11T01:01:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.772+0000 7f5ef6ffd640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5ed80762d0 0x7f5ed8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.772+0000 7f5ef6ffd640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5ed80762d0 0x7f5ed8078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0007cd0 tx=0x7f5ef0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.776+0000 7f5eef7fe640 1 -- 172.21.15.16:0/478205555 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5ee004d070 con 0x7f5ef81f0c00 2024-05-11T01:01:07.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:07.967+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5ef80700c0 con 0x7f5ef81f0c00 2024-05-11T01:01:08.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.633+0000 7f5eef7fe640 1 -- 172.21.15.16:0/478205555 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f5ee0083340 con 0x7f5ef81f0c00 2024-05-11T01:01:08.634 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-05-11T01:01:08.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5ed80762d0 msgr2=0x7f5ed8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:08.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5ed80762d0 0x7f5ed8078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0007cd0 tx=0x7f5ef0009040 comp rx=0 tx=0).stop 2024-05-11T01:01:08.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef81f0c00 msgr2=0x7f5ef815c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:08.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef81f0c00 0x7f5ef815c8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009bb0 tx=0x7f5ee0004730 comp rx=0 tx=0).stop 2024-05-11T01:01:08.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 shutdown_connections 2024-05-11T01:01:08.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5ed80762d0 0x7f5ed8078790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:08.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef815e8d0 0x7f5ef815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:08.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef81f0c00 0x7f5ef815c8c0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0009bb0 tx=0x7f5ee0004730 comp rx=0 tx=0).stop 2024-05-11T01:01:08.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.636+0000 7f5efd514640 1 --2- 172.21.15.16:0/478205555 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ee4004800 0x7f5ef815bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:08.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.637+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 >> 172.21.15.16:0/478205555 conn(0x7f5ef80b3c70 msgr2=0x7f5ef806f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:08.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.637+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 shutdown_connections 2024-05-11T01:01:08.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.637+0000 7f5efd514640 1 -- 172.21.15.16:0/478205555 wait complete. 2024-05-11T01:01:08.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-11T01:01:08.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.777+0000 7fde2b6cc640 1 Processor -- start 2024-05-11T01:01:08.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.777+0000 7fde2b6cc640 1 -- start start 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.778+0000 7fde2b6cc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fde2416c760 0x7fde240b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.778+0000 7fde2b6cc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fde2406f6b0 0x7fde2406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.778+0000 7fde2b6cc640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde24073e60 con 0x7fde2416c380 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.778+0000 7fde2b6cc640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fde24070040 con 0x7fde2406f6b0 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.778+0000 7fde2b6cc640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fde24074140 con 0x7fde2416c760 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.778+0000 7fde29c69640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fde2406f6b0 0x7fde2406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.778+0000 7fde29c69640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fde2406f6b0 0x7fde2406fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57700/0 (socket says 172.21.15.16:57700) 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.778+0000 7fde29c69640 1 -- 172.21.15.16:0/3350952455 learned_addr learned my addr 172.21.15.16:0/3350952455 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.779+0000 7fde23fff640 1 -- 172.21.15.16:0/3350952455 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466478764 0 0) 0x7fde24073e60 con 0x7fde2416c380 2024-05-11T01:01:08.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.779+0000 7fde28c67640 1 --2- 172.21.15.16:0/3350952455 >> v2:172.21.15.174:3300/0 conn(0x7fde2416c760 0x7fde240b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:08.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.804+0000 7fde23fff640 1 -- 172.21.15.16:0/3350952455 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde0c003500 con 0x7fde2416c380 2024-05-11T01:01:08.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.804+0000 7fde29c69640 1 -- 172.21.15.16:0/3350952455 >> v2:172.21.15.174:3300/0 conn(0x7fde2416c760 msgr2=0x7fde240b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:08.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.804+0000 7fde29c69640 1 --2- 172.21.15.16:0/3350952455 >> v2:172.21.15.174:3300/0 conn(0x7fde2416c760 0x7fde240b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:08.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.804+0000 7fde29c69640 1 -- 172.21.15.16:0/3350952455 >> v1:172.21.15.174:6789/0 conn(0x7fde2416c380 legacy=0x7fde240735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:08.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.804+0000 7fde29c69640 1 -- 172.21.15.16:0/3350952455 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde24074420 con 0x7fde2406f6b0 2024-05-11T01:01:08.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.805+0000 7fde29c69640 1 --2- 172.21.15.16:0/3350952455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2406f6b0 0x7fde2406fb00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde2406f400 tx=0x7fde1400a820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707e321d18210f04 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.805+0000 7fde23fff640 1 -- 172.21.15.16:0/3350952455 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14031640 con 0x7fde2406f6b0 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.805+0000 7fde23fff640 1 -- 172.21.15.16:0/3350952455 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde140317e0 con 0x7fde2406f6b0 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.805+0000 7fde23fff640 1 -- 172.21.15.16:0/3350952455 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14031b90 con 0x7fde2406f6b0 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.806+0000 7fde2b6cc640 1 -- 172.21.15.16:0/3350952455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2406f6b0 msgr2=0x7fde2406fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.806+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/3350952455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2406f6b0 0x7fde2406fb00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde2406f400 tx=0x7fde1400a820 comp rx=0 tx=0).stop 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.806+0000 7fde2b6cc640 1 -- 172.21.15.16:0/3350952455 shutdown_connections 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.806+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/3350952455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2406f6b0 0x7fde2406fb00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.806+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/3350952455 >> v2:172.21.15.174:3300/0 conn(0x7fde2416c760 0x7fde240b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.806+0000 7fde2b6cc640 1 -- 172.21.15.16:0/3350952455 >> 172.21.15.16:0/3350952455 conn(0x7fde240b2c60 msgr2=0x7fde240b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.806+0000 7fde2b6cc640 1 -- 172.21.15.16:0/3350952455 shutdown_connections 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.806+0000 7fde2b6cc640 1 -- 172.21.15.16:0/3350952455 wait complete. 2024-05-11T01:01:08.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.807+0000 7fde2b6cc640 1 Processor -- start 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.807+0000 7fde2b6cc640 1 -- start start 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde2b6cc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde2406f6b0 0x7fde24161d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde2b6cc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2416c380 0x7fde240abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde2b6cc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde2416c760 0x7fde240ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde2b6cc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fde2416d280 con 0x7fde2416c380 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde2b6cc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fde2416d100 con 0x7fde2416c760 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde2b6cc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fde2416d400 con 0x7fde2406f6b0 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2416c380 0x7fde240abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2416c380 0x7fde240abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57716/0 (socket says 172.21.15.16:57716) 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 -- 172.21.15.16:0/2477544617 learned_addr learned my addr 172.21.15.16:0/2477544617 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde29c69640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde2416c760 0x7fde240ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde29468640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde2406f6b0 0x7fde24161d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 -- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde2406f6b0 msgr2=0x7fde24161d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:08.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde2406f6b0 0x7fde24161d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 -- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde2416c760 msgr2=0x7fde240ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde2416c760 0x7fde240ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 -- 172.21.15.16:0/2477544617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde24162250 con 0x7fde2416c380 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde29c69640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde2416c760 0x7fde240ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde29468640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde2406f6b0 0x7fde24161d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde28c67640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2416c380 0x7fde240abd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde1800e870 tx=0x7fde1800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde21ffb640 1 -- 172.21.15.16:0/2477544617 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18017070 con 0x7fde2416c380 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde21ffb640 1 -- 172.21.15.16:0/2477544617 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1800c940 con 0x7fde2416c380 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde24164250 con 0x7fde2416c380 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.808+0000 7fde21ffb640 1 -- 172.21.15.16:0/2477544617 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1800cd30 con 0x7fde2416c380 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.809+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde24164810 con 0x7fde2416c380 2024-05-11T01:01:08.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.810+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde2406a5b0 con 0x7fde2416c380 2024-05-11T01:01:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.810+0000 7fde21ffb640 1 -- 172.21.15.16:0/2477544617 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde1801a070 con 0x7fde2416c380 2024-05-11T01:01:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.811+0000 7fde21ffb640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fde100762d0 0x7fde10078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.811+0000 7fde21ffb640 1 -- 172.21.15.16:0/2477544617 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fde180973d0 con 0x7fde2416c380 2024-05-11T01:01:08.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.811+0000 7fde29468640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fde100762d0 0x7fde10078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:08.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.812+0000 7fde29468640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fde100762d0 0x7fde10078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fde24204f10 tx=0x7fde1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:08.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:08.816+0000 7fde21ffb640 1 -- 172.21.15.16:0/2477544617 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde18060e20 con 0x7fde2416c380 2024-05-11T01:01:09.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.044+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fde240b44e0 con 0x7fde2416c380 2024-05-11T01:01:09.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.634+0000 7fde21ffb640 1 -- 172.21.15.16:0/2477544617 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fde18060720 con 0x7fde2416c380 2024-05-11T01:01:09.636 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2024-05-11T01:01:09.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.639+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fde100762d0 msgr2=0x7fde10078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:09.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.639+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fde100762d0 0x7fde10078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fde24204f10 tx=0x7fde1c009040 comp rx=0 tx=0).stop 2024-05-11T01:01:09.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.639+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2416c380 msgr2=0x7fde240abd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:09.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.639+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2416c380 0x7fde240abd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde1800e870 tx=0x7fde1800ed30 comp rx=0 tx=0).stop 2024-05-11T01:01:09.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.640+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 shutdown_connections 2024-05-11T01:01:09.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.640+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fde100762d0 0x7fde10078790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.640+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde2416c760 0x7fde240ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.640+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde2416c380 0x7fde240abd50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.640+0000 7fde2b6cc640 1 --2- 172.21.15.16:0/2477544617 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fde2406f6b0 0x7fde24161d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.640+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 >> 172.21.15.16:0/2477544617 conn(0x7fde240b2c60 msgr2=0x7fde240735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:09.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.641+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 shutdown_connections 2024-05-11T01:01:09.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.646+0000 7fde2b6cc640 1 -- 172.21.15.16:0/2477544617 wait complete. 2024-05-11T01:01:09.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:09.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.787+0000 7f42b1efc640 1 Processor -- start 2024-05-11T01:01:09.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.787+0000 7f42b1efc640 1 -- start start 2024-05-11T01:01:09.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.787+0000 7f42b1efc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42ac0d0000 0x7f42ac0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.787+0000 7f42b1efc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f42ac0baed0 0x7f42ac162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.787+0000 7f42b1efc640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac0d0920 con 0x7f42ac06d3e0 2024-05-11T01:01:09.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.787+0000 7f42b1efc640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f42ac163820 con 0x7f42ac0baed0 2024-05-11T01:01:09.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.787+0000 7f42b1efc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac163b00 con 0x7f42ac0d0000 2024-05-11T01:01:09.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42abfff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f42ac06d3e0 0x7f42ac06d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34076/0 (socket says 172.21.15.16:34076) 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42abfff640 1 -- 172.21.15.16:0/3349052112 learned_addr learned my addr 172.21.15.16:0/3349052112 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aaffd640 1 --2- 172.21.15.16:0/3349052112 >> v2:172.21.15.174:3300/0 conn(0x7f42ac0baed0 0x7f42ac162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42ab7fe640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42ac0d0000 0x7f42ac0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081262771 0 0) 0x7f42ac0d0920 con 0x7f42ac06d3e0 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4298003520 con 0x7f42ac06d3e0 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1281460960 0 0) 0x7f4298003520 con 0x7f42ac06d3e0 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42ac0d0000 msgr2=0x7f42ac0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42ac0d0000 0x7f42ac0d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 >> v2:172.21.15.174:3300/0 conn(0x7f42ac0baed0 msgr2=0x7f42ac162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 --2- 172.21.15.16:0/3349052112 >> v2:172.21.15.174:3300/0 conn(0x7f42ac0baed0 0x7f42ac162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac0d33f0 con 0x7f42ac06d3e0 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f42a4001a70 con 0x7f42ac06d3e0 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 >> v1:172.21.15.16:6789/0 conn(0x7f42ac06d3e0 legacy=0x7f42ac06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42ac0d0000 0x7f4298003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4298003fd0 0x7f4298004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298004d40 0x7f42980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac163820 con 0x7f4298003fd0 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac163b00 con 0x7f4298004d40 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f429800ba10 con 0x7f42ac0d0000 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42aaffd640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4298003fd0 0x7f4298004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42ab7fe640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42ac0d0000 0x7f4298003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.788+0000 7f42abfff640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298004d40 0x7f42980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aaffd640 1 -- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42ac0d0000 msgr2=0x7f4298003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:09.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aaffd640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42ac0d0000 0x7f4298003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aaffd640 1 -- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298004d40 msgr2=0x7f42980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aaffd640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4298004d40 0x7f42980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aaffd640 1 -- 172.21.15.16:0/3349052112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4298003520 con 0x7f4298003fd0 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aaffd640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4298003fd0 0x7f4298004800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4294009af0 tx=0x7f4298005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a77f69ec9e5c25 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294036070 con 0x7f4298003fd0 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4294031400 con 0x7f4298003fd0 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.789+0000 7f42aa7fc640 1 -- 172.21.15.16:0/3349052112 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294009690 con 0x7f4298003fd0 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.790+0000 7f42b1efc640 1 -- 172.21.15.16:0/3349052112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4298003fd0 msgr2=0x7f4298004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.790+0000 7f42b1efc640 1 --2- 172.21.15.16:0/3349052112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4298003fd0 0x7f4298004800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4294009af0 tx=0x7f4298005830 comp rx=0 tx=0).stop 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.790+0000 7f42abfff640 1 -- 172.21.15.16:0/3349052112 reap_dead start 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.790+0000 7f42b1efc640 1 -- 172.21.15.16:0/3349052112 shutdown_connections 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.790+0000 7f42b1efc640 1 -- 172.21.15.16:0/3349052112 >> 172.21.15.16:0/3349052112 conn(0x7f42ac074140 msgr2=0x7f42ac0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.790+0000 7f42b1efc640 1 -- 172.21.15.16:0/3349052112 shutdown_connections 2024-05-11T01:01:09.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.790+0000 7f42b1efc640 1 -- 172.21.15.16:0/3349052112 wait complete. 2024-05-11T01:01:09.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.791+0000 7f42b1efc640 1 Processor -- start 2024-05-11T01:01:09.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.791+0000 7f42b1efc640 1 -- start start 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42b1efc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4298003fd0 0x7f42ac14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42b1efc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42ac0cee50 0x7f42ac15fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42b1efc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42ac156a30 0x7f42ac156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42b1efc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac163de0 con 0x7f42ac0cee50 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42b1efc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac163510 con 0x7f42ac156a30 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42b1efc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac15f750 con 0x7f4298003fd0 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42aaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42ac0cee50 0x7f42ac15fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42aaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42ac0cee50 0x7f42ac15fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57728/0 (socket says 172.21.15.16:57728) 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42aaffd640 1 -- 172.21.15.16:0/3282561461 learned_addr learned my addr 172.21.15.16:0/3282561461 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:09.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42abfff640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42ac156a30 0x7f42ac156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.792+0000 7f42ab7fe640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4298003fd0 0x7f42ac14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42aaffd640 1 -- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4298003fd0 msgr2=0x7f42ac14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42aaffd640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4298003fd0 0x7f42ac14fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42aaffd640 1 -- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42ac156a30 msgr2=0x7f42ac156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42aaffd640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42ac156a30 0x7f42ac156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42aaffd640 1 -- 172.21.15.16:0/3282561461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac1573f0 con 0x7f42ac0cee50 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42aaffd640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42ac0cee50 0x7f42ac15fa10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f429402ac10 tx=0x7f4294004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42a3fff640 1 -- 172.21.15.16:0/3282561461 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294040020 con 0x7f42ac0cee50 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42a3fff640 1 -- 172.21.15.16:0/3282561461 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4294003830 con 0x7f42ac0cee50 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac155c70 con 0x7f42ac0cee50 2024-05-11T01:01:09.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42a3fff640 1 -- 172.21.15.16:0/3282561461 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294036040 con 0x7f42ac0cee50 2024-05-11T01:01:09.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.793+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac156230 con 0x7f42ac0cee50 2024-05-11T01:01:09.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.794+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ac06a5b0 con 0x7f42ac0cee50 2024-05-11T01:01:09.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.794+0000 7f42a3fff640 1 -- 172.21.15.16:0/3282561461 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4294043020 con 0x7f42ac0cee50 2024-05-11T01:01:09.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.795+0000 7f42a3fff640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f428c0762d0 0x7f428c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:09.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.795+0000 7f42a3fff640 1 -- 172.21.15.16:0/3282561461 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f42940b7860 con 0x7f42ac0cee50 2024-05-11T01:01:09.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.795+0000 7f42ab7fe640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f428c0762d0 0x7f428c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:09.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.796+0000 7f42ab7fe640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f428c0762d0 0x7f428c078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f429c009a20 tx=0x7f429c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:09.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.799+0000 7f42a3fff640 1 -- 172.21.15.16:0/3282561461 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f429404a030 con 0x7f42ac0cee50 2024-05-11T01:01:09.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.992+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42ac0d4f00 con 0x7f42ac0cee50 2024-05-11T01:01:09.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.993+0000 7f42a3fff640 1 -- 172.21.15.16:0/3282561461 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7f42940b7090 con 0x7f42ac0cee50 2024-05-11T01:01:09.994 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:09.994 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:09.046407+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:09.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f428c0762d0 msgr2=0x7f428c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f428c0762d0 0x7f428c078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f429c009a20 tx=0x7f429c008040 comp rx=0 tx=0).stop 2024-05-11T01:01:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42ac0cee50 msgr2=0x7f42ac15fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42ac0cee50 0x7f42ac15fa10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f429402ac10 tx=0x7f4294004730 comp rx=0 tx=0).stop 2024-05-11T01:01:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 shutdown_connections 2024-05-11T01:01:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f428c0762d0 0x7f428c078790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42ac156a30 0x7f42ac156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42ac0cee50 0x7f42ac15fa10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 --2- 172.21.15.16:0/3282561461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4298003fd0 0x7f42ac14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:09.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 >> 172.21.15.16:0/3282561461 conn(0x7f42ac074140 msgr2=0x7f42ac0b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:09.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 shutdown_connections 2024-05-11T01:01:09.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:09.995+0000 7f42b1efc640 1 -- 172.21.15.16:0/3282561461 wait complete. 2024-05-11T01:01:10.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:10.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.111+0000 7fb25bee1640 1 Processor -- start 2024-05-11T01:01:10.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.111+0000 7fb25bee1640 1 -- start start 2024-05-11T01:01:10.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25bee1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2540d0d40 0x7fb2540b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25bee1640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2540d1770 con 0x7fb2540d11f0 2024-05-11T01:01:10.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25bee1640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb254163300 con 0x7fb254160360 2024-05-11T01:01:10.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25bee1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb2541635e0 con 0x7fb2540d0d40 2024-05-11T01:01:10.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25947c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2540d0d40 0x7fb2540b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25a47e640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb2540d11f0 0x7fb2540d2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34078/0 (socket says 172.21.15.16:34078) 2024-05-11T01:01:10.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25a47e640 1 -- 172.21.15.16:0/2951918114 learned_addr learned my addr 172.21.15.16:0/2951918114 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:10.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25947c640 1 -- 172.21.15.16:0/2951918114 >> v1:172.21.15.174:6789/0 conn(0x7fb254160360 legacy=0x7fb254160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25947c640 1 -- 172.21.15.16:0/2951918114 >> v1:172.21.15.16:6789/0 conn(0x7fb2540d11f0 legacy=0x7fb2540d2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb25947c640 1 -- 172.21.15.16:0/2951918114 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2541638c0 con 0x7fb2540d0d40 2024-05-11T01:01:10.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.112+0000 7fb258c7b640 1 -- 172.21.15.16:0/2951918114 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060551343 0 0) 0x7fb2540d1770 con 0x7fb2540d11f0 2024-05-11T01:01:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.113+0000 7fb25947c640 1 --2- 172.21.15.16:0/2951918114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d0d40 0x7fb2540b4cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb2440097a0 tx=0x7fb24402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ad75b3af5f7e06 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.113+0000 7fb258c7b640 1 -- 172.21.15.16:0/2951918114 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244037070 con 0x7fb2540d0d40 2024-05-11T01:01:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.113+0000 7fb258c7b640 1 -- 172.21.15.16:0/2951918114 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb244032440 con 0x7fb2540d0d40 2024-05-11T01:01:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.113+0000 7fb258c7b640 1 -- 172.21.15.16:0/2951918114 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244032810 con 0x7fb2540d0d40 2024-05-11T01:01:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.114+0000 7fb25bee1640 1 -- 172.21.15.16:0/2951918114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d0d40 msgr2=0x7fb2540b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.114+0000 7fb25bee1640 1 --2- 172.21.15.16:0/2951918114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d0d40 0x7fb2540b4cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb2440097a0 tx=0x7fb24402a230 comp rx=0 tx=0).stop 2024-05-11T01:01:10.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.114+0000 7fb25bee1640 1 -- 172.21.15.16:0/2951918114 shutdown_connections 2024-05-11T01:01:10.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.114+0000 7fb25bee1640 1 --2- 172.21.15.16:0/2951918114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d0d40 0x7fb2540b4cf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.114+0000 7fb25bee1640 1 -- 172.21.15.16:0/2951918114 >> 172.21.15.16:0/2951918114 conn(0x7fb2540681c0 msgr2=0x7fb2540685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:10.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.114+0000 7fb25bee1640 1 -- 172.21.15.16:0/2951918114 shutdown_connections 2024-05-11T01:01:10.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.114+0000 7fb25bee1640 1 -- 172.21.15.16:0/2951918114 wait complete. 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.115+0000 7fb25bee1640 1 Processor -- start 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.115+0000 7fb25bee1640 1 -- start start 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25bee1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2540d0d40 0x7fb2540cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25bee1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d11f0 0x7fb2541eb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25bee1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254160360 0x7fb2541eb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25bee1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb2541640c0 con 0x7fb2540d11f0 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25bee1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb2540b5230 con 0x7fb254160360 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25bee1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb2540cc420 con 0x7fb2540d0d40 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d11f0 0x7fb2541eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d11f0 0x7fb2541eb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57736/0 (socket says 172.21.15.16:57736) 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 -- 172.21.15.16:0/2910933113 learned_addr learned my addr 172.21.15.16:0/2910933113 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb259c7d640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2540d0d40 0x7fb2540cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25a47e640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254160360 0x7fb2541eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 -- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2540d0d40 msgr2=0x7fb2540cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2540d0d40 0x7fb2540cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 -- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254160360 msgr2=0x7fb2541eb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254160360 0x7fb2541eb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 -- 172.21.15.16:0/2910933113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2540cc700 con 0x7fb2540d11f0 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb259c7d640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2540d0d40 0x7fb2540cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb25947c640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d11f0 0x7fb2541eb330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb244000c00 tx=0x7fb2440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.116+0000 7fb24a7fc640 1 -- 172.21.15.16:0/2910933113 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244037040 con 0x7fb2540d11f0 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.117+0000 7fb24a7fc640 1 -- 172.21.15.16:0/2910933113 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb244042070 con 0x7fb2540d11f0 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.117+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2540cc9e0 con 0x7fb2540d11f0 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.117+0000 7fb24a7fc640 1 -- 172.21.15.16:0/2910933113 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244030a70 con 0x7fb2540d11f0 2024-05-11T01:01:10.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.117+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2540cc110 con 0x7fb2540d11f0 2024-05-11T01:01:10.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.118+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25406a5b0 con 0x7fb2540d11f0 2024-05-11T01:01:10.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.118+0000 7fb24a7fc640 1 -- 172.21.15.16:0/2910933113 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb244030c10 con 0x7fb2540d11f0 2024-05-11T01:01:10.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.119+0000 7fb24a7fc640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fb2380762d0 0x7fb238078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.119+0000 7fb24a7fc640 1 -- 172.21.15.16:0/2910933113 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fb2440b7fa0 con 0x7fb2540d11f0 2024-05-11T01:01:10.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.119+0000 7fb259c7d640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fb2380762d0 0x7fb238078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.119+0000 7fb259c7d640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fb2380762d0 0x7fb238078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb250007fd0 tx=0x7fb250009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:10.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.123+0000 7fb24a7fc640 1 -- 172.21.15.16:0/2910933113 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb244081990 con 0x7fb2540d11f0 2024-05-11T01:01:10.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.315+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb254164240 con 0x7fb2540d11f0 2024-05-11T01:01:10.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.316+0000 7fb24a7fc640 1 -- 172.21.15.16:0/2910933113 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7fb244081290 con 0x7fb2540d11f0 2024-05-11T01:01:10.317 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:10.317 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:09.046407+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:10.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fb2380762d0 msgr2=0x7fb238078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fb2380762d0 0x7fb238078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb250007fd0 tx=0x7fb250009040 comp rx=0 tx=0).stop 2024-05-11T01:01:10.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d11f0 msgr2=0x7fb2541eb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d11f0 0x7fb2541eb330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb244000c00 tx=0x7fb2440046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 shutdown_connections 2024-05-11T01:01:10.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fb2380762d0 0x7fb238078790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb254160360 0x7fb2541eb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2540d11f0 0x7fb2541eb330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 --2- 172.21.15.16:0/2910933113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb2540d0d40 0x7fb2540cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 >> 172.21.15.16:0/2910933113 conn(0x7fb2540681c0 msgr2=0x7fb2541623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:10.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 shutdown_connections 2024-05-11T01:01:10.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.318+0000 7fb25bee1640 1 -- 172.21.15.16:0/2910933113 wait complete. 2024-05-11T01:01:10.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-11T01:01:10.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.435+0000 7f3f6415f640 1 Processor -- start 2024-05-11T01:01:10.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.436+0000 7f3f6415f640 1 -- start start 2024-05-11T01:01:10.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.436+0000 7f3f6415f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3f5c0d4580 0x7f3f5c06d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.436+0000 7f3f6415f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3f5c06dda0 0x7f3f5c0b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.436+0000 7f3f6415f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f5c0bb2b0 con 0x7f3f5c15f560 2024-05-11T01:01:10.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f6415f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3f5c06e210 con 0x7f3f5c06dda0 2024-05-11T01:01:10.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f6415f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3f5c0d49e0 con 0x7f3f5c0d4580 2024-05-11T01:01:10.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f626fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3f5c06dda0 0x7f3f5c0b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f61efb640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3f5c15f560 0x7f3f5c0baba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34088/0 (socket says 172.21.15.16:34088) 2024-05-11T01:01:10.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f61efb640 1 -- 172.21.15.16:0/2128136786 learned_addr learned my addr 172.21.15.16:0/2128136786 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:10.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f616fa640 1 --2- 172.21.15.16:0/2128136786 >> v2:172.21.15.174:3300/0 conn(0x7f3f5c0d4580 0x7f3f5c06d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f626fc640 1 -- 172.21.15.16:0/2128136786 >> v2:172.21.15.174:3300/0 conn(0x7f3f5c0d4580 msgr2=0x7f3f5c06d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:10.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f626fc640 1 --2- 172.21.15.16:0/2128136786 >> v2:172.21.15.174:3300/0 conn(0x7f3f5c0d4580 0x7f3f5c06d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f626fc640 1 -- 172.21.15.16:0/2128136786 >> v1:172.21.15.16:6789/0 conn(0x7f3f5c15f560 legacy=0x7f3f5c0baba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f626fc640 1 -- 172.21.15.16:0/2128136786 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5c0d34e0 con 0x7f3f5c06dda0 2024-05-11T01:01:10.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.437+0000 7f3f616fa640 1 --2- 172.21.15.16:0/2128136786 >> v2:172.21.15.174:3300/0 conn(0x7f3f5c0d4580 0x7f3f5c06d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:10.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f626fc640 1 --2- 172.21.15.16:0/2128136786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c06dda0 0x7f3f5c0b83b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0d2ba0 tx=0x7f3f5402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b506623698b396 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:10.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f60ef9640 1 -- 172.21.15.16:0/2128136786 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54007740 con 0x7f3f5c06dda0 2024-05-11T01:01:10.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f60ef9640 1 -- 172.21.15.16:0/2128136786 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f540078e0 con 0x7f3f5c06dda0 2024-05-11T01:01:10.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f60ef9640 1 -- 172.21.15.16:0/2128136786 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54007cb0 con 0x7f3f5c06dda0 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f6415f640 1 -- 172.21.15.16:0/2128136786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c06dda0 msgr2=0x7f3f5c0b83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f6415f640 1 --2- 172.21.15.16:0/2128136786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c06dda0 0x7f3f5c0b83b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0d2ba0 tx=0x7f3f5402a680 comp rx=0 tx=0).stop 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f6415f640 1 -- 172.21.15.16:0/2128136786 shutdown_connections 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f6415f640 1 --2- 172.21.15.16:0/2128136786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c06dda0 0x7f3f5c0b83b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f6415f640 1 --2- 172.21.15.16:0/2128136786 >> v2:172.21.15.174:3300/0 conn(0x7f3f5c0d4580 0x7f3f5c06d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f6415f640 1 -- 172.21.15.16:0/2128136786 >> 172.21.15.16:0/2128136786 conn(0x7f3f5c073f00 msgr2=0x7f3f5c074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f6415f640 1 -- 172.21.15.16:0/2128136786 shutdown_connections 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.438+0000 7f3f6415f640 1 -- 172.21.15.16:0/2128136786 wait complete. 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f6415f640 1 Processor -- start 2024-05-11T01:01:10.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f6415f640 1 -- start start 2024-05-11T01:01:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f6415f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c06dda0 0x7f3f5c0b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f6415f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c0d4580 0x7f3f5c0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f6415f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15f560 0x7f3f5c0b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f6415f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0d3d80 con 0x7f3f5c0d4580 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f6415f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0d3aa0 con 0x7f3f5c15f560 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f6415f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5c0d4060 con 0x7f3f5c06dda0 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f616fa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c0d4580 0x7f3f5c0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f616fa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c0d4580 0x7f3f5c0b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57762/0 (socket says 172.21.15.16:57762) 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.440+0000 7f3f616fa640 1 -- 172.21.15.16:0/1275211261 learned_addr learned my addr 172.21.15.16:0/1275211261 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f626fc640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15f560 0x7f3f5c0b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f616fa640 1 -- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c06dda0 msgr2=0x7f3f5c0b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f616fa640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c06dda0 0x7f3f5c0b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f616fa640 1 -- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15f560 msgr2=0x7f3f5c0b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f616fa640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15f560 0x7f3f5c0b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f616fa640 1 -- 172.21.15.16:0/1275211261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5c1e7f10 con 0x7f3f5c0d4580 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f616fa640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c0d4580 0x7f3f5c0b5e20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00e730 tx=0x7f3f4c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:10.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f527fc640 1 -- 172.21.15.16:0/1275211261 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00f040 con 0x7f3f5c0d4580 2024-05-11T01:01:10.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f527fc640 1 -- 172.21.15.16:0/1275211261 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f4c004230 con 0x7f3f5c0d4580 2024-05-11T01:01:10.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5c0b6990 con 0x7f3f5c0d4580 2024-05-11T01:01:10.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f527fc640 1 -- 172.21.15.16:0/1275211261 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00ee40 con 0x7f3f5c0d4580 2024-05-11T01:01:10.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.441+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f5c0b6f50 con 0x7f3f5c0d4580 2024-05-11T01:01:10.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.442+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5c075dc0 con 0x7f3f5c0d4580 2024-05-11T01:01:10.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.443+0000 7f3f527fc640 1 -- 172.21.15.16:0/1275211261 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f4c00c6d0 con 0x7f3f5c0d4580 2024-05-11T01:01:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.443+0000 7f3f527fc640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f400762d0 0x7f3f40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.443+0000 7f3f527fc640 1 -- 172.21.15.16:0/1275211261 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f3f4c0972e0 con 0x7f3f5c0d4580 2024-05-11T01:01:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.443+0000 7f3f61efb640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f400762d0 0x7f3f40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.444+0000 7f3f61efb640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f400762d0 0x7f3f40078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3f58001540 tx=0x7f3f58007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:10.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.447+0000 7f3f527fc640 1 -- 172.21.15.16:0/1275211261 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3f4c017020 con 0x7f3f5c0d4580 2024-05-11T01:01:10.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:10.680+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3f5c06d950 con 0x7f3f5c0d4580 2024-05-11T01:01:11.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.658+0000 7f3f527fc640 1 -- 172.21.15.16:0/1275211261 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f3f4c060cd0 con 0x7f3f5c0d4580 2024-05-11T01:01:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f400762d0 msgr2=0x7f3f40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f400762d0 0x7f3f40078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3f58001540 tx=0x7f3f58007a40 comp rx=0 tx=0).stop 2024-05-11T01:01:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c0d4580 msgr2=0x7f3f5c0b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c0d4580 0x7f3f5c0b5e20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00e730 tx=0x7f3f4c00ebf0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 shutdown_connections 2024-05-11T01:01:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f400762d0 0x7f3f40078790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3f5c15f560 0x7f3f5c0b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3f5c0d4580 0x7f3f5c0b5e20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 --2- 172.21.15.16:0/1275211261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3f5c06dda0 0x7f3f5c0b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 >> 172.21.15.16:0/1275211261 conn(0x7f3f5c073f00 msgr2=0x7f3f5c0cab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:11.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 shutdown_connections 2024-05-11T01:01:11.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.661+0000 7f3f6415f640 1 -- 172.21.15.16:0/1275211261 wait complete. 2024-05-11T01:01:11.676 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-11T01:01:11.676 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-11T01:01:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.788+0000 7f959f1da640 1 Processor -- start 2024-05-11T01:01:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.788+0000 7f959f1da640 1 -- start start 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f959f1da640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f95980b54e0 0x7f959806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f959f1da640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95980afd20 con 0x7f959815f390 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f959f1da640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959806ed60 con 0x7f959815f770 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f959f1da640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f95980afae0 con 0x7f95980b54e0 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f959cf76640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f959815f390 0x7f95980af3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34100/0 (socket says 172.21.15.16:34100) 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f959cf76640 1 -- 172.21.15.16:0/2215723802 learned_addr learned my addr 172.21.15.16:0/2215723802 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f958ffff640 1 --2- 172.21.15.16:0/2215723802 >> v2:172.21.15.174:3300/0 conn(0x7f95980b54e0 0x7f959806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662162639 0 0) 0x7f95980afd20 con 0x7f959815f390 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9580003520 con 0x7f959815f390 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2843597134 0 0) 0x7f9580003520 con 0x7f959815f390 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 >> v2:172.21.15.174:3300/0 conn(0x7f95980b54e0 msgr2=0x7f959806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.789+0000 7f958f7fe640 1 --2- 172.21.15.16:0/2215723802 >> v2:172.21.15.174:3300/0 conn(0x7f95980b54e0 0x7f959806d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 >> v1:172.21.15.174:6789/0 conn(0x7f959815f770 legacy=0x7f959806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959806f040 con 0x7f959815f390 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f95940016f0 con 0x7f959815f390 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 >> v1:172.21.15.16:6789/0 conn(0x7f959815f390 legacy=0x7f95980af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580003a50 0x7f9580003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9580004800 0x7f9580004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9580005210 0x7f958000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f95980afae0 con 0x7f9580005210 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f958000c160 con 0x7f9580003a50 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f958000c360 con 0x7f9580004800 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f959d777640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9580005210 0x7f958000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f959cf76640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580003a50 0x7f9580003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f958ffff640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9580004800 0x7f9580004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:11.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f959d777640 1 -- 172.21.15.16:0/2215723802 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9580004800 msgr2=0x7f9580004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f959d777640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9580004800 0x7f9580004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f959d777640 1 -- 172.21.15.16:0/2215723802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580003a50 msgr2=0x7f9580003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f959d777640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580003a50 0x7f9580003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.790+0000 7f959d777640 1 -- 172.21.15.16:0/2215723802 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9580003520 con 0x7f9580005210 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959d777640 1 -- 172.21.15.16:0/2215723802 reap_dead start 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959d777640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9580005210 0x7f958000b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9590001ee0 tx=0x7f9580005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b553b0553d6f8067 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590037070 con 0x7f9580005210 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9590032440 con 0x7f9580005210 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f958f7fe640 1 -- 172.21.15.16:0/2215723802 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590001b30 con 0x7f9580005210 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959f1da640 1 -- 172.21.15.16:0/2215723802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9580005210 msgr2=0x7f958000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959f1da640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9580005210 0x7f958000b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9590001ee0 tx=0x7f9580005830 comp rx=0 tx=0).stop 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959f1da640 1 -- 172.21.15.16:0/2215723802 shutdown_connections 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959f1da640 1 --2- 172.21.15.16:0/2215723802 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9580005210 0x7f958000b9c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959f1da640 1 -- 172.21.15.16:0/2215723802 >> 172.21.15.16:0/2215723802 conn(0x7f9598072bd0 msgr2=0x7f9598072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959f1da640 1 -- 172.21.15.16:0/2215723802 shutdown_connections 2024-05-11T01:01:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.791+0000 7f959f1da640 1 -- 172.21.15.16:0/2215723802 wait complete. 2024-05-11T01:01:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.793+0000 7f959f1da640 1 Processor -- start 2024-05-11T01:01:11.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.793+0000 7f959f1da640 1 -- start start 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959f1da640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580005210 0x7f9598142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959f1da640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9598154db0 0x7f959813f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959f1da640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9598160e50 0x7f9598142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959f1da640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f95980af3d0 con 0x7f9598160e50 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959f1da640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95980b0000 con 0x7f9580005210 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959f1da640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f95980af550 con 0x7f9598154db0 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9598160e50 0x7f9598142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9598160e50 0x7f9598142090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57778/0 (socket says 172.21.15.16:57778) 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 -- 172.21.15.16:0/3708574344 learned_addr learned my addr 172.21.15.16:0/3708574344 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959cf76640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580005210 0x7f9598142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f958ffff640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9598154db0 0x7f959813f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 -- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9598154db0 msgr2=0x7f959813f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9598154db0 0x7f959813f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 -- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580005210 msgr2=0x7f9598142c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580005210 0x7f9598142c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 -- 172.21.15.16:0/3708574344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959813fd20 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959d777640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9598160e50 0x7f9598142090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f959002a980 tx=0x7f9590001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f958d7fa640 1 -- 172.21.15.16:0/3708574344 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590040070 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f958d7fa640 1 -- 172.21.15.16:0/3708574344 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9590003b70 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959815fdf0 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f958d7fa640 1 -- 172.21.15.16:0/3708574344 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590037040 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.794+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9598160370 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.795+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959806a5b0 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.796+0000 7f958d7fa640 1 -- 172.21.15.16:0/3708574344 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9590043070 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.796+0000 7f958d7fa640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9584076300 0x7f95840787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.797+0000 7f958d7fa640 1 -- 172.21.15.16:0/3708574344 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f95900b6aa0 con 0x7f9598160e50 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.797+0000 7f959cf76640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9584076300 0x7f95840787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.797+0000 7f959cf76640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9584076300 0x7f95840787c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9594001eb0 tx=0x7f9594001e20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:11.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:11.801+0000 7f958d7fa640 1 -- 172.21.15.16:0/3708574344 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f959813fd20 con 0x7f9598160e50 2024-05-11T01:01:12.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.031+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f959806fa10 con 0x7f9598160e50 2024-05-11T01:01:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.663+0000 7f958d7fa640 1 -- 172.21.15.16:0/3708574344 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f9590088370 con 0x7f9598160e50 2024-05-11T01:01:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9584076300 msgr2=0x7f95840787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9584076300 0x7f95840787c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9594001eb0 tx=0x7f9594001e20 comp rx=0 tx=0).stop 2024-05-11T01:01:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9598160e50 msgr2=0x7f9598142090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9598160e50 0x7f9598142090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f959002a980 tx=0x7f9590001490 comp rx=0 tx=0).stop 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 shutdown_connections 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9584076300 0x7f95840787c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9598160e50 0x7f9598142090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9598154db0 0x7f959813f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 --2- 172.21.15.16:0/3708574344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9580005210 0x7f9598142c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 >> 172.21.15.16:0/3708574344 conn(0x7f9598072bd0 msgr2=0x7f9598073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 shutdown_connections 2024-05-11T01:01:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.666+0000 7f959f1da640 1 -- 172.21.15.16:0/3708574344 wait complete. 2024-05-11T01:01:12.680 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-11T01:01:12.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:12.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.790+0000 7ff8b5a93640 1 Processor -- start 2024-05-11T01:01:12.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.790+0000 7ff8b5a93640 1 -- start start 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8b5a93640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff8b0162d30 0x7ff8b00baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8b5a93640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8b00b7530 0x7ff8b00d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8b5a93640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8b01639f0 con 0x7ff8b0163210 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8b5a93640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b00d3700 con 0x7ff8b00b7530 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8b5a93640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b0163cd0 con 0x7ff8b0162d30 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8affff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8b00b7530 0x7ff8b00d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8affff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8b00b7530 0x7ff8b00d3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39786/0 (socket says 172.21.15.16:39786) 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8affff640 1 -- 172.21.15.16:0/1504597706 learned_addr learned my addr 172.21.15.16:0/1504597706 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8af7fe640 1 --2- 172.21.15.16:0/1504597706 >> v2:172.21.15.174:3300/0 conn(0x7ff8b0162d30 0x7ff8b00baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8affff640 1 -- 172.21.15.16:0/1504597706 >> v2:172.21.15.174:3300/0 conn(0x7ff8b0162d30 msgr2=0x7ff8b00baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:12.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8affff640 1 --2- 172.21.15.16:0/1504597706 >> v2:172.21.15.174:3300/0 conn(0x7ff8b0162d30 0x7ff8b00baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8affff640 1 -- 172.21.15.16:0/1504597706 >> v1:172.21.15.174:6789/0 conn(0x7ff8b0163210 legacy=0x7ff8b00b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:12.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8affff640 1 -- 172.21.15.16:0/1504597706 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b0163fb0 con 0x7ff8b00b7530 2024-05-11T01:01:12.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.791+0000 7ff8af7fe640 1 --2- 172.21.15.16:0/1504597706 >> v2:172.21.15.174:3300/0 conn(0x7ff8b0162d30 0x7ff8b00baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:12.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.792+0000 7ff8affff640 1 --2- 172.21.15.16:0/1504597706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b00b7530 0x7ff8b00d3e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8b008e5f0 tx=0x7ff8a802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634e9bb8ee6a1af0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:12.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.792+0000 7ff8aeffd640 1 -- 172.21.15.16:0/1504597706 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8036070 con 0x7ff8b00b7530 2024-05-11T01:01:12.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.792+0000 7ff8aeffd640 1 -- 172.21.15.16:0/1504597706 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a8031600 con 0x7ff8b00b7530 2024-05-11T01:01:12.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.792+0000 7ff8aeffd640 1 -- 172.21.15.16:0/1504597706 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80319d0 con 0x7ff8b00b7530 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.793+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1504597706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b00b7530 msgr2=0x7ff8b00d3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.793+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1504597706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b00b7530 0x7ff8b00d3e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8b008e5f0 tx=0x7ff8a802a610 comp rx=0 tx=0).stop 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.793+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1504597706 shutdown_connections 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.793+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1504597706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b00b7530 0x7ff8b00d3e70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.793+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1504597706 >> v2:172.21.15.174:3300/0 conn(0x7ff8b0162d30 0x7ff8b00baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.793+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1504597706 >> 172.21.15.16:0/1504597706 conn(0x7ff8b00d1e20 msgr2=0x7ff8b00d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.793+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1504597706 shutdown_connections 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.793+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1504597706 wait complete. 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.794+0000 7ff8b5a93640 1 Processor -- start 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.794+0000 7ff8b5a93640 1 -- start start 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8b5a93640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b00b7530 0x7ff8b01506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:12.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8b5a93640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b0162d30 0x7ff8b00cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8b5a93640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b0163210 0x7ff8b00ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8b5a93640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b00d43b0 con 0x7ff8b0162d30 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8b5a93640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b0163670 con 0x7ff8b00b7530 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8b5a93640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b00d4530 con 0x7ff8b0163210 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b0162d30 0x7ff8b00cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b0162d30 0x7ff8b00cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39796/0 (socket says 172.21.15.16:39796) 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 -- 172.21.15.16:0/1894952347 learned_addr learned my addr 172.21.15.16:0/1894952347 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 -- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b0163210 msgr2=0x7ff8b00ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b0163210 0x7ff8b00ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 -- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b00b7530 msgr2=0x7ff8b01506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:12.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b00b7530 0x7ff8b01506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 -- 172.21.15.16:0/1894952347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b00cdef0 con 0x7ff8b0162d30 2024-05-11T01:01:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8a7fff640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b0162d30 0x7ff8b00cc470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c3a0 tx=0x7ff89800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8acff9640 1 -- 172.21.15.16:0/1894952347 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898017070 con 0x7ff8b0162d30 2024-05-11T01:01:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8acff9640 1 -- 172.21.15.16:0/1894952347 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8980052d0 con 0x7ff8b0162d30 2024-05-11T01:01:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b0150c00 con 0x7ff8b0162d30 2024-05-11T01:01:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.795+0000 7ff8acff9640 1 -- 172.21.15.16:0/1894952347 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898003830 con 0x7ff8b0162d30 2024-05-11T01:01:12.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.796+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b00cd130 con 0x7ff8b0162d30 2024-05-11T01:01:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.797+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b00c8a30 con 0x7ff8b0162d30 2024-05-11T01:01:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.797+0000 7ff8acff9640 1 -- 172.21.15.16:0/1894952347 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff89801a070 con 0x7ff8b0162d30 2024-05-11T01:01:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.798+0000 7ff8acff9640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff8900762d0 0x7ff890078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.798+0000 7ff8acff9640 1 -- 172.21.15.16:0/1894952347 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff898096960 con 0x7ff8b0162d30 2024-05-11T01:01:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.798+0000 7ff8af7fe640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff8900762d0 0x7ff890078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:12.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.799+0000 7ff8af7fe640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff8900762d0 0x7ff890078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0006fd0 tx=0x7ff8a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:12.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:12.802+0000 7ff8acff9640 1 -- 172.21.15.16:0/1894952347 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff8b00c8a30 con 0x7ff8b0162d30 2024-05-11T01:01:13.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.032+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8b006a5b0 con 0x7ff8b0162d30 2024-05-11T01:01:13.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.033+0000 7ff8acff9640 1 -- 172.21.15.16:0/1894952347 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5178 (secure 0 0 0) 0x7ff8980602c0 con 0x7ff8b0162d30 2024-05-11T01:01:13.034 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:13.034 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:09.046368+0000","modified":"2024-05-11T01:01:12.033345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-11T01:01:13.035 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff8900762d0 msgr2=0x7ff890078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff8900762d0 0x7ff890078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0006fd0 tx=0x7ff8a0008040 comp rx=0 tx=0).stop 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b0162d30 msgr2=0x7ff8b00cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b0162d30 0x7ff8b00cc470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c3a0 tx=0x7ff89800c860 comp rx=0 tx=0).stop 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 shutdown_connections 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff8900762d0 0x7ff890078790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b0163210 0x7ff8b00ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b0162d30 0x7ff8b00cc470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 --2- 172.21.15.16:0/1894952347 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b00b7530 0x7ff8b01506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.035+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 >> 172.21.15.16:0/1894952347 conn(0x7ff8b00d1e20 msgr2=0x7ff8b00d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.036+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 shutdown_connections 2024-05-11T01:01:13.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.036+0000 7ff8b5a93640 1 -- 172.21.15.16:0/1894952347 wait complete. 2024-05-11T01:01:13.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.150+0000 7ff7d87c1640 1 Processor -- start 2024-05-11T01:01:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.150+0000 7ff7d87c1640 1 -- start start 2024-05-11T01:01:13.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.151+0000 7ff7d87c1640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff7d015f5f0 0x7ff7d006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.151+0000 7ff7d87c1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff7d006c920 0x7ff7d00b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.151+0000 7ff7d87c1640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7d00d2e80 con 0x7ff7d00b1400 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.151+0000 7ff7d87c1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d00b60e0 con 0x7ff7d006c920 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.151+0000 7ff7d87c1640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d0070800 con 0x7ff7d015f5f0 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.151+0000 7ff7d5d5c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff7d006c920 0x7ff7d00b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.151+0000 7ff7d5d5c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff7d006c920 0x7ff7d00b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39806/0 (socket says 172.21.15.16:39806) 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.151+0000 7ff7d5d5c640 1 -- 172.21.15.16:0/1275024222 learned_addr learned my addr 172.21.15.16:0/1275024222 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.152+0000 7ff7d655d640 1 --2- 172.21.15.16:0/1275024222 >> v2:172.21.15.174:3300/0 conn(0x7ff7d015f5f0 0x7ff7d006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.152+0000 7ff7d5d5c640 1 -- 172.21.15.16:0/1275024222 >> v2:172.21.15.174:3300/0 conn(0x7ff7d015f5f0 msgr2=0x7ff7d006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.152+0000 7ff7d5d5c640 1 --2- 172.21.15.16:0/1275024222 >> v2:172.21.15.174:3300/0 conn(0x7ff7d015f5f0 0x7ff7d006c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.152+0000 7ff7d5d5c640 1 -- 172.21.15.16:0/1275024222 >> v1:172.21.15.174:6789/0 conn(0x7ff7d00b1400 legacy=0x7ff7d0163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:13.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.152+0000 7ff7d5d5c640 1 -- 172.21.15.16:0/1275024222 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d015fcf0 con 0x7ff7d006c920 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.152+0000 7ff7d5d5c640 1 --2- 172.21.15.16:0/1275024222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d006c920 0x7ff7d00b0ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00747c0 tx=0x7ff7c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dbed83261f58cd server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d555b640 1 -- 172.21.15.16:0/1275024222 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0037070 con 0x7ff7d006c920 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d555b640 1 -- 172.21.15.16:0/1275024222 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c0032440 con 0x7ff7d006c920 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d555b640 1 -- 172.21.15.16:0/1275024222 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0032810 con 0x7ff7d006c920 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d87c1640 1 -- 172.21.15.16:0/1275024222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d006c920 msgr2=0x7ff7d00b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/1275024222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d006c920 0x7ff7d00b0ec0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00747c0 tx=0x7ff7c002a1e0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d87c1640 1 -- 172.21.15.16:0/1275024222 shutdown_connections 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/1275024222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d006c920 0x7ff7d00b0ec0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/1275024222 >> v2:172.21.15.174:3300/0 conn(0x7ff7d015f5f0 0x7ff7d006c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d87c1640 1 -- 172.21.15.16:0/1275024222 >> 172.21.15.16:0/1275024222 conn(0x7ff7d006dec0 msgr2=0x7ff7d00b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d87c1640 1 -- 172.21.15.16:0/1275024222 shutdown_connections 2024-05-11T01:01:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.153+0000 7ff7d87c1640 1 -- 172.21.15.16:0/1275024222 wait complete. 2024-05-11T01:01:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.154+0000 7ff7d87c1640 1 Processor -- start 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.154+0000 7ff7d87c1640 1 -- start start 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d87c1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7d006c920 0x7ff7d014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d87c1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7d00b1400 0x7ff7d015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d87c1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d015f5f0 0x7ff7d0161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d87c1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d0160590 con 0x7ff7d015f5f0 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d87c1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d01602b0 con 0x7ff7d006c920 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d87c1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d015f9d0 con 0x7ff7d00b1400 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d6d5e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d015f5f0 0x7ff7d0161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d6d5e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d015f5f0 0x7ff7d0161950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39818/0 (socket says 172.21.15.16:39818) 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d6d5e640 1 -- 172.21.15.16:0/580537152 learned_addr learned my addr 172.21.15.16:0/580537152 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.155+0000 7ff7d5d5c640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7d00b1400 0x7ff7d015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d655d640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7d006c920 0x7ff7d014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d6d5e640 1 -- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7d00b1400 msgr2=0x7ff7d015e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d6d5e640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7d00b1400 0x7ff7d015e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d6d5e640 1 -- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7d006c920 msgr2=0x7ff7d014cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d6d5e640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7d006c920 0x7ff7d014cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d6d5e640 1 -- 172.21.15.16:0/580537152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d0159a40 con 0x7ff7d015f5f0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d6d5e640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d015f5f0 0x7ff7d0161950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00c780 tx=0x7ff7cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7c6ffd640 1 -- 172.21.15.16:0/580537152 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc004b60 con 0x7ff7d015f5f0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7c6ffd640 1 -- 172.21.15.16:0/580537152 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7cc004d00 con 0x7ff7d015f5f0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d0159d20 con 0x7ff7d015f5f0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7c6ffd640 1 -- 172.21.15.16:0/580537152 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00aa90 con 0x7ff7d015f5f0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.156+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d015a2e0 con 0x7ff7d015f5f0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.157+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d006a5b0 con 0x7ff7d015f5f0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.157+0000 7ff7c6ffd640 1 -- 172.21.15.16:0/580537152 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff7cc00ac30 con 0x7ff7d015f5f0 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.158+0000 7ff7c6ffd640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff7b4076300 0x7ff7b40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.158+0000 7ff7c6ffd640 1 -- 172.21.15.16:0/580537152 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff7cc097820 con 0x7ff7d015f5f0 2024-05-11T01:01:13.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.158+0000 7ff7d655d640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff7b4076300 0x7ff7b40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.159+0000 7ff7d655d640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff7b4076300 0x7ff7b40787c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8006fd0 tx=0x7ff7c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.163+0000 7ff7c6ffd640 1 -- 172.21.15.16:0/580537152 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff7cc020070 con 0x7ff7d015f5f0 2024-05-11T01:01:13.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.352+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7d00d1270 con 0x7ff7d015f5f0 2024-05-11T01:01:13.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.353+0000 7ff7c6ffd640 1 -- 172.21.15.16:0/580537152 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7ff7cc069030 con 0x7ff7d015f5f0 2024-05-11T01:01:13.355 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:13.355 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:10.636137+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff7b4076300 msgr2=0x7ff7b40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff7b4076300 0x7ff7b40787c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8006fd0 tx=0x7ff7c8008040 comp rx=0 tx=0).stop 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d015f5f0 msgr2=0x7ff7d0161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d015f5f0 0x7ff7d0161950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00c780 tx=0x7ff7cc00cc40 comp rx=0 tx=0).stop 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 shutdown_connections 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff7b4076300 0x7ff7b40787c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7d015f5f0 0x7ff7d0161950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff7d00b1400 0x7ff7d015e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 --2- 172.21.15.16:0/580537152 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7d006c920 0x7ff7d014cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.355+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 >> 172.21.15.16:0/580537152 conn(0x7ff7d006dec0 msgr2=0x7ff7d00aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:13.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.356+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 shutdown_connections 2024-05-11T01:01:13.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.356+0000 7ff7d87c1640 1 -- 172.21.15.16:0/580537152 wait complete. 2024-05-11T01:01:13.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-11T01:01:13.368 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.470+0000 7f0ffb989640 1 Processor -- start 2024-05-11T01:01:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.470+0000 7f0ffb989640 1 -- start start 2024-05-11T01:01:13.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0ffb989640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0ff40b6d70 0x7f0ff40b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0ffb989640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff4163e90 con 0x7f0ff40d4990 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0ffb989640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff406e230 con 0x7f0ff40bac10 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0ffb989640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff40cfad0 con 0x7f0ff40b6d70 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0ff9725640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0ff40b6d70 0x7f0ff40b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0ff9f26640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0ff40d4990 0x7f0ff406db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48728/0 (socket says 172.21.15.16:48728) 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0ff9f26640 1 -- 172.21.15.16:0/2710083254 learned_addr learned my addr 172.21.15.16:0/2710083254 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0febfff640 1 -- 172.21.15.16:0/2710083254 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478788446 0 0) 0x7f0ff4163e90 con 0x7f0ff40d4990 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.471+0000 7f0febfff640 1 -- 172.21.15.16:0/2710083254 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe0003520 con 0x7f0ff40d4990 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.472+0000 7f0ff9725640 1 -- 172.21.15.16:0/2710083254 >> v1:172.21.15.174:6789/0 conn(0x7f0ff40bac10 legacy=0x7f0ff406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.472+0000 7f0ff9725640 1 -- 172.21.15.16:0/2710083254 >> v1:172.21.15.16:6789/0 conn(0x7f0ff40d4990 legacy=0x7f0ff406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.472+0000 7f0ff9725640 1 -- 172.21.15.16:0/2710083254 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff40b7690 con 0x7f0ff40b6d70 2024-05-11T01:01:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.472+0000 7f0ff9725640 1 --2- 172.21.15.16:0/2710083254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40b6d70 0x7f0ff40b7150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097d0 tx=0x7f0ff002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29ffbad600afb02 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.472+0000 7f0febfff640 1 -- 172.21.15.16:0/2710083254 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0037070 con 0x7f0ff40b6d70 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.472+0000 7f0febfff640 1 -- 172.21.15.16:0/2710083254 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff002ae40 con 0x7f0ff40b6d70 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.472+0000 7f0febfff640 1 -- 172.21.15.16:0/2710083254 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0032660 con 0x7f0ff40b6d70 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.473+0000 7f0ffb989640 1 -- 172.21.15.16:0/2710083254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40b6d70 msgr2=0x7f0ff40b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.473+0000 7f0ffb989640 1 --2- 172.21.15.16:0/2710083254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40b6d70 0x7f0ff40b7150 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097d0 tx=0x7f0ff002a130 comp rx=0 tx=0).stop 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.473+0000 7f0ffb989640 1 -- 172.21.15.16:0/2710083254 shutdown_connections 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.473+0000 7f0ffb989640 1 --2- 172.21.15.16:0/2710083254 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40b6d70 0x7f0ff40b7150 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.473+0000 7f0ffb989640 1 -- 172.21.15.16:0/2710083254 >> 172.21.15.16:0/2710083254 conn(0x7f0ff4074140 msgr2=0x7f0ff40d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.473+0000 7f0ffb989640 1 -- 172.21.15.16:0/2710083254 shutdown_connections 2024-05-11T01:01:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.473+0000 7f0ffb989640 1 -- 172.21.15.16:0/2710083254 wait complete. 2024-05-11T01:01:13.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.474+0000 7f0ffb989640 1 Processor -- start 2024-05-11T01:01:13.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.474+0000 7f0ffb989640 1 -- start start 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ffb989640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40b6d70 0x7f0ff4151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ffb989640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40bac10 0x7f0ff41ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ffb989640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40d4990 0x7f0ff4153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ffb989640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff41638d0 con 0x7f0ff40bac10 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ffb989640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff41635f0 con 0x7f0ff40b6d70 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ffb989640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff4163bb0 con 0x7f0ff40d4990 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff8f24640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40bac10 0x7f0ff41ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff8f24640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40bac10 0x7f0ff41ea000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39824/0 (socket says 172.21.15.16:39824) 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff8f24640 1 -- 172.21.15.16:0/3871533834 learned_addr learned my addr 172.21.15.16:0/3871533834 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff9725640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40b6d70 0x7f0ff4151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff9f26640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40d4990 0x7f0ff4153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff8f24640 1 -- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40d4990 msgr2=0x7f0ff4153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff8f24640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40d4990 0x7f0ff4153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff8f24640 1 -- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40b6d70 msgr2=0x7f0ff4151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff8f24640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40b6d70 0x7f0ff4151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.475+0000 7f0ff8f24640 1 -- 172.21.15.16:0/3871533834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff41eaac0 con 0x7f0ff40bac10 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.476+0000 7f0ff9f26640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40d4990 0x7f0ff4153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.476+0000 7f0ff8f24640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40bac10 0x7f0ff41ea000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c430 tx=0x7f0fe400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.476+0000 7f0fe9ffb640 1 -- 172.21.15.16:0/3871533834 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4011790 con 0x7f0ff40bac10 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.476+0000 7f0fe9ffb640 1 -- 172.21.15.16:0/3871533834 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe4017070 con 0x7f0ff40bac10 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.476+0000 7f0fe9ffb640 1 -- 172.21.15.16:0/3871533834 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4011bb0 con 0x7f0ff40bac10 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.476+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff40b8480 con 0x7f0ff40bac10 2024-05-11T01:01:13.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.476+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff40b8a40 con 0x7f0ff40bac10 2024-05-11T01:01:13.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.477+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff406a5b0 con 0x7f0ff40bac10 2024-05-11T01:01:13.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.477+0000 7f0fe9ffb640 1 -- 172.21.15.16:0/3871533834 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fe401c460 con 0x7f0ff40bac10 2024-05-11T01:01:13.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.478+0000 7f0fe9ffb640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd8076300 0x7f0fd80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.478+0000 7f0fe9ffb640 1 -- 172.21.15.16:0/3871533834 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0fe4097370 con 0x7f0ff40bac10 2024-05-11T01:01:13.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.478+0000 7f0ff9725640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd8076300 0x7f0fd80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.479+0000 7f0ff9725640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd8076300 0x7f0fd80787c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0034000 tx=0x7f0ff002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.482+0000 7f0fe9ffb640 1 -- 172.21.15.16:0/3871533834 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0fe4060d60 con 0x7f0ff40bac10 2024-05-11T01:01:13.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.669+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ff40b4a30 con 0x7f0fd8076300 2024-05-11T01:01:13.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.676+0000 7f0fe9ffb640 1 -- 172.21.15.16:0/3871533834 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246612 (secure 0 0 0) 0x7f0ff007e370 con 0x7f0fd8076300 2024-05-11T01:01:13.680 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:13.681 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:13.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd8076300 msgr2=0x7f0fd80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd8076300 0x7f0fd80787c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0034000 tx=0x7f0ff002e000 comp rx=0 tx=0).stop 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40bac10 msgr2=0x7f0ff41ea000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40bac10 0x7f0ff41ea000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400c430 tx=0x7f0fe400c8f0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 shutdown_connections 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd8076300 0x7f0fd80787c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ff40d4990 0x7f0ff4153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff40bac10 0x7f0ff41ea000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 --2- 172.21.15.16:0/3871533834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ff40b6d70 0x7f0ff4151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 >> 172.21.15.16:0/3871533834 conn(0x7f0ff4074140 msgr2=0x7f0ff40b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 shutdown_connections 2024-05-11T01:01:13.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.679+0000 7f0ffb989640 1 -- 172.21.15.16:0/3871533834 wait complete. 2024-05-11T01:01:13.691 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-11T01:01:11.755489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235808,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738912,"statfs":{"total":773094113280,"available":772852645888,"internally_reserved":0,"allocated":2555904,"data_stored":1605958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.117037"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644587+0000","last_change":"2024-05-11T01:01:08.644587+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644587+0000","last_undegraded":"2024-05-11T01:01:08.644587+0000","last_fullsized":"2024-05-11T01:01:08.644587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642284+0000","last_change":"2024-05-11T01:01:08.642284+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642284+0000","last_undegraded":"2024-05-11T01:01:08.642284+0000","last_fullsized":"2024-05-11T01:01:08.642284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641053+0000","last_change":"2024-05-11T01:01:08.641053+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641053+0000","last_undegraded":"2024-05-11T01:01:08.641053+0000","last_fullsized":"2024-05-11T01:01:08.641053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645618+0000","last_change":"2024-05-11T01:01:08.645618+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645618+0000","last_undegraded":"2024-05-11T01:01:08.645618+0000","last_fullsized":"2024-05-11T01:01:08.645618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646252+0000","last_change":"2024-05-11T01:01:08.646252+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646252+0000","last_undegraded":"2024-05-11T01:01:08.646252+0000","last_fullsized":"2024-05-11T01:01:08.646252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645404+0000","last_change":"2024-05-11T01:01:08.645404+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645404+0000","last_undegraded":"2024-05-11T01:01:08.645404+0000","last_fullsized":"2024-05-11T01:01:08.645404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645440+0000","last_change":"2024-05-11T01:01:08.645440+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645440+0000","last_undegraded":"2024-05-11T01:01:08.645440+0000","last_fullsized":"2024-05-11T01:01:08.645440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644464+0000","last_change":"2024-05-11T01:01:08.644464+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644464+0000","last_undegraded":"2024-05-11T01:01:08.644464+0000","last_fullsized":"2024-05-11T01:01:08.644464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642961+0000","last_change":"2024-05-11T01:01:08.642961+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642961+0000","last_undegraded":"2024-05-11T01:01:08.642961+0000","last_fullsized":"2024-05-11T01:01:08.642961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.650323+0000","last_change":"2024-05-11T01:01:08.650323+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.650323+0000","last_undegraded":"2024-05-11T01:01:08.650323+0000","last_fullsized":"2024-05-11T01:01:08.650323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.648064+0000","last_change":"2024-05-11T01:01:08.648064+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.648064+0000","last_undegraded":"2024-05-11T01:01:08.648064+0000","last_fullsized":"2024-05-11T01:01:08.648064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641104+0000","last_change":"2024-05-11T01:01:08.641104+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641104+0000","last_undegraded":"2024-05-11T01:01:08.641104+0000","last_fullsized":"2024-05-11T01:01:08.641104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643598+0000","last_change":"2024-05-11T01:01:08.643598+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643598+0000","last_undegraded":"2024-05-11T01:01:08.643598+0000","last_fullsized":"2024-05-11T01:01:08.643598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646386+0000","last_change":"2024-05-11T01:01:08.646386+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646386+0000","last_undegraded":"2024-05-11T01:01:08.646386+0000","last_fullsized":"2024-05-11T01:01:08.646386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642270+0000","last_change":"2024-05-11T01:01:08.642270+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642270+0000","last_undegraded":"2024-05-11T01:01:08.642270+0000","last_fullsized":"2024-05-11T01:01:08.642270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644542+0000","last_change":"2024-05-11T01:01:08.644542+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644542+0000","last_undegraded":"2024-05-11T01:01:08.644542+0000","last_fullsized":"2024-05-11T01:01:08.644542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643764+0000","last_change":"2024-05-11T01:01:08.643764+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643764+0000","last_undegraded":"2024-05-11T01:01:08.643764+0000","last_fullsized":"2024-05-11T01:01:08.643764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640129+0000","last_change":"2024-05-11T01:01:08.640129+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640129+0000","last_undegraded":"2024-05-11T01:01:08.640129+0000","last_fullsized":"2024-05-11T01:01:08.640129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640689+0000","last_change":"2024-05-11T01:01:08.640689+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640689+0000","last_undegraded":"2024-05-11T01:01:08.640689+0000","last_fullsized":"2024-05-11T01:01:08.640689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649549+0000","last_change":"2024-05-11T01:01:08.649549+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649549+0000","last_undegraded":"2024-05-11T01:01:08.649549+0000","last_fullsized":"2024-05-11T01:01:08.649549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647484+0000","last_change":"2024-05-11T01:01:08.647484+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647484+0000","last_undegraded":"2024-05-11T01:01:08.647484+0000","last_fullsized":"2024-05-11T01:01:08.647484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644705+0000","last_change":"2024-05-11T01:01:08.644705+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644705+0000","last_undegraded":"2024-05-11T01:01:08.644705+0000","last_fullsized":"2024-05-11T01:01:08.644705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644526+0000","last_change":"2024-05-11T01:01:08.644526+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644526+0000","last_undegraded":"2024-05-11T01:01:08.644526+0000","last_fullsized":"2024-05-11T01:01:08.644526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642937+0000","last_change":"2024-05-11T01:01:08.642937+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642937+0000","last_undegraded":"2024-05-11T01:01:08.642937+0000","last_fullsized":"2024-05-11T01:01:08.642937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645521+0000","last_change":"2024-05-11T01:01:08.645521+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645521+0000","last_undegraded":"2024-05-11T01:01:08.645521+0000","last_fullsized":"2024-05-11T01:01:08.645521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649780+0000","last_change":"2024-05-11T01:01:08.649780+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649780+0000","last_undegraded":"2024-05-11T01:01:08.649780+0000","last_fullsized":"2024-05-11T01:01:08.649780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643709+0000","last_change":"2024-05-11T01:01:08.643709+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643709+0000","last_undegraded":"2024-05-11T01:01:08.643709+0000","last_fullsized":"2024-05-11T01:01:08.643709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642008+0000","last_change":"2024-05-11T01:01:08.642008+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642008+0000","last_undegraded":"2024-05-11T01:01:08.642008+0000","last_fullsized":"2024-05-11T01:01:08.642008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646983+0000","last_change":"2024-05-11T01:01:08.646983+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646983+0000","last_undegraded":"2024-05-11T01:01:08.646983+0000","last_fullsized":"2024-05-11T01:01:08.646983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644147+0000","last_change":"2024-05-11T01:01:08.644147+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644147+0000","last_undegraded":"2024-05-11T01:01:08.644147+0000","last_fullsized":"2024-05-11T01:01:08.644147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640318+0000","last_change":"2024-05-11T01:01:08.640318+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640318+0000","last_undegraded":"2024-05-11T01:01:08.640318+0000","last_fullsized":"2024-05-11T01:01:08.640318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647230+0000","last_change":"2024-05-11T01:01:08.647230+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647230+0000","last_undegraded":"2024-05-11T01:01:08.647230+0000","last_fullsized":"2024-05-11T01:01:08.647230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640153+0000","last_change":"2024-05-11T01:01:08.640153+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640153+0000","last_undegraded":"2024-05-11T01:01:08.640153+0000","last_fullsized":"2024-05-11T01:01:08.640153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658304+0000","last_change":"2024-05-11T01:01:08.656899+0000","last_active":"2024-05-11T01:01:08.658304+0000","last_peered":"2024-05-11T01:01:08.658304+0000","last_clean":"2024-05-11T01:01:08.658304+0000","last_became_active":"2024-05-11T01:01:08.656569+0000","last_became_peered":"2024-05-11T01:01:08.656569+0000","last_unstale":"2024-05-11T01:01:08.658304+0000","last_undegraded":"2024-05-11T01:01:08.658304+0000","last_fullsized":"2024-05-11T01:01:08.658304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643486+0000","last_change":"2024-05-11T01:01:08.643486+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643486+0000","last_undegraded":"2024-05-11T01:01:08.643486+0000","last_fullsized":"2024-05-11T01:01:08.643486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.655969+0000","last_change":"2024-05-11T01:01:08.651945+0000","last_active":"2024-05-11T01:01:08.655969+0000","last_peered":"2024-05-11T01:01:08.655969+0000","last_clean":"2024-05-11T01:01:08.655969+0000","last_became_active":"2024-05-11T01:01:08.651681+0000","last_became_peered":"2024-05-11T01:01:08.651681+0000","last_unstale":"2024-05-11T01:01:08.655969+0000","last_undegraded":"2024-05-11T01:01:08.655969+0000","last_fullsized":"2024-05-11T01:01:08.655969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659704+0000","last_change":"2024-05-11T01:01:08.658922+0000","last_active":"2024-05-11T01:01:08.659704+0000","last_peered":"2024-05-11T01:01:08.659704+0000","last_clean":"2024-05-11T01:01:08.659704+0000","last_became_active":"2024-05-11T01:01:08.658620+0000","last_became_peered":"2024-05-11T01:01:08.658620+0000","last_unstale":"2024-05-11T01:01:08.659704+0000","last_undegraded":"2024-05-11T01:01:08.659704+0000","last_fullsized":"2024-05-11T01:01:08.659704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643967+0000","last_change":"2024-05-11T01:01:08.643967+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643967+0000","last_undegraded":"2024-05-11T01:01:08.643967+0000","last_fullsized":"2024-05-11T01:01:08.643967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.650072+0000","last_change":"2024-05-11T01:01:08.647703+0000","last_active":"2024-05-11T01:01:08.650072+0000","last_peered":"2024-05-11T01:01:08.650072+0000","last_clean":"2024-05-11T01:01:08.650072+0000","last_became_active":"2024-05-11T01:01:08.647434+0000","last_became_peered":"2024-05-11T01:01:08.647434+0000","last_unstale":"2024-05-11T01:01:08.650072+0000","last_undegraded":"2024-05-11T01:01:08.650072+0000","last_fullsized":"2024-05-11T01:01:08.650072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644170+0000","last_change":"2024-05-11T01:01:08.644170+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644170+0000","last_undegraded":"2024-05-11T01:01:08.644170+0000","last_fullsized":"2024-05-11T01:01:08.644170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.656123+0000","last_change":"2024-05-11T01:01:08.655160+0000","last_active":"2024-05-11T01:01:08.656123+0000","last_peered":"2024-05-11T01:01:08.656123+0000","last_clean":"2024-05-11T01:01:08.656123+0000","last_became_active":"2024-05-11T01:01:08.654886+0000","last_became_peered":"2024-05-11T01:01:08.654886+0000","last_unstale":"2024-05-11T01:01:08.656123+0000","last_undegraded":"2024-05-11T01:01:08.656123+0000","last_fullsized":"2024-05-11T01:01:08.656123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643532+0000","last_change":"2024-05-11T01:01:08.643532+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643532+0000","last_undegraded":"2024-05-11T01:01:08.643532+0000","last_fullsized":"2024-05-11T01:01:08.643532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657466+0000","last_change":"2024-05-11T01:01:08.655815+0000","last_active":"2024-05-11T01:01:08.657466+0000","last_peered":"2024-05-11T01:01:08.657466+0000","last_clean":"2024-05-11T01:01:08.657466+0000","last_became_active":"2024-05-11T01:01:08.655307+0000","last_became_peered":"2024-05-11T01:01:08.655307+0000","last_unstale":"2024-05-11T01:01:08.657466+0000","last_undegraded":"2024-05-11T01:01:08.657466+0000","last_fullsized":"2024-05-11T01:01:08.657466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646042+0000","last_change":"2024-05-11T01:01:08.646042+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646042+0000","last_undegraded":"2024-05-11T01:01:08.646042+0000","last_fullsized":"2024-05-11T01:01:08.646042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654599+0000","last_change":"2024-05-11T01:01:08.653490+0000","last_active":"2024-05-11T01:01:08.654599+0000","last_peered":"2024-05-11T01:01:08.654599+0000","last_clean":"2024-05-11T01:01:08.654599+0000","last_became_active":"2024-05-11T01:01:08.653133+0000","last_became_peered":"2024-05-11T01:01:08.653133+0000","last_unstale":"2024-05-11T01:01:08.654599+0000","last_undegraded":"2024-05-11T01:01:08.654599+0000","last_fullsized":"2024-05-11T01:01:08.654599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640364+0000","last_change":"2024-05-11T01:01:08.640364+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640364+0000","last_undegraded":"2024-05-11T01:01:08.640364+0000","last_fullsized":"2024-05-11T01:01:08.640364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657197+0000","last_change":"2024-05-11T01:01:08.654417+0000","last_active":"2024-05-11T01:01:08.657197+0000","last_peered":"2024-05-11T01:01:08.657197+0000","last_clean":"2024-05-11T01:01:08.657197+0000","last_became_active":"2024-05-11T01:01:08.654147+0000","last_became_peered":"2024-05-11T01:01:08.654147+0000","last_unstale":"2024-05-11T01:01:08.657197+0000","last_undegraded":"2024-05-11T01:01:08.657197+0000","last_fullsized":"2024-05-11T01:01:08.657197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645095+0000","last_change":"2024-05-11T01:01:08.645095+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645095+0000","last_undegraded":"2024-05-11T01:01:08.645095+0000","last_fullsized":"2024-05-11T01:01:08.645095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657420+0000","last_change":"2024-05-11T01:01:08.655493+0000","last_active":"2024-05-11T01:01:08.657420+0000","last_peered":"2024-05-11T01:01:08.657420+0000","last_clean":"2024-05-11T01:01:08.657420+0000","last_became_active":"2024-05-11T01:01:08.655147+0000","last_became_peered":"2024-05-11T01:01:08.655147+0000","last_unstale":"2024-05-11T01:01:08.657420+0000","last_undegraded":"2024-05-11T01:01:08.657420+0000","last_fullsized":"2024-05-11T01:01:08.657420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641701+0000","last_change":"2024-05-11T01:01:08.641701+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641701+0000","last_undegraded":"2024-05-11T01:01:08.641701+0000","last_fullsized":"2024-05-11T01:01:08.641701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.651846+0000","last_change":"2024-05-11T01:01:08.648494+0000","last_active":"2024-05-11T01:01:08.651846+0000","last_peered":"2024-05-11T01:01:08.651846+0000","last_clean":"2024-05-11T01:01:08.651846+0000","last_became_active":"2024-05-11T01:01:08.648206+0000","last_became_peered":"2024-05-11T01:01:08.648206+0000","last_unstale":"2024-05-11T01:01:08.651846+0000","last_undegraded":"2024-05-11T01:01:08.651846+0000","last_fullsized":"2024-05-11T01:01:08.651846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642014+0000","last_change":"2024-05-11T01:01:08.642014+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642014+0000","last_undegraded":"2024-05-11T01:01:08.642014+0000","last_fullsized":"2024-05-11T01:01:08.642014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658274+0000","last_change":"2024-05-11T01:01:08.655771+0000","last_active":"2024-05-11T01:01:08.658274+0000","last_peered":"2024-05-11T01:01:08.658274+0000","last_clean":"2024-05-11T01:01:08.658274+0000","last_became_active":"2024-05-11T01:01:08.655462+0000","last_became_peered":"2024-05-11T01:01:08.655462+0000","last_unstale":"2024-05-11T01:01:08.658274+0000","last_undegraded":"2024-05-11T01:01:08.658274+0000","last_fullsized":"2024-05-11T01:01:08.658274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646474+0000","last_change":"2024-05-11T01:01:08.646474+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646474+0000","last_undegraded":"2024-05-11T01:01:08.646474+0000","last_fullsized":"2024-05-11T01:01:08.646474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652346+0000","last_change":"2024-05-11T01:01:08.649715+0000","last_active":"2024-05-11T01:01:08.652346+0000","last_peered":"2024-05-11T01:01:08.652346+0000","last_clean":"2024-05-11T01:01:08.652346+0000","last_became_active":"2024-05-11T01:01:08.649344+0000","last_became_peered":"2024-05-11T01:01:08.649344+0000","last_unstale":"2024-05-11T01:01:08.652346+0000","last_undegraded":"2024-05-11T01:01:08.652346+0000","last_fullsized":"2024-05-11T01:01:08.652346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640890+0000","last_change":"2024-05-11T01:01:08.640890+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640890+0000","last_undegraded":"2024-05-11T01:01:08.640890+0000","last_fullsized":"2024-05-11T01:01:08.640890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658084+0000","last_change":"2024-05-11T01:01:08.656669+0000","last_active":"2024-05-11T01:01:08.658084+0000","last_peered":"2024-05-11T01:01:08.658084+0000","last_clean":"2024-05-11T01:01:08.658084+0000","last_became_active":"2024-05-11T01:01:08.656381+0000","last_became_peered":"2024-05-11T01:01:08.656381+0000","last_unstale":"2024-05-11T01:01:08.658084+0000","last_undegraded":"2024-05-11T01:01:08.658084+0000","last_fullsized":"2024-05-11T01:01:08.658084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641185+0000","last_change":"2024-05-11T01:01:08.641185+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641185+0000","last_undegraded":"2024-05-11T01:01:08.641185+0000","last_fullsized":"2024-05-11T01:01:08.641185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652983+0000","last_change":"2024-05-11T01:01:08.651433+0000","last_active":"2024-05-11T01:01:08.652983+0000","last_peered":"2024-05-11T01:01:08.652983+0000","last_clean":"2024-05-11T01:01:08.652983+0000","last_became_active":"2024-05-11T01:01:08.650413+0000","last_became_peered":"2024-05-11T01:01:08.650413+0000","last_unstale":"2024-05-11T01:01:08.652983+0000","last_undegraded":"2024-05-11T01:01:08.652983+0000","last_fullsized":"2024-05-11T01:01:08.652983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640813+0000","last_change":"2024-05-11T01:01:08.640813+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640813+0000","last_undegraded":"2024-05-11T01:01:08.640813+0000","last_fullsized":"2024-05-11T01:01:08.640813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652563+0000","last_change":"2024-05-11T01:01:08.648337+0000","last_active":"2024-05-11T01:01:08.652563+0000","last_peered":"2024-05-11T01:01:08.652563+0000","last_clean":"2024-05-11T01:01:08.652563+0000","last_became_active":"2024-05-11T01:01:08.648027+0000","last_became_peered":"2024-05-11T01:01:08.648027+0000","last_unstale":"2024-05-11T01:01:08.652563+0000","last_undegraded":"2024-05-11T01:01:08.652563+0000","last_fullsized":"2024-05-11T01:01:08.652563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644072+0000","last_change":"2024-05-11T01:01:08.644072+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644072+0000","last_undegraded":"2024-05-11T01:01:08.644072+0000","last_fullsized":"2024-05-11T01:01:08.644072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.650047+0000","last_change":"2024-05-11T01:01:08.648806+0000","last_active":"2024-05-11T01:01:08.650047+0000","last_peered":"2024-05-11T01:01:08.650047+0000","last_clean":"2024-05-11T01:01:08.650047+0000","last_became_active":"2024-05-11T01:01:08.648140+0000","last_became_peered":"2024-05-11T01:01:08.648140+0000","last_unstale":"2024-05-11T01:01:08.650047+0000","last_undegraded":"2024-05-11T01:01:08.650047+0000","last_fullsized":"2024-05-11T01:01:08.650047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642340+0000","last_change":"2024-05-11T01:01:08.642340+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642340+0000","last_undegraded":"2024-05-11T01:01:08.642340+0000","last_fullsized":"2024-05-11T01:01:08.642340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.651516+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:08.651516+0000","last_peered":"2024-05-11T01:01:08.651516+0000","last_clean":"2024-05-11T01:01:08.651516+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:08.651516+0000","last_undegraded":"2024-05-11T01:01:08.651516+0000","last_fullsized":"2024-05-11T01:01:08.651516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654777+0000","last_change":"2024-05-11T01:01:08.649868+0000","last_active":"2024-05-11T01:01:08.654777+0000","last_peered":"2024-05-11T01:01:08.654777+0000","last_clean":"2024-05-11T01:01:08.654777+0000","last_became_active":"2024-05-11T01:01:08.649580+0000","last_became_peered":"2024-05-11T01:01:08.649580+0000","last_unstale":"2024-05-11T01:01:08.654777+0000","last_undegraded":"2024-05-11T01:01:08.654777+0000","last_fullsized":"2024-05-11T01:01:08.654777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642019+0000","last_change":"2024-05-11T01:01:08.642019+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642019+0000","last_undegraded":"2024-05-11T01:01:08.642019+0000","last_fullsized":"2024-05-11T01:01:08.642019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662245+0000","last_change":"2024-05-11T01:01:08.659302+0000","last_active":"2024-05-11T01:01:08.662245+0000","last_peered":"2024-05-11T01:01:08.662245+0000","last_clean":"2024-05-11T01:01:08.662245+0000","last_became_active":"2024-05-11T01:01:08.658788+0000","last_became_peered":"2024-05-11T01:01:08.658788+0000","last_unstale":"2024-05-11T01:01:08.662245+0000","last_undegraded":"2024-05-11T01:01:08.662245+0000","last_fullsized":"2024-05-11T01:01:08.662245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641388+0000","last_change":"2024-05-11T01:01:08.641388+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641388+0000","last_undegraded":"2024-05-11T01:01:08.641388+0000","last_fullsized":"2024-05-11T01:01:08.641388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652177+0000","last_change":"2024-05-11T01:01:08.648835+0000","last_active":"2024-05-11T01:01:08.652177+0000","last_peered":"2024-05-11T01:01:08.652177+0000","last_clean":"2024-05-11T01:01:08.652177+0000","last_became_active":"2024-05-11T01:01:08.648420+0000","last_became_peered":"2024-05-11T01:01:08.648420+0000","last_unstale":"2024-05-11T01:01:08.652177+0000","last_undegraded":"2024-05-11T01:01:08.652177+0000","last_fullsized":"2024-05-11T01:01:08.652177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645286+0000","last_change":"2024-05-11T01:01:08.645286+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645286+0000","last_undegraded":"2024-05-11T01:01:08.645286+0000","last_fullsized":"2024-05-11T01:01:08.645286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.656834+0000","last_change":"2024-05-11T01:01:08.655055+0000","last_active":"2024-05-11T01:01:08.656834+0000","last_peered":"2024-05-11T01:01:08.656834+0000","last_clean":"2024-05-11T01:01:08.656834+0000","last_became_active":"2024-05-11T01:01:08.654780+0000","last_became_peered":"2024-05-11T01:01:08.654780+0000","last_unstale":"2024-05-11T01:01:08.656834+0000","last_undegraded":"2024-05-11T01:01:08.656834+0000","last_fullsized":"2024-05-11T01:01:08.656834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640283+0000","last_change":"2024-05-11T01:01:08.640283+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640283+0000","last_undegraded":"2024-05-11T01:01:08.640283+0000","last_fullsized":"2024-05-11T01:01:08.640283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657314+0000","last_change":"2024-05-11T01:01:08.656434+0000","last_active":"2024-05-11T01:01:08.657314+0000","last_peered":"2024-05-11T01:01:08.657314+0000","last_clean":"2024-05-11T01:01:08.657314+0000","last_became_active":"2024-05-11T01:01:08.656111+0000","last_became_peered":"2024-05-11T01:01:08.656111+0000","last_unstale":"2024-05-11T01:01:08.657314+0000","last_undegraded":"2024-05-11T01:01:08.657314+0000","last_fullsized":"2024-05-11T01:01:08.657314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643150+0000","last_change":"2024-05-11T01:01:08.643150+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643150+0000","last_undegraded":"2024-05-11T01:01:08.643150+0000","last_fullsized":"2024-05-11T01:01:08.643150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658349+0000","last_change":"2024-05-11T01:01:08.656666+0000","last_active":"2024-05-11T01:01:08.658349+0000","last_peered":"2024-05-11T01:01:08.658349+0000","last_clean":"2024-05-11T01:01:08.658349+0000","last_became_active":"2024-05-11T01:01:08.656387+0000","last_became_peered":"2024-05-11T01:01:08.656387+0000","last_unstale":"2024-05-11T01:01:08.658349+0000","last_undegraded":"2024-05-11T01:01:08.658349+0000","last_fullsized":"2024-05-11T01:01:08.658349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642800+0000","last_change":"2024-05-11T01:01:08.642800+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642800+0000","last_undegraded":"2024-05-11T01:01:08.642800+0000","last_fullsized":"2024-05-11T01:01:08.642800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659261+0000","last_change":"2024-05-11T01:01:08.658432+0000","last_active":"2024-05-11T01:01:08.659261+0000","last_peered":"2024-05-11T01:01:08.659261+0000","last_clean":"2024-05-11T01:01:08.659261+0000","last_became_active":"2024-05-11T01:01:08.658089+0000","last_became_peered":"2024-05-11T01:01:08.658089+0000","last_unstale":"2024-05-11T01:01:08.659261+0000","last_undegraded":"2024-05-11T01:01:08.659261+0000","last_fullsized":"2024-05-11T01:01:08.659261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645040+0000","last_change":"2024-05-11T01:01:08.645040+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645040+0000","last_undegraded":"2024-05-11T01:01:08.645040+0000","last_fullsized":"2024-05-11T01:01:08.645040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659659+0000","last_change":"2024-05-11T01:01:08.658073+0000","last_active":"2024-05-11T01:01:08.659659+0000","last_peered":"2024-05-11T01:01:08.659659+0000","last_clean":"2024-05-11T01:01:08.659659+0000","last_became_active":"2024-05-11T01:01:08.657786+0000","last_became_peered":"2024-05-11T01:01:08.657786+0000","last_unstale":"2024-05-11T01:01:08.659659+0000","last_undegraded":"2024-05-11T01:01:08.659659+0000","last_fullsized":"2024-05-11T01:01:08.659659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645372+0000","last_change":"2024-05-11T01:01:08.645372+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645372+0000","last_undegraded":"2024-05-11T01:01:08.645372+0000","last_fullsized":"2024-05-11T01:01:08.645372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662168+0000","last_change":"2024-05-11T01:01:08.658520+0000","last_active":"2024-05-11T01:01:08.662168+0000","last_peered":"2024-05-11T01:01:08.662168+0000","last_clean":"2024-05-11T01:01:08.662168+0000","last_became_active":"2024-05-11T01:01:08.657670+0000","last_became_peered":"2024-05-11T01:01:08.657670+0000","last_unstale":"2024-05-11T01:01:08.662168+0000","last_undegraded":"2024-05-11T01:01:08.662168+0000","last_fullsized":"2024-05-11T01:01:08.662168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640245+0000","last_change":"2024-05-11T01:01:08.640245+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640245+0000","last_undegraded":"2024-05-11T01:01:08.640245+0000","last_fullsized":"2024-05-11T01:01:08.640245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654911+0000","last_change":"2024-05-11T01:01:08.653589+0000","last_active":"2024-05-11T01:01:08.654911+0000","last_peered":"2024-05-11T01:01:08.654911+0000","last_clean":"2024-05-11T01:01:08.654911+0000","last_became_active":"2024-05-11T01:01:08.653254+0000","last_became_peered":"2024-05-11T01:01:08.653254+0000","last_unstale":"2024-05-11T01:01:08.654911+0000","last_undegraded":"2024-05-11T01:01:08.654911+0000","last_fullsized":"2024-05-11T01:01:08.654911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643424+0000","last_change":"2024-05-11T01:01:08.643424+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643424+0000","last_undegraded":"2024-05-11T01:01:08.643424+0000","last_fullsized":"2024-05-11T01:01:08.643424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.655230+0000","last_change":"2024-05-11T01:01:08.653913+0000","last_active":"2024-05-11T01:01:08.655230+0000","last_peered":"2024-05-11T01:01:08.655230+0000","last_clean":"2024-05-11T01:01:08.655230+0000","last_became_active":"2024-05-11T01:01:08.653485+0000","last_became_peered":"2024-05-11T01:01:08.653485+0000","last_unstale":"2024-05-11T01:01:08.655230+0000","last_undegraded":"2024-05-11T01:01:08.655230+0000","last_fullsized":"2024-05-11T01:01:08.655230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641461+0000","last_change":"2024-05-11T01:01:08.641461+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641461+0000","last_undegraded":"2024-05-11T01:01:08.641461+0000","last_fullsized":"2024-05-11T01:01:08.641461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662174+0000","last_change":"2024-05-11T01:01:08.658594+0000","last_active":"2024-05-11T01:01:08.662174+0000","last_peered":"2024-05-11T01:01:08.662174+0000","last_clean":"2024-05-11T01:01:08.662174+0000","last_became_active":"2024-05-11T01:01:08.658310+0000","last_became_peered":"2024-05-11T01:01:08.658310+0000","last_unstale":"2024-05-11T01:01:08.662174+0000","last_undegraded":"2024-05-11T01:01:08.662174+0000","last_fullsized":"2024-05-11T01:01:08.662174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649153+0000","last_change":"2024-05-11T01:01:08.649153+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649153+0000","last_undegraded":"2024-05-11T01:01:08.649153+0000","last_fullsized":"2024-05-11T01:01:08.649153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644055+0000","last_change":"2024-05-11T01:01:08.644055+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644055+0000","last_undegraded":"2024-05-11T01:01:08.644055+0000","last_fullsized":"2024-05-11T01:01:08.644055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657607+0000","last_change":"2024-05-11T01:01:08.656072+0000","last_active":"2024-05-11T01:01:08.657607+0000","last_peered":"2024-05-11T01:01:08.657607+0000","last_clean":"2024-05-11T01:01:08.657607+0000","last_became_active":"2024-05-11T01:01:08.655793+0000","last_became_peered":"2024-05-11T01:01:08.655793+0000","last_unstale":"2024-05-11T01:01:08.657607+0000","last_undegraded":"2024-05-11T01:01:08.657607+0000","last_fullsized":"2024-05-11T01:01:08.657607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645151+0000","last_change":"2024-05-11T01:01:08.645151+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645151+0000","last_undegraded":"2024-05-11T01:01:08.645151+0000","last_fullsized":"2024-05-11T01:01:08.645151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662225+0000","last_change":"2024-05-11T01:01:08.659252+0000","last_active":"2024-05-11T01:01:08.662225+0000","last_peered":"2024-05-11T01:01:08.662225+0000","last_clean":"2024-05-11T01:01:08.662225+0000","last_became_active":"2024-05-11T01:01:08.658942+0000","last_became_peered":"2024-05-11T01:01:08.658942+0000","last_unstale":"2024-05-11T01:01:08.662225+0000","last_undegraded":"2024-05-11T01:01:08.662225+0000","last_fullsized":"2024-05-11T01:01:08.662225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647766+0000","last_change":"2024-05-11T01:01:08.647766+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647766+0000","last_undegraded":"2024-05-11T01:01:08.647766+0000","last_fullsized":"2024-05-11T01:01:08.647766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657530+0000","last_change":"2024-05-11T01:01:08.655897+0000","last_active":"2024-05-11T01:01:08.657530+0000","last_peered":"2024-05-11T01:01:08.657530+0000","last_clean":"2024-05-11T01:01:08.657530+0000","last_became_active":"2024-05-11T01:01:08.655602+0000","last_became_peered":"2024-05-11T01:01:08.655602+0000","last_unstale":"2024-05-11T01:01:08.657530+0000","last_undegraded":"2024-05-11T01:01:08.657530+0000","last_fullsized":"2024-05-11T01:01:08.657530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644257+0000","last_change":"2024-05-11T01:01:08.644257+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644257+0000","last_undegraded":"2024-05-11T01:01:08.644257+0000","last_fullsized":"2024-05-11T01:01:08.644257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658738+0000","last_change":"2024-05-11T01:01:08.657362+0000","last_active":"2024-05-11T01:01:08.658738+0000","last_peered":"2024-05-11T01:01:08.658738+0000","last_clean":"2024-05-11T01:01:08.658738+0000","last_became_active":"2024-05-11T01:01:08.657072+0000","last_became_peered":"2024-05-11T01:01:08.657072+0000","last_unstale":"2024-05-11T01:01:08.658738+0000","last_undegraded":"2024-05-11T01:01:08.658738+0000","last_fullsized":"2024-05-11T01:01:08.658738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":774144,"data_stored":648227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:13.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:13.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.835+0000 7fd9230b0640 1 Processor -- start 2024-05-11T01:01:13.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.835+0000 7fd9230b0640 1 -- start start 2024-05-11T01:01:13.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.835+0000 7fd9230b0640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd91c0cefe0 0x7fd91c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.835+0000 7fd9230b0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd91c0cffc0 0x7fd91c1631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.835+0000 7fd9230b0640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91c06f520 con 0x7fd91c06f0b0 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.835+0000 7fd9230b0640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd91c0d0cf0 con 0x7fd91c0cffc0 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.835+0000 7fd9230b0640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fd91c071210 con 0x7fd91c0cefe0 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.835+0000 7fd92164d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd91c0cffc0 0x7fd91c1631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.836+0000 7fd92164d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd91c0cffc0 0x7fd91c1631d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39828/0 (socket says 172.21.15.16:39828) 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.836+0000 7fd92164d640 1 -- 172.21.15.16:0/4220287906 learned_addr learned my addr 172.21.15.16:0/4220287906 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.836+0000 7fd920e4c640 1 --2- 172.21.15.16:0/4220287906 >> v2:172.21.15.174:3300/0 conn(0x7fd91c0cefe0 0x7fd91c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.836+0000 7fd92164d640 1 -- 172.21.15.16:0/4220287906 >> v2:172.21.15.174:3300/0 conn(0x7fd91c0cefe0 msgr2=0x7fd91c0b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.836+0000 7fd92164d640 1 --2- 172.21.15.16:0/4220287906 >> v2:172.21.15.174:3300/0 conn(0x7fd91c0cefe0 0x7fd91c0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.836+0000 7fd92164d640 1 -- 172.21.15.16:0/4220287906 >> v1:172.21.15.174:6789/0 conn(0x7fd91c06f0b0 legacy=0x7fd91c0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:13.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.836+0000 7fd92164d640 1 -- 172.21.15.16:0/4220287906 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c0714f0 con 0x7fd91c0cffc0 2024-05-11T01:01:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd92164d640 1 --2- 172.21.15.16:0/4220287906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c0cffc0 0x7fd91c1631d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd914009e50 tx=0x7fd91402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989d0d2cfb263e18 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd91b7fe640 1 -- 172.21.15.16:0/4220287906 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914036070 con 0x7fd91c0cffc0 2024-05-11T01:01:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd91b7fe640 1 -- 172.21.15.16:0/4220287906 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd914031600 con 0x7fd91c0cffc0 2024-05-11T01:01:13.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd91b7fe640 1 -- 172.21.15.16:0/4220287906 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9140319d0 con 0x7fd91c0cffc0 2024-05-11T01:01:13.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd9230b0640 1 -- 172.21.15.16:0/4220287906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c0cffc0 msgr2=0x7fd91c1631d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd9230b0640 1 --2- 172.21.15.16:0/4220287906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c0cffc0 0x7fd91c1631d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd914009e50 tx=0x7fd91402a630 comp rx=0 tx=0).stop 2024-05-11T01:01:13.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd9230b0640 1 -- 172.21.15.16:0/4220287906 shutdown_connections 2024-05-11T01:01:13.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd9230b0640 1 --2- 172.21.15.16:0/4220287906 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c0cffc0 0x7fd91c1631d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd9230b0640 1 --2- 172.21.15.16:0/4220287906 >> v2:172.21.15.174:3300/0 conn(0x7fd91c0cefe0 0x7fd91c0b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd9230b0640 1 -- 172.21.15.16:0/4220287906 >> 172.21.15.16:0/4220287906 conn(0x7fd91c072b60 msgr2=0x7fd91c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:13.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd9230b0640 1 -- 172.21.15.16:0/4220287906 shutdown_connections 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.837+0000 7fd9230b0640 1 -- 172.21.15.16:0/4220287906 wait complete. 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.838+0000 7fd9230b0640 1 Processor -- start 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd9230b0640 1 -- start start 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd9230b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c06f0b0 0x7fd91c0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd9230b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c0cefe0 0x7fd91c15fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd9230b0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91c0cffc0 0x7fd91c1f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd9230b0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c0cf3c0 con 0x7fd91c06f0b0 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd9230b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd91c0d1220 con 0x7fd91c0cefe0 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd9230b0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd91c163710 con 0x7fd91c0cffc0 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd920e4c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c06f0b0 0x7fd91c0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.839+0000 7fd920e4c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c06f0b0 0x7fd91c0c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39844/0 (socket says 172.21.15.16:39844) 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd920e4c640 1 -- 172.21.15.16:0/3510818519 learned_addr learned my addr 172.21.15.16:0/3510818519 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:13.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd92164d640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91c0cffc0 0x7fd91c1f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd920e4c640 1 -- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91c0cffc0 msgr2=0x7fd91c1f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd91bfff640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c0cefe0 0x7fd91c15fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd920e4c640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91c0cffc0 0x7fd91c1f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd920e4c640 1 -- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c0cefe0 msgr2=0x7fd91c15fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd920e4c640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c0cefe0 0x7fd91c15fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd920e4c640 1 -- 172.21.15.16:0/3510818519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91c0c7500 con 0x7fd91c06f0b0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd91bfff640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c0cefe0 0x7fd91c15fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd920e4c640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c06f0b0 0x7fd91c0c85a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c7f0 tx=0x7fd91000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd9197fa640 1 -- 172.21.15.16:0/3510818519 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910015070 con 0x7fd91c06f0b0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd9197fa640 1 -- 172.21.15.16:0/3510818519 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd910004240 con 0x7fd91c06f0b0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd91c0c77e0 con 0x7fd91c06f0b0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd9197fa640 1 -- 172.21.15.16:0/3510818519 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910007620 con 0x7fd91c06f0b0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.840+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd91c0c8080 con 0x7fd91c06f0b0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.841+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd91c0c7bd0 con 0x7fd91c06f0b0 2024-05-11T01:01:13.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.842+0000 7fd9197fa640 1 -- 172.21.15.16:0/3510818519 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd9100077c0 con 0x7fd91c06f0b0 2024-05-11T01:01:13.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.842+0000 7fd9197fa640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd9000762d0 0x7fd900078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:13.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.842+0000 7fd9197fa640 1 -- 172.21.15.16:0/3510818519 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd910097830 con 0x7fd91c06f0b0 2024-05-11T01:01:13.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.842+0000 7fd91bfff640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd9000762d0 0x7fd900078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:13.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.843+0000 7fd91bfff640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd9000762d0 0x7fd900078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0c6b50 tx=0x7fd908009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:13.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:13.847+0000 7fd9197fa640 1 -- 172.21.15.16:0/3510818519 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd910061190 con 0x7fd91c06f0b0 2024-05-11T01:01:14.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.032+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd91c06a5b0 con 0x7fd9000762d0 2024-05-11T01:01:14.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.039+0000 7fd9197fa640 1 -- 172.21.15.16:0/3510818519 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246612 (secure 0 0 0) 0x7fd908054370 con 0x7fd9000762d0 2024-05-11T01:01:14.042 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:14.043 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:14.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd9000762d0 msgr2=0x7fd900078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd9000762d0 0x7fd900078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0c6b50 tx=0x7fd908009040 comp rx=0 tx=0).stop 2024-05-11T01:01:14.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c06f0b0 msgr2=0x7fd91c0c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c06f0b0 0x7fd91c0c85a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c7f0 tx=0x7fd91000ccb0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 shutdown_connections 2024-05-11T01:01:14.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd9000762d0 0x7fd900078790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd91c0cffc0 0x7fd91c1f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91c0cefe0 0x7fd91c15fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 --2- 172.21.15.16:0/3510818519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd91c06f0b0 0x7fd91c0c85a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 >> 172.21.15.16:0/3510818519 conn(0x7fd91c072b60 msgr2=0x7fd91c15c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:14.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 shutdown_connections 2024-05-11T01:01:14.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.041+0000 7fd9230b0640 1 -- 172.21.15.16:0/3510818519 wait complete. 2024-05-11T01:01:14.053 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-11T01:01:13.755895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235808,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738912,"statfs":{"total":773094113280,"available":772852645888,"internally_reserved":0,"allocated":2555904,"data_stored":1605958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.117443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644587+0000","last_change":"2024-05-11T01:01:08.644587+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644587+0000","last_undegraded":"2024-05-11T01:01:08.644587+0000","last_fullsized":"2024-05-11T01:01:08.644587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642284+0000","last_change":"2024-05-11T01:01:08.642284+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642284+0000","last_undegraded":"2024-05-11T01:01:08.642284+0000","last_fullsized":"2024-05-11T01:01:08.642284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641053+0000","last_change":"2024-05-11T01:01:08.641053+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641053+0000","last_undegraded":"2024-05-11T01:01:08.641053+0000","last_fullsized":"2024-05-11T01:01:08.641053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645618+0000","last_change":"2024-05-11T01:01:08.645618+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645618+0000","last_undegraded":"2024-05-11T01:01:08.645618+0000","last_fullsized":"2024-05-11T01:01:08.645618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646252+0000","last_change":"2024-05-11T01:01:08.646252+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646252+0000","last_undegraded":"2024-05-11T01:01:08.646252+0000","last_fullsized":"2024-05-11T01:01:08.646252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645404+0000","last_change":"2024-05-11T01:01:08.645404+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645404+0000","last_undegraded":"2024-05-11T01:01:08.645404+0000","last_fullsized":"2024-05-11T01:01:08.645404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645440+0000","last_change":"2024-05-11T01:01:08.645440+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645440+0000","last_undegraded":"2024-05-11T01:01:08.645440+0000","last_fullsized":"2024-05-11T01:01:08.645440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644464+0000","last_change":"2024-05-11T01:01:08.644464+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644464+0000","last_undegraded":"2024-05-11T01:01:08.644464+0000","last_fullsized":"2024-05-11T01:01:08.644464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642961+0000","last_change":"2024-05-11T01:01:08.642961+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642961+0000","last_undegraded":"2024-05-11T01:01:08.642961+0000","last_fullsized":"2024-05-11T01:01:08.642961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.650323+0000","last_change":"2024-05-11T01:01:08.650323+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.650323+0000","last_undegraded":"2024-05-11T01:01:08.650323+0000","last_fullsized":"2024-05-11T01:01:08.650323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.648064+0000","last_change":"2024-05-11T01:01:08.648064+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.648064+0000","last_undegraded":"2024-05-11T01:01:08.648064+0000","last_fullsized":"2024-05-11T01:01:08.648064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641104+0000","last_change":"2024-05-11T01:01:08.641104+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641104+0000","last_undegraded":"2024-05-11T01:01:08.641104+0000","last_fullsized":"2024-05-11T01:01:08.641104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643598+0000","last_change":"2024-05-11T01:01:08.643598+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643598+0000","last_undegraded":"2024-05-11T01:01:08.643598+0000","last_fullsized":"2024-05-11T01:01:08.643598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646386+0000","last_change":"2024-05-11T01:01:08.646386+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646386+0000","last_undegraded":"2024-05-11T01:01:08.646386+0000","last_fullsized":"2024-05-11T01:01:08.646386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642270+0000","last_change":"2024-05-11T01:01:08.642270+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642270+0000","last_undegraded":"2024-05-11T01:01:08.642270+0000","last_fullsized":"2024-05-11T01:01:08.642270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644542+0000","last_change":"2024-05-11T01:01:08.644542+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644542+0000","last_undegraded":"2024-05-11T01:01:08.644542+0000","last_fullsized":"2024-05-11T01:01:08.644542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643764+0000","last_change":"2024-05-11T01:01:08.643764+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643764+0000","last_undegraded":"2024-05-11T01:01:08.643764+0000","last_fullsized":"2024-05-11T01:01:08.643764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640129+0000","last_change":"2024-05-11T01:01:08.640129+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640129+0000","last_undegraded":"2024-05-11T01:01:08.640129+0000","last_fullsized":"2024-05-11T01:01:08.640129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640689+0000","last_change":"2024-05-11T01:01:08.640689+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640689+0000","last_undegraded":"2024-05-11T01:01:08.640689+0000","last_fullsized":"2024-05-11T01:01:08.640689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649549+0000","last_change":"2024-05-11T01:01:08.649549+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649549+0000","last_undegraded":"2024-05-11T01:01:08.649549+0000","last_fullsized":"2024-05-11T01:01:08.649549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647484+0000","last_change":"2024-05-11T01:01:08.647484+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647484+0000","last_undegraded":"2024-05-11T01:01:08.647484+0000","last_fullsized":"2024-05-11T01:01:08.647484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644705+0000","last_change":"2024-05-11T01:01:08.644705+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644705+0000","last_undegraded":"2024-05-11T01:01:08.644705+0000","last_fullsized":"2024-05-11T01:01:08.644705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644526+0000","last_change":"2024-05-11T01:01:08.644526+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644526+0000","last_undegraded":"2024-05-11T01:01:08.644526+0000","last_fullsized":"2024-05-11T01:01:08.644526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642937+0000","last_change":"2024-05-11T01:01:08.642937+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642937+0000","last_undegraded":"2024-05-11T01:01:08.642937+0000","last_fullsized":"2024-05-11T01:01:08.642937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645521+0000","last_change":"2024-05-11T01:01:08.645521+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645521+0000","last_undegraded":"2024-05-11T01:01:08.645521+0000","last_fullsized":"2024-05-11T01:01:08.645521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649780+0000","last_change":"2024-05-11T01:01:08.649780+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649780+0000","last_undegraded":"2024-05-11T01:01:08.649780+0000","last_fullsized":"2024-05-11T01:01:08.649780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643709+0000","last_change":"2024-05-11T01:01:08.643709+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643709+0000","last_undegraded":"2024-05-11T01:01:08.643709+0000","last_fullsized":"2024-05-11T01:01:08.643709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642008+0000","last_change":"2024-05-11T01:01:08.642008+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642008+0000","last_undegraded":"2024-05-11T01:01:08.642008+0000","last_fullsized":"2024-05-11T01:01:08.642008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646983+0000","last_change":"2024-05-11T01:01:08.646983+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646983+0000","last_undegraded":"2024-05-11T01:01:08.646983+0000","last_fullsized":"2024-05-11T01:01:08.646983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644147+0000","last_change":"2024-05-11T01:01:08.644147+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644147+0000","last_undegraded":"2024-05-11T01:01:08.644147+0000","last_fullsized":"2024-05-11T01:01:08.644147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640318+0000","last_change":"2024-05-11T01:01:08.640318+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640318+0000","last_undegraded":"2024-05-11T01:01:08.640318+0000","last_fullsized":"2024-05-11T01:01:08.640318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647230+0000","last_change":"2024-05-11T01:01:08.647230+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647230+0000","last_undegraded":"2024-05-11T01:01:08.647230+0000","last_fullsized":"2024-05-11T01:01:08.647230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640153+0000","last_change":"2024-05-11T01:01:08.640153+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640153+0000","last_undegraded":"2024-05-11T01:01:08.640153+0000","last_fullsized":"2024-05-11T01:01:08.640153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658304+0000","last_change":"2024-05-11T01:01:08.656899+0000","last_active":"2024-05-11T01:01:08.658304+0000","last_peered":"2024-05-11T01:01:08.658304+0000","last_clean":"2024-05-11T01:01:08.658304+0000","last_became_active":"2024-05-11T01:01:08.656569+0000","last_became_peered":"2024-05-11T01:01:08.656569+0000","last_unstale":"2024-05-11T01:01:08.658304+0000","last_undegraded":"2024-05-11T01:01:08.658304+0000","last_fullsized":"2024-05-11T01:01:08.658304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643486+0000","last_change":"2024-05-11T01:01:08.643486+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643486+0000","last_undegraded":"2024-05-11T01:01:08.643486+0000","last_fullsized":"2024-05-11T01:01:08.643486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.655969+0000","last_change":"2024-05-11T01:01:08.651945+0000","last_active":"2024-05-11T01:01:08.655969+0000","last_peered":"2024-05-11T01:01:08.655969+0000","last_clean":"2024-05-11T01:01:08.655969+0000","last_became_active":"2024-05-11T01:01:08.651681+0000","last_became_peered":"2024-05-11T01:01:08.651681+0000","last_unstale":"2024-05-11T01:01:08.655969+0000","last_undegraded":"2024-05-11T01:01:08.655969+0000","last_fullsized":"2024-05-11T01:01:08.655969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659704+0000","last_change":"2024-05-11T01:01:08.658922+0000","last_active":"2024-05-11T01:01:08.659704+0000","last_peered":"2024-05-11T01:01:08.659704+0000","last_clean":"2024-05-11T01:01:08.659704+0000","last_became_active":"2024-05-11T01:01:08.658620+0000","last_became_peered":"2024-05-11T01:01:08.658620+0000","last_unstale":"2024-05-11T01:01:08.659704+0000","last_undegraded":"2024-05-11T01:01:08.659704+0000","last_fullsized":"2024-05-11T01:01:08.659704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643967+0000","last_change":"2024-05-11T01:01:08.643967+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643967+0000","last_undegraded":"2024-05-11T01:01:08.643967+0000","last_fullsized":"2024-05-11T01:01:08.643967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.650072+0000","last_change":"2024-05-11T01:01:08.647703+0000","last_active":"2024-05-11T01:01:08.650072+0000","last_peered":"2024-05-11T01:01:08.650072+0000","last_clean":"2024-05-11T01:01:08.650072+0000","last_became_active":"2024-05-11T01:01:08.647434+0000","last_became_peered":"2024-05-11T01:01:08.647434+0000","last_unstale":"2024-05-11T01:01:08.650072+0000","last_undegraded":"2024-05-11T01:01:08.650072+0000","last_fullsized":"2024-05-11T01:01:08.650072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644170+0000","last_change":"2024-05-11T01:01:08.644170+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644170+0000","last_undegraded":"2024-05-11T01:01:08.644170+0000","last_fullsized":"2024-05-11T01:01:08.644170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.656123+0000","last_change":"2024-05-11T01:01:08.655160+0000","last_active":"2024-05-11T01:01:08.656123+0000","last_peered":"2024-05-11T01:01:08.656123+0000","last_clean":"2024-05-11T01:01:08.656123+0000","last_became_active":"2024-05-11T01:01:08.654886+0000","last_became_peered":"2024-05-11T01:01:08.654886+0000","last_unstale":"2024-05-11T01:01:08.656123+0000","last_undegraded":"2024-05-11T01:01:08.656123+0000","last_fullsized":"2024-05-11T01:01:08.656123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643532+0000","last_change":"2024-05-11T01:01:08.643532+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643532+0000","last_undegraded":"2024-05-11T01:01:08.643532+0000","last_fullsized":"2024-05-11T01:01:08.643532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657466+0000","last_change":"2024-05-11T01:01:08.655815+0000","last_active":"2024-05-11T01:01:08.657466+0000","last_peered":"2024-05-11T01:01:08.657466+0000","last_clean":"2024-05-11T01:01:08.657466+0000","last_became_active":"2024-05-11T01:01:08.655307+0000","last_became_peered":"2024-05-11T01:01:08.655307+0000","last_unstale":"2024-05-11T01:01:08.657466+0000","last_undegraded":"2024-05-11T01:01:08.657466+0000","last_fullsized":"2024-05-11T01:01:08.657466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646042+0000","last_change":"2024-05-11T01:01:08.646042+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646042+0000","last_undegraded":"2024-05-11T01:01:08.646042+0000","last_fullsized":"2024-05-11T01:01:08.646042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654599+0000","last_change":"2024-05-11T01:01:08.653490+0000","last_active":"2024-05-11T01:01:08.654599+0000","last_peered":"2024-05-11T01:01:08.654599+0000","last_clean":"2024-05-11T01:01:08.654599+0000","last_became_active":"2024-05-11T01:01:08.653133+0000","last_became_peered":"2024-05-11T01:01:08.653133+0000","last_unstale":"2024-05-11T01:01:08.654599+0000","last_undegraded":"2024-05-11T01:01:08.654599+0000","last_fullsized":"2024-05-11T01:01:08.654599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640364+0000","last_change":"2024-05-11T01:01:08.640364+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640364+0000","last_undegraded":"2024-05-11T01:01:08.640364+0000","last_fullsized":"2024-05-11T01:01:08.640364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657197+0000","last_change":"2024-05-11T01:01:08.654417+0000","last_active":"2024-05-11T01:01:08.657197+0000","last_peered":"2024-05-11T01:01:08.657197+0000","last_clean":"2024-05-11T01:01:08.657197+0000","last_became_active":"2024-05-11T01:01:08.654147+0000","last_became_peered":"2024-05-11T01:01:08.654147+0000","last_unstale":"2024-05-11T01:01:08.657197+0000","last_undegraded":"2024-05-11T01:01:08.657197+0000","last_fullsized":"2024-05-11T01:01:08.657197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645095+0000","last_change":"2024-05-11T01:01:08.645095+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645095+0000","last_undegraded":"2024-05-11T01:01:08.645095+0000","last_fullsized":"2024-05-11T01:01:08.645095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657420+0000","last_change":"2024-05-11T01:01:08.655493+0000","last_active":"2024-05-11T01:01:08.657420+0000","last_peered":"2024-05-11T01:01:08.657420+0000","last_clean":"2024-05-11T01:01:08.657420+0000","last_became_active":"2024-05-11T01:01:08.655147+0000","last_became_peered":"2024-05-11T01:01:08.655147+0000","last_unstale":"2024-05-11T01:01:08.657420+0000","last_undegraded":"2024-05-11T01:01:08.657420+0000","last_fullsized":"2024-05-11T01:01:08.657420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641701+0000","last_change":"2024-05-11T01:01:08.641701+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641701+0000","last_undegraded":"2024-05-11T01:01:08.641701+0000","last_fullsized":"2024-05-11T01:01:08.641701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.651846+0000","last_change":"2024-05-11T01:01:08.648494+0000","last_active":"2024-05-11T01:01:08.651846+0000","last_peered":"2024-05-11T01:01:08.651846+0000","last_clean":"2024-05-11T01:01:08.651846+0000","last_became_active":"2024-05-11T01:01:08.648206+0000","last_became_peered":"2024-05-11T01:01:08.648206+0000","last_unstale":"2024-05-11T01:01:08.651846+0000","last_undegraded":"2024-05-11T01:01:08.651846+0000","last_fullsized":"2024-05-11T01:01:08.651846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642014+0000","last_change":"2024-05-11T01:01:08.642014+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642014+0000","last_undegraded":"2024-05-11T01:01:08.642014+0000","last_fullsized":"2024-05-11T01:01:08.642014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658274+0000","last_change":"2024-05-11T01:01:08.655771+0000","last_active":"2024-05-11T01:01:08.658274+0000","last_peered":"2024-05-11T01:01:08.658274+0000","last_clean":"2024-05-11T01:01:08.658274+0000","last_became_active":"2024-05-11T01:01:08.655462+0000","last_became_peered":"2024-05-11T01:01:08.655462+0000","last_unstale":"2024-05-11T01:01:08.658274+0000","last_undegraded":"2024-05-11T01:01:08.658274+0000","last_fullsized":"2024-05-11T01:01:08.658274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646474+0000","last_change":"2024-05-11T01:01:08.646474+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646474+0000","last_undegraded":"2024-05-11T01:01:08.646474+0000","last_fullsized":"2024-05-11T01:01:08.646474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652346+0000","last_change":"2024-05-11T01:01:08.649715+0000","last_active":"2024-05-11T01:01:08.652346+0000","last_peered":"2024-05-11T01:01:08.652346+0000","last_clean":"2024-05-11T01:01:08.652346+0000","last_became_active":"2024-05-11T01:01:08.649344+0000","last_became_peered":"2024-05-11T01:01:08.649344+0000","last_unstale":"2024-05-11T01:01:08.652346+0000","last_undegraded":"2024-05-11T01:01:08.652346+0000","last_fullsized":"2024-05-11T01:01:08.652346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640890+0000","last_change":"2024-05-11T01:01:08.640890+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640890+0000","last_undegraded":"2024-05-11T01:01:08.640890+0000","last_fullsized":"2024-05-11T01:01:08.640890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658084+0000","last_change":"2024-05-11T01:01:08.656669+0000","last_active":"2024-05-11T01:01:08.658084+0000","last_peered":"2024-05-11T01:01:08.658084+0000","last_clean":"2024-05-11T01:01:08.658084+0000","last_became_active":"2024-05-11T01:01:08.656381+0000","last_became_peered":"2024-05-11T01:01:08.656381+0000","last_unstale":"2024-05-11T01:01:08.658084+0000","last_undegraded":"2024-05-11T01:01:08.658084+0000","last_fullsized":"2024-05-11T01:01:08.658084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641185+0000","last_change":"2024-05-11T01:01:08.641185+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641185+0000","last_undegraded":"2024-05-11T01:01:08.641185+0000","last_fullsized":"2024-05-11T01:01:08.641185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652983+0000","last_change":"2024-05-11T01:01:08.651433+0000","last_active":"2024-05-11T01:01:08.652983+0000","last_peered":"2024-05-11T01:01:08.652983+0000","last_clean":"2024-05-11T01:01:08.652983+0000","last_became_active":"2024-05-11T01:01:08.650413+0000","last_became_peered":"2024-05-11T01:01:08.650413+0000","last_unstale":"2024-05-11T01:01:08.652983+0000","last_undegraded":"2024-05-11T01:01:08.652983+0000","last_fullsized":"2024-05-11T01:01:08.652983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640813+0000","last_change":"2024-05-11T01:01:08.640813+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640813+0000","last_undegraded":"2024-05-11T01:01:08.640813+0000","last_fullsized":"2024-05-11T01:01:08.640813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652563+0000","last_change":"2024-05-11T01:01:08.648337+0000","last_active":"2024-05-11T01:01:08.652563+0000","last_peered":"2024-05-11T01:01:08.652563+0000","last_clean":"2024-05-11T01:01:08.652563+0000","last_became_active":"2024-05-11T01:01:08.648027+0000","last_became_peered":"2024-05-11T01:01:08.648027+0000","last_unstale":"2024-05-11T01:01:08.652563+0000","last_undegraded":"2024-05-11T01:01:08.652563+0000","last_fullsized":"2024-05-11T01:01:08.652563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644072+0000","last_change":"2024-05-11T01:01:08.644072+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644072+0000","last_undegraded":"2024-05-11T01:01:08.644072+0000","last_fullsized":"2024-05-11T01:01:08.644072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.650047+0000","last_change":"2024-05-11T01:01:08.648806+0000","last_active":"2024-05-11T01:01:08.650047+0000","last_peered":"2024-05-11T01:01:08.650047+0000","last_clean":"2024-05-11T01:01:08.650047+0000","last_became_active":"2024-05-11T01:01:08.648140+0000","last_became_peered":"2024-05-11T01:01:08.648140+0000","last_unstale":"2024-05-11T01:01:08.650047+0000","last_undegraded":"2024-05-11T01:01:08.650047+0000","last_fullsized":"2024-05-11T01:01:08.650047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642340+0000","last_change":"2024-05-11T01:01:08.642340+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642340+0000","last_undegraded":"2024-05-11T01:01:08.642340+0000","last_fullsized":"2024-05-11T01:01:08.642340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.651516+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:08.651516+0000","last_peered":"2024-05-11T01:01:08.651516+0000","last_clean":"2024-05-11T01:01:08.651516+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:08.651516+0000","last_undegraded":"2024-05-11T01:01:08.651516+0000","last_fullsized":"2024-05-11T01:01:08.651516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654777+0000","last_change":"2024-05-11T01:01:08.649868+0000","last_active":"2024-05-11T01:01:08.654777+0000","last_peered":"2024-05-11T01:01:08.654777+0000","last_clean":"2024-05-11T01:01:08.654777+0000","last_became_active":"2024-05-11T01:01:08.649580+0000","last_became_peered":"2024-05-11T01:01:08.649580+0000","last_unstale":"2024-05-11T01:01:08.654777+0000","last_undegraded":"2024-05-11T01:01:08.654777+0000","last_fullsized":"2024-05-11T01:01:08.654777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642019+0000","last_change":"2024-05-11T01:01:08.642019+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642019+0000","last_undegraded":"2024-05-11T01:01:08.642019+0000","last_fullsized":"2024-05-11T01:01:08.642019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662245+0000","last_change":"2024-05-11T01:01:08.659302+0000","last_active":"2024-05-11T01:01:08.662245+0000","last_peered":"2024-05-11T01:01:08.662245+0000","last_clean":"2024-05-11T01:01:08.662245+0000","last_became_active":"2024-05-11T01:01:08.658788+0000","last_became_peered":"2024-05-11T01:01:08.658788+0000","last_unstale":"2024-05-11T01:01:08.662245+0000","last_undegraded":"2024-05-11T01:01:08.662245+0000","last_fullsized":"2024-05-11T01:01:08.662245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641388+0000","last_change":"2024-05-11T01:01:08.641388+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641388+0000","last_undegraded":"2024-05-11T01:01:08.641388+0000","last_fullsized":"2024-05-11T01:01:08.641388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652177+0000","last_change":"2024-05-11T01:01:08.648835+0000","last_active":"2024-05-11T01:01:08.652177+0000","last_peered":"2024-05-11T01:01:08.652177+0000","last_clean":"2024-05-11T01:01:08.652177+0000","last_became_active":"2024-05-11T01:01:08.648420+0000","last_became_peered":"2024-05-11T01:01:08.648420+0000","last_unstale":"2024-05-11T01:01:08.652177+0000","last_undegraded":"2024-05-11T01:01:08.652177+0000","last_fullsized":"2024-05-11T01:01:08.652177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645286+0000","last_change":"2024-05-11T01:01:08.645286+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645286+0000","last_undegraded":"2024-05-11T01:01:08.645286+0000","last_fullsized":"2024-05-11T01:01:08.645286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.656834+0000","last_change":"2024-05-11T01:01:08.655055+0000","last_active":"2024-05-11T01:01:08.656834+0000","last_peered":"2024-05-11T01:01:08.656834+0000","last_clean":"2024-05-11T01:01:08.656834+0000","last_became_active":"2024-05-11T01:01:08.654780+0000","last_became_peered":"2024-05-11T01:01:08.654780+0000","last_unstale":"2024-05-11T01:01:08.656834+0000","last_undegraded":"2024-05-11T01:01:08.656834+0000","last_fullsized":"2024-05-11T01:01:08.656834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640283+0000","last_change":"2024-05-11T01:01:08.640283+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640283+0000","last_undegraded":"2024-05-11T01:01:08.640283+0000","last_fullsized":"2024-05-11T01:01:08.640283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657314+0000","last_change":"2024-05-11T01:01:08.656434+0000","last_active":"2024-05-11T01:01:08.657314+0000","last_peered":"2024-05-11T01:01:08.657314+0000","last_clean":"2024-05-11T01:01:08.657314+0000","last_became_active":"2024-05-11T01:01:08.656111+0000","last_became_peered":"2024-05-11T01:01:08.656111+0000","last_unstale":"2024-05-11T01:01:08.657314+0000","last_undegraded":"2024-05-11T01:01:08.657314+0000","last_fullsized":"2024-05-11T01:01:08.657314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643150+0000","last_change":"2024-05-11T01:01:08.643150+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643150+0000","last_undegraded":"2024-05-11T01:01:08.643150+0000","last_fullsized":"2024-05-11T01:01:08.643150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658349+0000","last_change":"2024-05-11T01:01:08.656666+0000","last_active":"2024-05-11T01:01:08.658349+0000","last_peered":"2024-05-11T01:01:08.658349+0000","last_clean":"2024-05-11T01:01:08.658349+0000","last_became_active":"2024-05-11T01:01:08.656387+0000","last_became_peered":"2024-05-11T01:01:08.656387+0000","last_unstale":"2024-05-11T01:01:08.658349+0000","last_undegraded":"2024-05-11T01:01:08.658349+0000","last_fullsized":"2024-05-11T01:01:08.658349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642800+0000","last_change":"2024-05-11T01:01:08.642800+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642800+0000","last_undegraded":"2024-05-11T01:01:08.642800+0000","last_fullsized":"2024-05-11T01:01:08.642800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659261+0000","last_change":"2024-05-11T01:01:08.658432+0000","last_active":"2024-05-11T01:01:08.659261+0000","last_peered":"2024-05-11T01:01:08.659261+0000","last_clean":"2024-05-11T01:01:08.659261+0000","last_became_active":"2024-05-11T01:01:08.658089+0000","last_became_peered":"2024-05-11T01:01:08.658089+0000","last_unstale":"2024-05-11T01:01:08.659261+0000","last_undegraded":"2024-05-11T01:01:08.659261+0000","last_fullsized":"2024-05-11T01:01:08.659261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645040+0000","last_change":"2024-05-11T01:01:08.645040+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645040+0000","last_undegraded":"2024-05-11T01:01:08.645040+0000","last_fullsized":"2024-05-11T01:01:08.645040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659659+0000","last_change":"2024-05-11T01:01:08.658073+0000","last_active":"2024-05-11T01:01:08.659659+0000","last_peered":"2024-05-11T01:01:08.659659+0000","last_clean":"2024-05-11T01:01:08.659659+0000","last_became_active":"2024-05-11T01:01:08.657786+0000","last_became_peered":"2024-05-11T01:01:08.657786+0000","last_unstale":"2024-05-11T01:01:08.659659+0000","last_undegraded":"2024-05-11T01:01:08.659659+0000","last_fullsized":"2024-05-11T01:01:08.659659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645372+0000","last_change":"2024-05-11T01:01:08.645372+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645372+0000","last_undegraded":"2024-05-11T01:01:08.645372+0000","last_fullsized":"2024-05-11T01:01:08.645372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662168+0000","last_change":"2024-05-11T01:01:08.658520+0000","last_active":"2024-05-11T01:01:08.662168+0000","last_peered":"2024-05-11T01:01:08.662168+0000","last_clean":"2024-05-11T01:01:08.662168+0000","last_became_active":"2024-05-11T01:01:08.657670+0000","last_became_peered":"2024-05-11T01:01:08.657670+0000","last_unstale":"2024-05-11T01:01:08.662168+0000","last_undegraded":"2024-05-11T01:01:08.662168+0000","last_fullsized":"2024-05-11T01:01:08.662168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640245+0000","last_change":"2024-05-11T01:01:08.640245+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640245+0000","last_undegraded":"2024-05-11T01:01:08.640245+0000","last_fullsized":"2024-05-11T01:01:08.640245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654911+0000","last_change":"2024-05-11T01:01:08.653589+0000","last_active":"2024-05-11T01:01:08.654911+0000","last_peered":"2024-05-11T01:01:08.654911+0000","last_clean":"2024-05-11T01:01:08.654911+0000","last_became_active":"2024-05-11T01:01:08.653254+0000","last_became_peered":"2024-05-11T01:01:08.653254+0000","last_unstale":"2024-05-11T01:01:08.654911+0000","last_undegraded":"2024-05-11T01:01:08.654911+0000","last_fullsized":"2024-05-11T01:01:08.654911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643424+0000","last_change":"2024-05-11T01:01:08.643424+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643424+0000","last_undegraded":"2024-05-11T01:01:08.643424+0000","last_fullsized":"2024-05-11T01:01:08.643424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.655230+0000","last_change":"2024-05-11T01:01:08.653913+0000","last_active":"2024-05-11T01:01:08.655230+0000","last_peered":"2024-05-11T01:01:08.655230+0000","last_clean":"2024-05-11T01:01:08.655230+0000","last_became_active":"2024-05-11T01:01:08.653485+0000","last_became_peered":"2024-05-11T01:01:08.653485+0000","last_unstale":"2024-05-11T01:01:08.655230+0000","last_undegraded":"2024-05-11T01:01:08.655230+0000","last_fullsized":"2024-05-11T01:01:08.655230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641461+0000","last_change":"2024-05-11T01:01:08.641461+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641461+0000","last_undegraded":"2024-05-11T01:01:08.641461+0000","last_fullsized":"2024-05-11T01:01:08.641461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662174+0000","last_change":"2024-05-11T01:01:08.658594+0000","last_active":"2024-05-11T01:01:08.662174+0000","last_peered":"2024-05-11T01:01:08.662174+0000","last_clean":"2024-05-11T01:01:08.662174+0000","last_became_active":"2024-05-11T01:01:08.658310+0000","last_became_peered":"2024-05-11T01:01:08.658310+0000","last_unstale":"2024-05-11T01:01:08.662174+0000","last_undegraded":"2024-05-11T01:01:08.662174+0000","last_fullsized":"2024-05-11T01:01:08.662174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649153+0000","last_change":"2024-05-11T01:01:08.649153+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649153+0000","last_undegraded":"2024-05-11T01:01:08.649153+0000","last_fullsized":"2024-05-11T01:01:08.649153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644055+0000","last_change":"2024-05-11T01:01:08.644055+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644055+0000","last_undegraded":"2024-05-11T01:01:08.644055+0000","last_fullsized":"2024-05-11T01:01:08.644055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657607+0000","last_change":"2024-05-11T01:01:08.656072+0000","last_active":"2024-05-11T01:01:08.657607+0000","last_peered":"2024-05-11T01:01:08.657607+0000","last_clean":"2024-05-11T01:01:08.657607+0000","last_became_active":"2024-05-11T01:01:08.655793+0000","last_became_peered":"2024-05-11T01:01:08.655793+0000","last_unstale":"2024-05-11T01:01:08.657607+0000","last_undegraded":"2024-05-11T01:01:08.657607+0000","last_fullsized":"2024-05-11T01:01:08.657607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645151+0000","last_change":"2024-05-11T01:01:08.645151+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645151+0000","last_undegraded":"2024-05-11T01:01:08.645151+0000","last_fullsized":"2024-05-11T01:01:08.645151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662225+0000","last_change":"2024-05-11T01:01:08.659252+0000","last_active":"2024-05-11T01:01:08.662225+0000","last_peered":"2024-05-11T01:01:08.662225+0000","last_clean":"2024-05-11T01:01:08.662225+0000","last_became_active":"2024-05-11T01:01:08.658942+0000","last_became_peered":"2024-05-11T01:01:08.658942+0000","last_unstale":"2024-05-11T01:01:08.662225+0000","last_undegraded":"2024-05-11T01:01:08.662225+0000","last_fullsized":"2024-05-11T01:01:08.662225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647766+0000","last_change":"2024-05-11T01:01:08.647766+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647766+0000","last_undegraded":"2024-05-11T01:01:08.647766+0000","last_fullsized":"2024-05-11T01:01:08.647766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657530+0000","last_change":"2024-05-11T01:01:08.655897+0000","last_active":"2024-05-11T01:01:08.657530+0000","last_peered":"2024-05-11T01:01:08.657530+0000","last_clean":"2024-05-11T01:01:08.657530+0000","last_became_active":"2024-05-11T01:01:08.655602+0000","last_became_peered":"2024-05-11T01:01:08.655602+0000","last_unstale":"2024-05-11T01:01:08.657530+0000","last_undegraded":"2024-05-11T01:01:08.657530+0000","last_fullsized":"2024-05-11T01:01:08.657530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644257+0000","last_change":"2024-05-11T01:01:08.644257+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644257+0000","last_undegraded":"2024-05-11T01:01:08.644257+0000","last_fullsized":"2024-05-11T01:01:08.644257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658738+0000","last_change":"2024-05-11T01:01:08.657362+0000","last_active":"2024-05-11T01:01:08.658738+0000","last_peered":"2024-05-11T01:01:08.658738+0000","last_clean":"2024-05-11T01:01:08.658738+0000","last_became_active":"2024-05-11T01:01:08.657072+0000","last_became_peered":"2024-05-11T01:01:08.657072+0000","last_unstale":"2024-05-11T01:01:08.658738+0000","last_undegraded":"2024-05-11T01:01:08.658738+0000","last_fullsized":"2024-05-11T01:01:08.658738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":774144,"data_stored":648227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:14.057 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:14.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.197+0000 7f30a57c9640 1 Processor -- start 2024-05-11T01:01:14.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.197+0000 7f30a57c9640 1 -- start start 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.198+0000 7f30a57c9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30a006fba0 0x7f30a0163aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.198+0000 7f30a57c9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a0070860 con 0x7f30a00cdcf0 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.198+0000 7f30a57c9640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a0070580 con 0x7f30a006e7d0 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.198+0000 7f30a57c9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f30a00d0b40 con 0x7f30a006fba0 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.198+0000 7f309effd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f30a00cdcf0 0x7f30a00ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48744/0 (socket says 172.21.15.16:48744) 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.198+0000 7f309effd640 1 -- 172.21.15.16:0/851285061 learned_addr learned my addr 172.21.15.16:0/851285061 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.198+0000 7f3097fff640 1 --2- 172.21.15.16:0/851285061 >> v2:172.21.15.16:3300/0 conn(0x7f30a006fba0 0x7f30a0163aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.199+0000 7f309e7fc640 1 -- 172.21.15.16:0/851285061 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838768148 0 0) 0x7f30a0070860 con 0x7f30a00cdcf0 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.199+0000 7f309e7fc640 1 -- 172.21.15.16:0/851285061 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f308c003520 con 0x7f30a00cdcf0 2024-05-11T01:01:14.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.199+0000 7f3097fff640 1 -- 172.21.15.16:0/851285061 >> v1:172.21.15.174:6789/0 conn(0x7f30a006e7d0 legacy=0x7f30a006ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.199+0000 7f3097fff640 1 -- 172.21.15.16:0/851285061 >> v1:172.21.15.16:6789/0 conn(0x7f30a00cdcf0 legacy=0x7f30a00ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.199+0000 7f3097fff640 1 -- 172.21.15.16:0/851285061 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a00d0e20 con 0x7f30a006fba0 2024-05-11T01:01:14.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.199+0000 7f3097fff640 1 --2- 172.21.15.16:0/851285061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006fba0 0x7f30a0163aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30880097a0 tx=0x7f308802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc6519897164804 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f309e7fc640 1 -- 172.21.15.16:0/851285061 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088037070 con 0x7f30a006fba0 2024-05-11T01:01:14.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f309e7fc640 1 -- 172.21.15.16:0/851285061 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3088032440 con 0x7f30a006fba0 2024-05-11T01:01:14.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f309e7fc640 1 -- 172.21.15.16:0/851285061 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088032810 con 0x7f30a006fba0 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f30a57c9640 1 -- 172.21.15.16:0/851285061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006fba0 msgr2=0x7f30a0163aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f30a57c9640 1 --2- 172.21.15.16:0/851285061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006fba0 0x7f30a0163aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30880097a0 tx=0x7f308802a230 comp rx=0 tx=0).stop 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f30a57c9640 1 -- 172.21.15.16:0/851285061 shutdown_connections 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f30a57c9640 1 --2- 172.21.15.16:0/851285061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006fba0 0x7f30a0163aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f30a57c9640 1 -- 172.21.15.16:0/851285061 >> 172.21.15.16:0/851285061 conn(0x7f30a0072c70 msgr2=0x7f30a00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f30a57c9640 1 -- 172.21.15.16:0/851285061 shutdown_connections 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.200+0000 7f30a57c9640 1 -- 172.21.15.16:0/851285061 wait complete. 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.201+0000 7f30a57c9640 1 Processor -- start 2024-05-11T01:01:14.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.201+0000 7f30a57c9640 1 -- start start 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f30a57c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006e7d0 0x7f30a0151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f30a57c9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006fba0 0x7f30a0160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f30a57c9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00cdcf0 0x7f30a009a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f30a57c9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f30a00cb9e0 con 0x7f30a006e7d0 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f30a57c9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0162c50 con 0x7f30a006fba0 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f30a57c9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f30a00b43d0 con 0x7f30a00cdcf0 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f309effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006e7d0 0x7f30a0151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f309effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006e7d0 0x7f30a0151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39854/0 (socket says 172.21.15.16:39854) 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.202+0000 7f309effd640 1 -- 172.21.15.16:0/3297211541 learned_addr learned my addr 172.21.15.16:0/3297211541 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f3097fff640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006fba0 0x7f30a0160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f309f7fe640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00cdcf0 0x7f30a009a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f309effd640 1 -- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00cdcf0 msgr2=0x7f30a009a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f309effd640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00cdcf0 0x7f30a009a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f309effd640 1 -- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006fba0 msgr2=0x7f30a0160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f309effd640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006fba0 0x7f30a0160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f309effd640 1 -- 172.21.15.16:0/3297211541 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a00b46b0 con 0x7f30a006e7d0 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f309f7fe640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00cdcf0 0x7f30a009a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f309effd640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006e7d0 0x7f30a0151050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f309000c500 tx=0x7f309000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f30977fe640 1 -- 172.21.15.16:0/3297211541 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090017070 con 0x7f30a006e7d0 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f30977fe640 1 -- 172.21.15.16:0/3297211541 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3090005ce0 con 0x7f30a006e7d0 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a0150570 con 0x7f30a006e7d0 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f30977fe640 1 -- 172.21.15.16:0/3297211541 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090007270 con 0x7f30a006e7d0 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.203+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a0150b30 con 0x7f30a006e7d0 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.204+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a006a5b0 con 0x7f30a006e7d0 2024-05-11T01:01:14.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.205+0000 7f30977fe640 1 -- 172.21.15.16:0/3297211541 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f309001a070 con 0x7f30a006e7d0 2024-05-11T01:01:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.205+0000 7f30977fe640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3080076300 0x7f30800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.206+0000 7f30977fe640 1 -- 172.21.15.16:0/3297211541 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3090096890 con 0x7f30a006e7d0 2024-05-11T01:01:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.206+0000 7f3097fff640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3080076300 0x7f30800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.206+0000 7f3097fff640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3080076300 0x7f30800787c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3088034000 tx=0x7f308802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.210+0000 7f30977fe640 1 -- 172.21.15.16:0/3297211541 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f309005fb90 con 0x7f30a006e7d0 2024-05-11T01:01:14.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.397+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30a0150d70 con 0x7f3080076300 2024-05-11T01:01:14.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.404+0000 7f30977fe640 1 -- 172.21.15.16:0/3297211541 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246612 (secure 0 0 0) 0x7f30a0150d70 con 0x7f3080076300 2024-05-11T01:01:14.407 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:14.408 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.406+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3080076300 msgr2=0x7f30800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.406+0000 7f30a57c9640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3080076300 0x7f30800787c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3088034000 tx=0x7f308802e000 comp rx=0 tx=0).stop 2024-05-11T01:01:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.406+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006e7d0 msgr2=0x7f30a0151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.406+0000 7f30a57c9640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006e7d0 0x7f30a0151050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f309000c500 tx=0x7f309000c9c0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.406+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 shutdown_connections 2024-05-11T01:01:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.406+0000 7f30a57c9640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3080076300 0x7f30800787c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.406+0000 7f30a57c9640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f30a00cdcf0 0x7f30a009a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.406+0000 7f30a57c9640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30a006fba0 0x7f30a0160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.407+0000 7f30a57c9640 1 --2- 172.21.15.16:0/3297211541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a006e7d0 0x7f30a0151050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.407+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 >> 172.21.15.16:0/3297211541 conn(0x7f30a0072c70 msgr2=0x7f30a00afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.407+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 shutdown_connections 2024-05-11T01:01:14.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.407+0000 7f30a57c9640 1 -- 172.21.15.16:0/3297211541 wait complete. 2024-05-11T01:01:14.419 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-11T01:01:13.755895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235808,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738912,"statfs":{"total":773094113280,"available":772852645888,"internally_reserved":0,"allocated":2555904,"data_stored":1605958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.117443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644587+0000","last_change":"2024-05-11T01:01:08.644587+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644587+0000","last_undegraded":"2024-05-11T01:01:08.644587+0000","last_fullsized":"2024-05-11T01:01:08.644587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642284+0000","last_change":"2024-05-11T01:01:08.642284+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642284+0000","last_undegraded":"2024-05-11T01:01:08.642284+0000","last_fullsized":"2024-05-11T01:01:08.642284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641053+0000","last_change":"2024-05-11T01:01:08.641053+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641053+0000","last_undegraded":"2024-05-11T01:01:08.641053+0000","last_fullsized":"2024-05-11T01:01:08.641053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645618+0000","last_change":"2024-05-11T01:01:08.645618+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645618+0000","last_undegraded":"2024-05-11T01:01:08.645618+0000","last_fullsized":"2024-05-11T01:01:08.645618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646252+0000","last_change":"2024-05-11T01:01:08.646252+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646252+0000","last_undegraded":"2024-05-11T01:01:08.646252+0000","last_fullsized":"2024-05-11T01:01:08.646252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645404+0000","last_change":"2024-05-11T01:01:08.645404+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645404+0000","last_undegraded":"2024-05-11T01:01:08.645404+0000","last_fullsized":"2024-05-11T01:01:08.645404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645440+0000","last_change":"2024-05-11T01:01:08.645440+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645440+0000","last_undegraded":"2024-05-11T01:01:08.645440+0000","last_fullsized":"2024-05-11T01:01:08.645440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644464+0000","last_change":"2024-05-11T01:01:08.644464+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644464+0000","last_undegraded":"2024-05-11T01:01:08.644464+0000","last_fullsized":"2024-05-11T01:01:08.644464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642961+0000","last_change":"2024-05-11T01:01:08.642961+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642961+0000","last_undegraded":"2024-05-11T01:01:08.642961+0000","last_fullsized":"2024-05-11T01:01:08.642961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.650323+0000","last_change":"2024-05-11T01:01:08.650323+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.650323+0000","last_undegraded":"2024-05-11T01:01:08.650323+0000","last_fullsized":"2024-05-11T01:01:08.650323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.648064+0000","last_change":"2024-05-11T01:01:08.648064+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.648064+0000","last_undegraded":"2024-05-11T01:01:08.648064+0000","last_fullsized":"2024-05-11T01:01:08.648064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641104+0000","last_change":"2024-05-11T01:01:08.641104+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641104+0000","last_undegraded":"2024-05-11T01:01:08.641104+0000","last_fullsized":"2024-05-11T01:01:08.641104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643598+0000","last_change":"2024-05-11T01:01:08.643598+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643598+0000","last_undegraded":"2024-05-11T01:01:08.643598+0000","last_fullsized":"2024-05-11T01:01:08.643598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646386+0000","last_change":"2024-05-11T01:01:08.646386+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646386+0000","last_undegraded":"2024-05-11T01:01:08.646386+0000","last_fullsized":"2024-05-11T01:01:08.646386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642270+0000","last_change":"2024-05-11T01:01:08.642270+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642270+0000","last_undegraded":"2024-05-11T01:01:08.642270+0000","last_fullsized":"2024-05-11T01:01:08.642270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644542+0000","last_change":"2024-05-11T01:01:08.644542+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644542+0000","last_undegraded":"2024-05-11T01:01:08.644542+0000","last_fullsized":"2024-05-11T01:01:08.644542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643764+0000","last_change":"2024-05-11T01:01:08.643764+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643764+0000","last_undegraded":"2024-05-11T01:01:08.643764+0000","last_fullsized":"2024-05-11T01:01:08.643764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640129+0000","last_change":"2024-05-11T01:01:08.640129+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640129+0000","last_undegraded":"2024-05-11T01:01:08.640129+0000","last_fullsized":"2024-05-11T01:01:08.640129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640689+0000","last_change":"2024-05-11T01:01:08.640689+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640689+0000","last_undegraded":"2024-05-11T01:01:08.640689+0000","last_fullsized":"2024-05-11T01:01:08.640689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649549+0000","last_change":"2024-05-11T01:01:08.649549+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649549+0000","last_undegraded":"2024-05-11T01:01:08.649549+0000","last_fullsized":"2024-05-11T01:01:08.649549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647484+0000","last_change":"2024-05-11T01:01:08.647484+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647484+0000","last_undegraded":"2024-05-11T01:01:08.647484+0000","last_fullsized":"2024-05-11T01:01:08.647484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644705+0000","last_change":"2024-05-11T01:01:08.644705+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644705+0000","last_undegraded":"2024-05-11T01:01:08.644705+0000","last_fullsized":"2024-05-11T01:01:08.644705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644526+0000","last_change":"2024-05-11T01:01:08.644526+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644526+0000","last_undegraded":"2024-05-11T01:01:08.644526+0000","last_fullsized":"2024-05-11T01:01:08.644526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642937+0000","last_change":"2024-05-11T01:01:08.642937+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642937+0000","last_undegraded":"2024-05-11T01:01:08.642937+0000","last_fullsized":"2024-05-11T01:01:08.642937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645521+0000","last_change":"2024-05-11T01:01:08.645521+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645521+0000","last_undegraded":"2024-05-11T01:01:08.645521+0000","last_fullsized":"2024-05-11T01:01:08.645521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649780+0000","last_change":"2024-05-11T01:01:08.649780+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649780+0000","last_undegraded":"2024-05-11T01:01:08.649780+0000","last_fullsized":"2024-05-11T01:01:08.649780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643709+0000","last_change":"2024-05-11T01:01:08.643709+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643709+0000","last_undegraded":"2024-05-11T01:01:08.643709+0000","last_fullsized":"2024-05-11T01:01:08.643709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642008+0000","last_change":"2024-05-11T01:01:08.642008+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642008+0000","last_undegraded":"2024-05-11T01:01:08.642008+0000","last_fullsized":"2024-05-11T01:01:08.642008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646983+0000","last_change":"2024-05-11T01:01:08.646983+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646983+0000","last_undegraded":"2024-05-11T01:01:08.646983+0000","last_fullsized":"2024-05-11T01:01:08.646983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644147+0000","last_change":"2024-05-11T01:01:08.644147+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644147+0000","last_undegraded":"2024-05-11T01:01:08.644147+0000","last_fullsized":"2024-05-11T01:01:08.644147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640318+0000","last_change":"2024-05-11T01:01:08.640318+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640318+0000","last_undegraded":"2024-05-11T01:01:08.640318+0000","last_fullsized":"2024-05-11T01:01:08.640318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647230+0000","last_change":"2024-05-11T01:01:08.647230+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647230+0000","last_undegraded":"2024-05-11T01:01:08.647230+0000","last_fullsized":"2024-05-11T01:01:08.647230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640153+0000","last_change":"2024-05-11T01:01:08.640153+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640153+0000","last_undegraded":"2024-05-11T01:01:08.640153+0000","last_fullsized":"2024-05-11T01:01:08.640153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658304+0000","last_change":"2024-05-11T01:01:08.656899+0000","last_active":"2024-05-11T01:01:08.658304+0000","last_peered":"2024-05-11T01:01:08.658304+0000","last_clean":"2024-05-11T01:01:08.658304+0000","last_became_active":"2024-05-11T01:01:08.656569+0000","last_became_peered":"2024-05-11T01:01:08.656569+0000","last_unstale":"2024-05-11T01:01:08.658304+0000","last_undegraded":"2024-05-11T01:01:08.658304+0000","last_fullsized":"2024-05-11T01:01:08.658304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643486+0000","last_change":"2024-05-11T01:01:08.643486+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643486+0000","last_undegraded":"2024-05-11T01:01:08.643486+0000","last_fullsized":"2024-05-11T01:01:08.643486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.655969+0000","last_change":"2024-05-11T01:01:08.651945+0000","last_active":"2024-05-11T01:01:08.655969+0000","last_peered":"2024-05-11T01:01:08.655969+0000","last_clean":"2024-05-11T01:01:08.655969+0000","last_became_active":"2024-05-11T01:01:08.651681+0000","last_became_peered":"2024-05-11T01:01:08.651681+0000","last_unstale":"2024-05-11T01:01:08.655969+0000","last_undegraded":"2024-05-11T01:01:08.655969+0000","last_fullsized":"2024-05-11T01:01:08.655969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659704+0000","last_change":"2024-05-11T01:01:08.658922+0000","last_active":"2024-05-11T01:01:08.659704+0000","last_peered":"2024-05-11T01:01:08.659704+0000","last_clean":"2024-05-11T01:01:08.659704+0000","last_became_active":"2024-05-11T01:01:08.658620+0000","last_became_peered":"2024-05-11T01:01:08.658620+0000","last_unstale":"2024-05-11T01:01:08.659704+0000","last_undegraded":"2024-05-11T01:01:08.659704+0000","last_fullsized":"2024-05-11T01:01:08.659704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643967+0000","last_change":"2024-05-11T01:01:08.643967+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643967+0000","last_undegraded":"2024-05-11T01:01:08.643967+0000","last_fullsized":"2024-05-11T01:01:08.643967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.650072+0000","last_change":"2024-05-11T01:01:08.647703+0000","last_active":"2024-05-11T01:01:08.650072+0000","last_peered":"2024-05-11T01:01:08.650072+0000","last_clean":"2024-05-11T01:01:08.650072+0000","last_became_active":"2024-05-11T01:01:08.647434+0000","last_became_peered":"2024-05-11T01:01:08.647434+0000","last_unstale":"2024-05-11T01:01:08.650072+0000","last_undegraded":"2024-05-11T01:01:08.650072+0000","last_fullsized":"2024-05-11T01:01:08.650072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644170+0000","last_change":"2024-05-11T01:01:08.644170+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644170+0000","last_undegraded":"2024-05-11T01:01:08.644170+0000","last_fullsized":"2024-05-11T01:01:08.644170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.656123+0000","last_change":"2024-05-11T01:01:08.655160+0000","last_active":"2024-05-11T01:01:08.656123+0000","last_peered":"2024-05-11T01:01:08.656123+0000","last_clean":"2024-05-11T01:01:08.656123+0000","last_became_active":"2024-05-11T01:01:08.654886+0000","last_became_peered":"2024-05-11T01:01:08.654886+0000","last_unstale":"2024-05-11T01:01:08.656123+0000","last_undegraded":"2024-05-11T01:01:08.656123+0000","last_fullsized":"2024-05-11T01:01:08.656123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643532+0000","last_change":"2024-05-11T01:01:08.643532+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643532+0000","last_undegraded":"2024-05-11T01:01:08.643532+0000","last_fullsized":"2024-05-11T01:01:08.643532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657466+0000","last_change":"2024-05-11T01:01:08.655815+0000","last_active":"2024-05-11T01:01:08.657466+0000","last_peered":"2024-05-11T01:01:08.657466+0000","last_clean":"2024-05-11T01:01:08.657466+0000","last_became_active":"2024-05-11T01:01:08.655307+0000","last_became_peered":"2024-05-11T01:01:08.655307+0000","last_unstale":"2024-05-11T01:01:08.657466+0000","last_undegraded":"2024-05-11T01:01:08.657466+0000","last_fullsized":"2024-05-11T01:01:08.657466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646042+0000","last_change":"2024-05-11T01:01:08.646042+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646042+0000","last_undegraded":"2024-05-11T01:01:08.646042+0000","last_fullsized":"2024-05-11T01:01:08.646042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654599+0000","last_change":"2024-05-11T01:01:08.653490+0000","last_active":"2024-05-11T01:01:08.654599+0000","last_peered":"2024-05-11T01:01:08.654599+0000","last_clean":"2024-05-11T01:01:08.654599+0000","last_became_active":"2024-05-11T01:01:08.653133+0000","last_became_peered":"2024-05-11T01:01:08.653133+0000","last_unstale":"2024-05-11T01:01:08.654599+0000","last_undegraded":"2024-05-11T01:01:08.654599+0000","last_fullsized":"2024-05-11T01:01:08.654599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640364+0000","last_change":"2024-05-11T01:01:08.640364+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640364+0000","last_undegraded":"2024-05-11T01:01:08.640364+0000","last_fullsized":"2024-05-11T01:01:08.640364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657197+0000","last_change":"2024-05-11T01:01:08.654417+0000","last_active":"2024-05-11T01:01:08.657197+0000","last_peered":"2024-05-11T01:01:08.657197+0000","last_clean":"2024-05-11T01:01:08.657197+0000","last_became_active":"2024-05-11T01:01:08.654147+0000","last_became_peered":"2024-05-11T01:01:08.654147+0000","last_unstale":"2024-05-11T01:01:08.657197+0000","last_undegraded":"2024-05-11T01:01:08.657197+0000","last_fullsized":"2024-05-11T01:01:08.657197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645095+0000","last_change":"2024-05-11T01:01:08.645095+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645095+0000","last_undegraded":"2024-05-11T01:01:08.645095+0000","last_fullsized":"2024-05-11T01:01:08.645095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657420+0000","last_change":"2024-05-11T01:01:08.655493+0000","last_active":"2024-05-11T01:01:08.657420+0000","last_peered":"2024-05-11T01:01:08.657420+0000","last_clean":"2024-05-11T01:01:08.657420+0000","last_became_active":"2024-05-11T01:01:08.655147+0000","last_became_peered":"2024-05-11T01:01:08.655147+0000","last_unstale":"2024-05-11T01:01:08.657420+0000","last_undegraded":"2024-05-11T01:01:08.657420+0000","last_fullsized":"2024-05-11T01:01:08.657420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641701+0000","last_change":"2024-05-11T01:01:08.641701+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641701+0000","last_undegraded":"2024-05-11T01:01:08.641701+0000","last_fullsized":"2024-05-11T01:01:08.641701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.651846+0000","last_change":"2024-05-11T01:01:08.648494+0000","last_active":"2024-05-11T01:01:08.651846+0000","last_peered":"2024-05-11T01:01:08.651846+0000","last_clean":"2024-05-11T01:01:08.651846+0000","last_became_active":"2024-05-11T01:01:08.648206+0000","last_became_peered":"2024-05-11T01:01:08.648206+0000","last_unstale":"2024-05-11T01:01:08.651846+0000","last_undegraded":"2024-05-11T01:01:08.651846+0000","last_fullsized":"2024-05-11T01:01:08.651846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642014+0000","last_change":"2024-05-11T01:01:08.642014+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642014+0000","last_undegraded":"2024-05-11T01:01:08.642014+0000","last_fullsized":"2024-05-11T01:01:08.642014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658274+0000","last_change":"2024-05-11T01:01:08.655771+0000","last_active":"2024-05-11T01:01:08.658274+0000","last_peered":"2024-05-11T01:01:08.658274+0000","last_clean":"2024-05-11T01:01:08.658274+0000","last_became_active":"2024-05-11T01:01:08.655462+0000","last_became_peered":"2024-05-11T01:01:08.655462+0000","last_unstale":"2024-05-11T01:01:08.658274+0000","last_undegraded":"2024-05-11T01:01:08.658274+0000","last_fullsized":"2024-05-11T01:01:08.658274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646474+0000","last_change":"2024-05-11T01:01:08.646474+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646474+0000","last_undegraded":"2024-05-11T01:01:08.646474+0000","last_fullsized":"2024-05-11T01:01:08.646474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652346+0000","last_change":"2024-05-11T01:01:08.649715+0000","last_active":"2024-05-11T01:01:08.652346+0000","last_peered":"2024-05-11T01:01:08.652346+0000","last_clean":"2024-05-11T01:01:08.652346+0000","last_became_active":"2024-05-11T01:01:08.649344+0000","last_became_peered":"2024-05-11T01:01:08.649344+0000","last_unstale":"2024-05-11T01:01:08.652346+0000","last_undegraded":"2024-05-11T01:01:08.652346+0000","last_fullsized":"2024-05-11T01:01:08.652346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640890+0000","last_change":"2024-05-11T01:01:08.640890+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640890+0000","last_undegraded":"2024-05-11T01:01:08.640890+0000","last_fullsized":"2024-05-11T01:01:08.640890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658084+0000","last_change":"2024-05-11T01:01:08.656669+0000","last_active":"2024-05-11T01:01:08.658084+0000","last_peered":"2024-05-11T01:01:08.658084+0000","last_clean":"2024-05-11T01:01:08.658084+0000","last_became_active":"2024-05-11T01:01:08.656381+0000","last_became_peered":"2024-05-11T01:01:08.656381+0000","last_unstale":"2024-05-11T01:01:08.658084+0000","last_undegraded":"2024-05-11T01:01:08.658084+0000","last_fullsized":"2024-05-11T01:01:08.658084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641185+0000","last_change":"2024-05-11T01:01:08.641185+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641185+0000","last_undegraded":"2024-05-11T01:01:08.641185+0000","last_fullsized":"2024-05-11T01:01:08.641185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652983+0000","last_change":"2024-05-11T01:01:08.651433+0000","last_active":"2024-05-11T01:01:08.652983+0000","last_peered":"2024-05-11T01:01:08.652983+0000","last_clean":"2024-05-11T01:01:08.652983+0000","last_became_active":"2024-05-11T01:01:08.650413+0000","last_became_peered":"2024-05-11T01:01:08.650413+0000","last_unstale":"2024-05-11T01:01:08.652983+0000","last_undegraded":"2024-05-11T01:01:08.652983+0000","last_fullsized":"2024-05-11T01:01:08.652983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640813+0000","last_change":"2024-05-11T01:01:08.640813+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640813+0000","last_undegraded":"2024-05-11T01:01:08.640813+0000","last_fullsized":"2024-05-11T01:01:08.640813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652563+0000","last_change":"2024-05-11T01:01:08.648337+0000","last_active":"2024-05-11T01:01:08.652563+0000","last_peered":"2024-05-11T01:01:08.652563+0000","last_clean":"2024-05-11T01:01:08.652563+0000","last_became_active":"2024-05-11T01:01:08.648027+0000","last_became_peered":"2024-05-11T01:01:08.648027+0000","last_unstale":"2024-05-11T01:01:08.652563+0000","last_undegraded":"2024-05-11T01:01:08.652563+0000","last_fullsized":"2024-05-11T01:01:08.652563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644072+0000","last_change":"2024-05-11T01:01:08.644072+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644072+0000","last_undegraded":"2024-05-11T01:01:08.644072+0000","last_fullsized":"2024-05-11T01:01:08.644072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.650047+0000","last_change":"2024-05-11T01:01:08.648806+0000","last_active":"2024-05-11T01:01:08.650047+0000","last_peered":"2024-05-11T01:01:08.650047+0000","last_clean":"2024-05-11T01:01:08.650047+0000","last_became_active":"2024-05-11T01:01:08.648140+0000","last_became_peered":"2024-05-11T01:01:08.648140+0000","last_unstale":"2024-05-11T01:01:08.650047+0000","last_undegraded":"2024-05-11T01:01:08.650047+0000","last_fullsized":"2024-05-11T01:01:08.650047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642340+0000","last_change":"2024-05-11T01:01:08.642340+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642340+0000","last_undegraded":"2024-05-11T01:01:08.642340+0000","last_fullsized":"2024-05-11T01:01:08.642340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.651516+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:08.651516+0000","last_peered":"2024-05-11T01:01:08.651516+0000","last_clean":"2024-05-11T01:01:08.651516+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:08.651516+0000","last_undegraded":"2024-05-11T01:01:08.651516+0000","last_fullsized":"2024-05-11T01:01:08.651516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654777+0000","last_change":"2024-05-11T01:01:08.649868+0000","last_active":"2024-05-11T01:01:08.654777+0000","last_peered":"2024-05-11T01:01:08.654777+0000","last_clean":"2024-05-11T01:01:08.654777+0000","last_became_active":"2024-05-11T01:01:08.649580+0000","last_became_peered":"2024-05-11T01:01:08.649580+0000","last_unstale":"2024-05-11T01:01:08.654777+0000","last_undegraded":"2024-05-11T01:01:08.654777+0000","last_fullsized":"2024-05-11T01:01:08.654777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642019+0000","last_change":"2024-05-11T01:01:08.642019+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642019+0000","last_undegraded":"2024-05-11T01:01:08.642019+0000","last_fullsized":"2024-05-11T01:01:08.642019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662245+0000","last_change":"2024-05-11T01:01:08.659302+0000","last_active":"2024-05-11T01:01:08.662245+0000","last_peered":"2024-05-11T01:01:08.662245+0000","last_clean":"2024-05-11T01:01:08.662245+0000","last_became_active":"2024-05-11T01:01:08.658788+0000","last_became_peered":"2024-05-11T01:01:08.658788+0000","last_unstale":"2024-05-11T01:01:08.662245+0000","last_undegraded":"2024-05-11T01:01:08.662245+0000","last_fullsized":"2024-05-11T01:01:08.662245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641388+0000","last_change":"2024-05-11T01:01:08.641388+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641388+0000","last_undegraded":"2024-05-11T01:01:08.641388+0000","last_fullsized":"2024-05-11T01:01:08.641388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652177+0000","last_change":"2024-05-11T01:01:08.648835+0000","last_active":"2024-05-11T01:01:08.652177+0000","last_peered":"2024-05-11T01:01:08.652177+0000","last_clean":"2024-05-11T01:01:08.652177+0000","last_became_active":"2024-05-11T01:01:08.648420+0000","last_became_peered":"2024-05-11T01:01:08.648420+0000","last_unstale":"2024-05-11T01:01:08.652177+0000","last_undegraded":"2024-05-11T01:01:08.652177+0000","last_fullsized":"2024-05-11T01:01:08.652177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645286+0000","last_change":"2024-05-11T01:01:08.645286+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645286+0000","last_undegraded":"2024-05-11T01:01:08.645286+0000","last_fullsized":"2024-05-11T01:01:08.645286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.656834+0000","last_change":"2024-05-11T01:01:08.655055+0000","last_active":"2024-05-11T01:01:08.656834+0000","last_peered":"2024-05-11T01:01:08.656834+0000","last_clean":"2024-05-11T01:01:08.656834+0000","last_became_active":"2024-05-11T01:01:08.654780+0000","last_became_peered":"2024-05-11T01:01:08.654780+0000","last_unstale":"2024-05-11T01:01:08.656834+0000","last_undegraded":"2024-05-11T01:01:08.656834+0000","last_fullsized":"2024-05-11T01:01:08.656834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640283+0000","last_change":"2024-05-11T01:01:08.640283+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640283+0000","last_undegraded":"2024-05-11T01:01:08.640283+0000","last_fullsized":"2024-05-11T01:01:08.640283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657314+0000","last_change":"2024-05-11T01:01:08.656434+0000","last_active":"2024-05-11T01:01:08.657314+0000","last_peered":"2024-05-11T01:01:08.657314+0000","last_clean":"2024-05-11T01:01:08.657314+0000","last_became_active":"2024-05-11T01:01:08.656111+0000","last_became_peered":"2024-05-11T01:01:08.656111+0000","last_unstale":"2024-05-11T01:01:08.657314+0000","last_undegraded":"2024-05-11T01:01:08.657314+0000","last_fullsized":"2024-05-11T01:01:08.657314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643150+0000","last_change":"2024-05-11T01:01:08.643150+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643150+0000","last_undegraded":"2024-05-11T01:01:08.643150+0000","last_fullsized":"2024-05-11T01:01:08.643150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658349+0000","last_change":"2024-05-11T01:01:08.656666+0000","last_active":"2024-05-11T01:01:08.658349+0000","last_peered":"2024-05-11T01:01:08.658349+0000","last_clean":"2024-05-11T01:01:08.658349+0000","last_became_active":"2024-05-11T01:01:08.656387+0000","last_became_peered":"2024-05-11T01:01:08.656387+0000","last_unstale":"2024-05-11T01:01:08.658349+0000","last_undegraded":"2024-05-11T01:01:08.658349+0000","last_fullsized":"2024-05-11T01:01:08.658349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642800+0000","last_change":"2024-05-11T01:01:08.642800+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642800+0000","last_undegraded":"2024-05-11T01:01:08.642800+0000","last_fullsized":"2024-05-11T01:01:08.642800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659261+0000","last_change":"2024-05-11T01:01:08.658432+0000","last_active":"2024-05-11T01:01:08.659261+0000","last_peered":"2024-05-11T01:01:08.659261+0000","last_clean":"2024-05-11T01:01:08.659261+0000","last_became_active":"2024-05-11T01:01:08.658089+0000","last_became_peered":"2024-05-11T01:01:08.658089+0000","last_unstale":"2024-05-11T01:01:08.659261+0000","last_undegraded":"2024-05-11T01:01:08.659261+0000","last_fullsized":"2024-05-11T01:01:08.659261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645040+0000","last_change":"2024-05-11T01:01:08.645040+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645040+0000","last_undegraded":"2024-05-11T01:01:08.645040+0000","last_fullsized":"2024-05-11T01:01:08.645040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659659+0000","last_change":"2024-05-11T01:01:08.658073+0000","last_active":"2024-05-11T01:01:08.659659+0000","last_peered":"2024-05-11T01:01:08.659659+0000","last_clean":"2024-05-11T01:01:08.659659+0000","last_became_active":"2024-05-11T01:01:08.657786+0000","last_became_peered":"2024-05-11T01:01:08.657786+0000","last_unstale":"2024-05-11T01:01:08.659659+0000","last_undegraded":"2024-05-11T01:01:08.659659+0000","last_fullsized":"2024-05-11T01:01:08.659659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645372+0000","last_change":"2024-05-11T01:01:08.645372+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645372+0000","last_undegraded":"2024-05-11T01:01:08.645372+0000","last_fullsized":"2024-05-11T01:01:08.645372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662168+0000","last_change":"2024-05-11T01:01:08.658520+0000","last_active":"2024-05-11T01:01:08.662168+0000","last_peered":"2024-05-11T01:01:08.662168+0000","last_clean":"2024-05-11T01:01:08.662168+0000","last_became_active":"2024-05-11T01:01:08.657670+0000","last_became_peered":"2024-05-11T01:01:08.657670+0000","last_unstale":"2024-05-11T01:01:08.662168+0000","last_undegraded":"2024-05-11T01:01:08.662168+0000","last_fullsized":"2024-05-11T01:01:08.662168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640245+0000","last_change":"2024-05-11T01:01:08.640245+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640245+0000","last_undegraded":"2024-05-11T01:01:08.640245+0000","last_fullsized":"2024-05-11T01:01:08.640245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654911+0000","last_change":"2024-05-11T01:01:08.653589+0000","last_active":"2024-05-11T01:01:08.654911+0000","last_peered":"2024-05-11T01:01:08.654911+0000","last_clean":"2024-05-11T01:01:08.654911+0000","last_became_active":"2024-05-11T01:01:08.653254+0000","last_became_peered":"2024-05-11T01:01:08.653254+0000","last_unstale":"2024-05-11T01:01:08.654911+0000","last_undegraded":"2024-05-11T01:01:08.654911+0000","last_fullsized":"2024-05-11T01:01:08.654911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643424+0000","last_change":"2024-05-11T01:01:08.643424+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643424+0000","last_undegraded":"2024-05-11T01:01:08.643424+0000","last_fullsized":"2024-05-11T01:01:08.643424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.655230+0000","last_change":"2024-05-11T01:01:08.653913+0000","last_active":"2024-05-11T01:01:08.655230+0000","last_peered":"2024-05-11T01:01:08.655230+0000","last_clean":"2024-05-11T01:01:08.655230+0000","last_became_active":"2024-05-11T01:01:08.653485+0000","last_became_peered":"2024-05-11T01:01:08.653485+0000","last_unstale":"2024-05-11T01:01:08.655230+0000","last_undegraded":"2024-05-11T01:01:08.655230+0000","last_fullsized":"2024-05-11T01:01:08.655230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641461+0000","last_change":"2024-05-11T01:01:08.641461+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641461+0000","last_undegraded":"2024-05-11T01:01:08.641461+0000","last_fullsized":"2024-05-11T01:01:08.641461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662174+0000","last_change":"2024-05-11T01:01:08.658594+0000","last_active":"2024-05-11T01:01:08.662174+0000","last_peered":"2024-05-11T01:01:08.662174+0000","last_clean":"2024-05-11T01:01:08.662174+0000","last_became_active":"2024-05-11T01:01:08.658310+0000","last_became_peered":"2024-05-11T01:01:08.658310+0000","last_unstale":"2024-05-11T01:01:08.662174+0000","last_undegraded":"2024-05-11T01:01:08.662174+0000","last_fullsized":"2024-05-11T01:01:08.662174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649153+0000","last_change":"2024-05-11T01:01:08.649153+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649153+0000","last_undegraded":"2024-05-11T01:01:08.649153+0000","last_fullsized":"2024-05-11T01:01:08.649153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644055+0000","last_change":"2024-05-11T01:01:08.644055+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644055+0000","last_undegraded":"2024-05-11T01:01:08.644055+0000","last_fullsized":"2024-05-11T01:01:08.644055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657607+0000","last_change":"2024-05-11T01:01:08.656072+0000","last_active":"2024-05-11T01:01:08.657607+0000","last_peered":"2024-05-11T01:01:08.657607+0000","last_clean":"2024-05-11T01:01:08.657607+0000","last_became_active":"2024-05-11T01:01:08.655793+0000","last_became_peered":"2024-05-11T01:01:08.655793+0000","last_unstale":"2024-05-11T01:01:08.657607+0000","last_undegraded":"2024-05-11T01:01:08.657607+0000","last_fullsized":"2024-05-11T01:01:08.657607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645151+0000","last_change":"2024-05-11T01:01:08.645151+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645151+0000","last_undegraded":"2024-05-11T01:01:08.645151+0000","last_fullsized":"2024-05-11T01:01:08.645151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662225+0000","last_change":"2024-05-11T01:01:08.659252+0000","last_active":"2024-05-11T01:01:08.662225+0000","last_peered":"2024-05-11T01:01:08.662225+0000","last_clean":"2024-05-11T01:01:08.662225+0000","last_became_active":"2024-05-11T01:01:08.658942+0000","last_became_peered":"2024-05-11T01:01:08.658942+0000","last_unstale":"2024-05-11T01:01:08.662225+0000","last_undegraded":"2024-05-11T01:01:08.662225+0000","last_fullsized":"2024-05-11T01:01:08.662225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647766+0000","last_change":"2024-05-11T01:01:08.647766+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647766+0000","last_undegraded":"2024-05-11T01:01:08.647766+0000","last_fullsized":"2024-05-11T01:01:08.647766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657530+0000","last_change":"2024-05-11T01:01:08.655897+0000","last_active":"2024-05-11T01:01:08.657530+0000","last_peered":"2024-05-11T01:01:08.657530+0000","last_clean":"2024-05-11T01:01:08.657530+0000","last_became_active":"2024-05-11T01:01:08.655602+0000","last_became_peered":"2024-05-11T01:01:08.655602+0000","last_unstale":"2024-05-11T01:01:08.657530+0000","last_undegraded":"2024-05-11T01:01:08.657530+0000","last_fullsized":"2024-05-11T01:01:08.657530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644257+0000","last_change":"2024-05-11T01:01:08.644257+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644257+0000","last_undegraded":"2024-05-11T01:01:08.644257+0000","last_fullsized":"2024-05-11T01:01:08.644257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658738+0000","last_change":"2024-05-11T01:01:08.657362+0000","last_active":"2024-05-11T01:01:08.658738+0000","last_peered":"2024-05-11T01:01:08.658738+0000","last_clean":"2024-05-11T01:01:08.658738+0000","last_became_active":"2024-05-11T01:01:08.657072+0000","last_became_peered":"2024-05-11T01:01:08.657072+0000","last_unstale":"2024-05-11T01:01:08.658738+0000","last_undegraded":"2024-05-11T01:01:08.658738+0000","last_fullsized":"2024-05-11T01:01:08.658738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":774144,"data_stored":648227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:14.423 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-05-11T01:01:14.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644587+0000', 'last_change': '2024-05-11T01:01:08.644587+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644587+0000', 'last_undegraded': '2024-05-11T01:01:08.644587+0000', 'last_fullsized': '2024-05-11T01:01:08.644587+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.423 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-05-11T01:01:14.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642284+0000', 'last_change': '2024-05-11T01:01:08.642284+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642284+0000', 'last_undegraded': '2024-05-11T01:01:08.642284+0000', 'last_fullsized': '2024-05-11T01:01:08.642284+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-11T01:01:14.423 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.641053+0000', 'last_change': '2024-05-11T01:01:08.641053+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.641053+0000', 'last_undegraded': '2024-05-11T01:01:08.641053+0000', 'last_fullsized': '2024-05-11T01:01:08.641053+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645618+0000', 'last_change': '2024-05-11T01:01:08.645618+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645618+0000', 'last_undegraded': '2024-05-11T01:01:08.645618+0000', 'last_fullsized': '2024-05-11T01:01:08.645618+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.646252+0000', 'last_change': '2024-05-11T01:01:08.646252+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.646252+0000', 'last_undegraded': '2024-05-11T01:01:08.646252+0000', 'last_fullsized': '2024-05-11T01:01:08.646252+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645404+0000', 'last_change': '2024-05-11T01:01:08.645404+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645404+0000', 'last_undegraded': '2024-05-11T01:01:08.645404+0000', 'last_fullsized': '2024-05-11T01:01:08.645404+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645440+0000', 'last_change': '2024-05-11T01:01:08.645440+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645440+0000', 'last_undegraded': '2024-05-11T01:01:08.645440+0000', 'last_fullsized': '2024-05-11T01:01:08.645440+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-05-11T01:01:14.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644464+0000', 'last_change': '2024-05-11T01:01:08.644464+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644464+0000', 'last_undegraded': '2024-05-11T01:01:08.644464+0000', 'last_fullsized': '2024-05-11T01:01:08.644464+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642961+0000', 'last_change': '2024-05-11T01:01:08.642961+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642961+0000', 'last_undegraded': '2024-05-11T01:01:08.642961+0000', 'last_fullsized': '2024-05-11T01:01:08.642961+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.650323+0000', 'last_change': '2024-05-11T01:01:08.650323+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.650323+0000', 'last_undegraded': '2024-05-11T01:01:08.650323+0000', 'last_fullsized': '2024-05-11T01:01:08.650323+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.648064+0000', 'last_change': '2024-05-11T01:01:08.648064+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.648064+0000', 'last_undegraded': '2024-05-11T01:01:08.648064+0000', 'last_fullsized': '2024-05-11T01:01:08.648064+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.641104+0000', 'last_change': '2024-05-11T01:01:08.641104+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.641104+0000', 'last_undegraded': '2024-05-11T01:01:08.641104+0000', 'last_fullsized': '2024-05-11T01:01:08.641104+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.643598+0000', 'last_change': '2024-05-11T01:01:08.643598+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.643598+0000', 'last_undegraded': '2024-05-11T01:01:08.643598+0000', 'last_fullsized': '2024-05-11T01:01:08.643598+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-05-11T01:01:14.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.646386+0000', 'last_change': '2024-05-11T01:01:08.646386+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.646386+0000', 'last_undegraded': '2024-05-11T01:01:08.646386+0000', 'last_fullsized': '2024-05-11T01:01:08.646386+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642270+0000', 'last_change': '2024-05-11T01:01:08.642270+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642270+0000', 'last_undegraded': '2024-05-11T01:01:08.642270+0000', 'last_fullsized': '2024-05-11T01:01:08.642270+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644542+0000', 'last_change': '2024-05-11T01:01:08.644542+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644542+0000', 'last_undegraded': '2024-05-11T01:01:08.644542+0000', 'last_fullsized': '2024-05-11T01:01:08.644542+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.643764+0000', 'last_change': '2024-05-11T01:01:08.643764+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.643764+0000', 'last_undegraded': '2024-05-11T01:01:08.643764+0000', 'last_fullsized': '2024-05-11T01:01:08.643764+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640129+0000', 'last_change': '2024-05-11T01:01:08.640129+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640129+0000', 'last_undegraded': '2024-05-11T01:01:08.640129+0000', 'last_fullsized': '2024-05-11T01:01:08.640129+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640689+0000', 'last_change': '2024-05-11T01:01:08.640689+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640689+0000', 'last_undegraded': '2024-05-11T01:01:08.640689+0000', 'last_fullsized': '2024-05-11T01:01:08.640689+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.426 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.649549+0000', 'last_change': '2024-05-11T01:01:08.649549+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.649549+0000', 'last_undegraded': '2024-05-11T01:01:08.649549+0000', 'last_fullsized': '2024-05-11T01:01:08.649549+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.647484+0000', 'last_change': '2024-05-11T01:01:08.647484+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.647484+0000', 'last_undegraded': '2024-05-11T01:01:08.647484+0000', 'last_fullsized': '2024-05-11T01:01:08.647484+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644705+0000', 'last_change': '2024-05-11T01:01:08.644705+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644705+0000', 'last_undegraded': '2024-05-11T01:01:08.644705+0000', 'last_fullsized': '2024-05-11T01:01:08.644705+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644526+0000', 'last_change': '2024-05-11T01:01:08.644526+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644526+0000', 'last_undegraded': '2024-05-11T01:01:08.644526+0000', 'last_fullsized': '2024-05-11T01:01:08.644526+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-05-11T01:01:14.427 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642937+0000', 'last_change': '2024-05-11T01:01:08.642937+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642937+0000', 'last_undegraded': '2024-05-11T01:01:08.642937+0000', 'last_fullsized': '2024-05-11T01:01:08.642937+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-05-11T01:01:14.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645521+0000', 'last_change': '2024-05-11T01:01:08.645521+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645521+0000', 'last_undegraded': '2024-05-11T01:01:08.645521+0000', 'last_fullsized': '2024-05-11T01:01:08.645521+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-05-11T01:01:14.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.649780+0000', 'last_change': '2024-05-11T01:01:08.649780+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.649780+0000', 'last_undegraded': '2024-05-11T01:01:08.649780+0000', 'last_fullsized': '2024-05-11T01:01:08.649780+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-11T01:01:14.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-05-11T01:01:14.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.643709+0000', 'last_change': '2024-05-11T01:01:08.643709+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.643709+0000', 'last_undegraded': '2024-05-11T01:01:08.643709+0000', 'last_fullsized': '2024-05-11T01:01:08.643709+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-11T01:01:14.428 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-05-11T01:01:14.428 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642008+0000', 'last_change': '2024-05-11T01:01:08.642008+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642008+0000', 'last_undegraded': '2024-05-11T01:01:08.642008+0000', 'last_fullsized': '2024-05-11T01:01:08.642008+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-05-11T01:01:14.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.646983+0000', 'last_change': '2024-05-11T01:01:08.646983+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.646983+0000', 'last_undegraded': '2024-05-11T01:01:08.646983+0000', 'last_fullsized': '2024-05-11T01:01:08.646983+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-05-11T01:01:14.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644147+0000', 'last_change': '2024-05-11T01:01:08.644147+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644147+0000', 'last_undegraded': '2024-05-11T01:01:08.644147+0000', 'last_fullsized': '2024-05-11T01:01:08.644147+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-05-11T01:01:14.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640318+0000', 'last_change': '2024-05-11T01:01:08.640318+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640318+0000', 'last_undegraded': '2024-05-11T01:01:08.640318+0000', 'last_fullsized': '2024-05-11T01:01:08.640318+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-11T01:01:14.429 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-05-11T01:01:14.429 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.647230+0000', 'last_change': '2024-05-11T01:01:08.647230+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.647230+0000', 'last_undegraded': '2024-05-11T01:01:08.647230+0000', 'last_fullsized': '2024-05-11T01:01:08.647230+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640153+0000', 'last_change': '2024-05-11T01:01:08.640153+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640153+0000', 'last_undegraded': '2024-05-11T01:01:08.640153+0000', 'last_fullsized': '2024-05-11T01:01:08.640153+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.643486+0000', 'last_change': '2024-05-11T01:01:08.643486+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.643486+0000', 'last_undegraded': '2024-05-11T01:01:08.643486+0000', 'last_fullsized': '2024-05-11T01:01:08.643486+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.643967+0000', 'last_change': '2024-05-11T01:01:08.643967+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.643967+0000', 'last_undegraded': '2024-05-11T01:01:08.643967+0000', 'last_fullsized': '2024-05-11T01:01:08.643967+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644170+0000', 'last_change': '2024-05-11T01:01:08.644170+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644170+0000', 'last_undegraded': '2024-05-11T01:01:08.644170+0000', 'last_fullsized': '2024-05-11T01:01:08.644170+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-05-11T01:01:14.430 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.643532+0000', 'last_change': '2024-05-11T01:01:08.643532+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.643532+0000', 'last_undegraded': '2024-05-11T01:01:08.643532+0000', 'last_fullsized': '2024-05-11T01:01:08.643532+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.646042+0000', 'last_change': '2024-05-11T01:01:08.646042+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.646042+0000', 'last_undegraded': '2024-05-11T01:01:08.646042+0000', 'last_fullsized': '2024-05-11T01:01:08.646042+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640364+0000', 'last_change': '2024-05-11T01:01:08.640364+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640364+0000', 'last_undegraded': '2024-05-11T01:01:08.640364+0000', 'last_fullsized': '2024-05-11T01:01:08.640364+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645095+0000', 'last_change': '2024-05-11T01:01:08.645095+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645095+0000', 'last_undegraded': '2024-05-11T01:01:08.645095+0000', 'last_fullsized': '2024-05-11T01:01:08.645095+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.641701+0000', 'last_change': '2024-05-11T01:01:08.641701+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.641701+0000', 'last_undegraded': '2024-05-11T01:01:08.641701+0000', 'last_fullsized': '2024-05-11T01:01:08.641701+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642014+0000', 'last_change': '2024-05-11T01:01:08.642014+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642014+0000', 'last_undegraded': '2024-05-11T01:01:08.642014+0000', 'last_fullsized': '2024-05-11T01:01:08.642014+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-05-11T01:01:14.431 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.646474+0000', 'last_change': '2024-05-11T01:01:08.646474+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.646474+0000', 'last_undegraded': '2024-05-11T01:01:08.646474+0000', 'last_fullsized': '2024-05-11T01:01:08.646474+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640890+0000', 'last_change': '2024-05-11T01:01:08.640890+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640890+0000', 'last_undegraded': '2024-05-11T01:01:08.640890+0000', 'last_fullsized': '2024-05-11T01:01:08.640890+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.641185+0000', 'last_change': '2024-05-11T01:01:08.641185+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.641185+0000', 'last_undegraded': '2024-05-11T01:01:08.641185+0000', 'last_fullsized': '2024-05-11T01:01:08.641185+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640813+0000', 'last_change': '2024-05-11T01:01:08.640813+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640813+0000', 'last_undegraded': '2024-05-11T01:01:08.640813+0000', 'last_fullsized': '2024-05-11T01:01:08.640813+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644072+0000', 'last_change': '2024-05-11T01:01:08.644072+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644072+0000', 'last_undegraded': '2024-05-11T01:01:08.644072+0000', 'last_fullsized': '2024-05-11T01:01:08.644072+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642340+0000', 'last_change': '2024-05-11T01:01:08.642340+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642340+0000', 'last_undegraded': '2024-05-11T01:01:08.642340+0000', 'last_fullsized': '2024-05-11T01:01:08.642340+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-11T01:01:14.432 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642019+0000', 'last_change': '2024-05-11T01:01:08.642019+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642019+0000', 'last_undegraded': '2024-05-11T01:01:08.642019+0000', 'last_fullsized': '2024-05-11T01:01:08.642019+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.641388+0000', 'last_change': '2024-05-11T01:01:08.641388+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.641388+0000', 'last_undegraded': '2024-05-11T01:01:08.641388+0000', 'last_fullsized': '2024-05-11T01:01:08.641388+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645286+0000', 'last_change': '2024-05-11T01:01:08.645286+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645286+0000', 'last_undegraded': '2024-05-11T01:01:08.645286+0000', 'last_fullsized': '2024-05-11T01:01:08.645286+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640283+0000', 'last_change': '2024-05-11T01:01:08.640283+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640283+0000', 'last_undegraded': '2024-05-11T01:01:08.640283+0000', 'last_fullsized': '2024-05-11T01:01:08.640283+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.643150+0000', 'last_change': '2024-05-11T01:01:08.643150+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.643150+0000', 'last_undegraded': '2024-05-11T01:01:08.643150+0000', 'last_fullsized': '2024-05-11T01:01:08.643150+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-05-11T01:01:14.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.642800+0000', 'last_change': '2024-05-11T01:01:08.642800+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.642800+0000', 'last_undegraded': '2024-05-11T01:01:08.642800+0000', 'last_fullsized': '2024-05-11T01:01:08.642800+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-11T01:01:14.434 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-05-11T01:01:14.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645040+0000', 'last_change': '2024-05-11T01:01:08.645040+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645040+0000', 'last_undegraded': '2024-05-11T01:01:08.645040+0000', 'last_fullsized': '2024-05-11T01:01:08.645040+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.434 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-05-11T01:01:14.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645372+0000', 'last_change': '2024-05-11T01:01:08.645372+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645372+0000', 'last_undegraded': '2024-05-11T01:01:08.645372+0000', 'last_fullsized': '2024-05-11T01:01:08.645372+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.434 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-05-11T01:01:14.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.640245+0000', 'last_change': '2024-05-11T01:01:08.640245+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.640245+0000', 'last_undegraded': '2024-05-11T01:01:08.640245+0000', 'last_fullsized': '2024-05-11T01:01:08.640245+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:01:14.434 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-05-11T01:01:14.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.643424+0000', 'last_change': '2024-05-11T01:01:08.643424+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.643424+0000', 'last_undegraded': '2024-05-11T01:01:08.643424+0000', 'last_fullsized': '2024-05-11T01:01:08.643424+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.435 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-05-11T01:01:14.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.641461+0000', 'last_change': '2024-05-11T01:01:08.641461+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.641461+0000', 'last_undegraded': '2024-05-11T01:01:08.641461+0000', 'last_fullsized': '2024-05-11T01:01:08.641461+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.435 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.649153+0000', 'last_change': '2024-05-11T01:01:08.649153+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.649153+0000', 'last_undegraded': '2024-05-11T01:01:08.649153+0000', 'last_fullsized': '2024-05-11T01:01:08.649153+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644055+0000', 'last_change': '2024-05-11T01:01:08.644055+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644055+0000', 'last_undegraded': '2024-05-11T01:01:08.644055+0000', 'last_fullsized': '2024-05-11T01:01:08.644055+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.645151+0000', 'last_change': '2024-05-11T01:01:08.645151+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.645151+0000', 'last_undegraded': '2024-05-11T01:01:08.645151+0000', 'last_fullsized': '2024-05-11T01:01:08.645151+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.647766+0000', 'last_change': '2024-05-11T01:01:08.647766+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.647766+0000', 'last_undegraded': '2024-05-11T01:01:08.647766+0000', 'last_fullsized': '2024-05-11T01:01:08.647766+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-05-11T01:01:14.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:01:08.644257+0000', 'last_change': '2024-05-11T01:01:08.644257+0000', 'last_active': '2024-05-11T01:01:08.629716+0000', 'last_peered': '2024-05-11T01:01:08.629716+0000', 'last_clean': '2024-05-11T01:01:08.629716+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:01:08.644257+0000', 'last_undegraded': '2024-05-11T01:01:08.644257+0000', 'last_fullsized': '2024-05-11T01:01:08.644257+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'last_clean_scrub_stamp': '2024-05-11T01:01:08.629716+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-11T01:01:14.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-11T01:01:14.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.560+0000 7fca1bf0a640 1 Processor -- start 2024-05-11T01:01:14.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.560+0000 7fca1bf0a640 1 -- start start 2024-05-11T01:01:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca1bf0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 0x7fca140bab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca1bf0a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fca140b8380 0x7fca140d45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca1bf0a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca140d3800 con 0x7fca140b6d70 2024-05-11T01:01:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca1bf0a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fca140d35b0 con 0x7fca140b8380 2024-05-11T01:01:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca1bf0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fca140bb0b0 con 0x7fca140d2ec0 2024-05-11T01:01:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca19ca6640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fca140b6d70 0x7fca140b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48752/0 (socket says 172.21.15.16:48752) 2024-05-11T01:01:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca19ca6640 1 -- 172.21.15.16:0/3271671382 learned_addr learned my addr 172.21.15.16:0/3271671382 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861921875 0 0) 0x7fca140d3800 con 0x7fca140b6d70 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca00003520 con 0x7fca140b6d70 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca1a4a7640 1 --2- 172.21.15.16:0/3271671382 >> v2:172.21.15.174:3300/0 conn(0x7fca140b8380 0x7fca140d45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca194a5640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 0x7fca140bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2632727148 0 0) 0x7fca00003520 con 0x7fca140b6d70 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 msgr2=0x7fca140bab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 0x7fca140bab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 >> v2:172.21.15.174:3300/0 conn(0x7fca140b8380 msgr2=0x7fca140d45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 --2- 172.21.15.16:0/3271671382 >> v2:172.21.15.174:3300/0 conn(0x7fca140b8380 0x7fca140d45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca140d3ae0 con 0x7fca140b6d70 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fca100016f0 con 0x7fca140b6d70 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 >> v1:172.21.15.16:6789/0 conn(0x7fca140b6d70 legacy=0x7fca140b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca00003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca00004800 0x7fca00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 0x7fca000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fca140d35b0 con 0x7fca00003a50 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca140bb0b0 con 0x7fca00004800 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fca0000bac0 con 0x7fca140d2ec0 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca19ca6640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca00003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca194a5640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca00004800 0x7fca00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.561+0000 7fca1a4a7640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 0x7fca000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.562+0000 7fca19ca6640 1 -- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 msgr2=0x7fca000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.562+0000 7fca19ca6640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 0x7fca000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.562+0000 7fca19ca6640 1 -- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca00004800 msgr2=0x7fca00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.562+0000 7fca19ca6640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca00004800 0x7fca00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.562+0000 7fca19ca6640 1 -- 172.21.15.16:0/3271671382 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca00003520 con 0x7fca00003a50 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.562+0000 7fca1a4a7640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca140d2ec0 0x7fca000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.562+0000 7fca19ca6640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca00003e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c160 tx=0x7fca00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea72d8f98a3e273e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.562+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10007ca0 con 0x7fca00003a50 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10005af0 con 0x7fca00003a50 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca18ca4640 1 -- 172.21.15.16:0/3271671382 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10007070 con 0x7fca00003a50 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3271671382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 msgr2=0x7fca00003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca1bf0a640 1 --2- 172.21.15.16:0/3271671382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca00003e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c160 tx=0x7fca00005830 comp rx=0 tx=0).stop 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca1a4a7640 1 -- 172.21.15.16:0/3271671382 reap_dead start 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3271671382 shutdown_connections 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3271671382 >> 172.21.15.16:0/3271671382 conn(0x7fca14074140 msgr2=0x7fca140d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3271671382 shutdown_connections 2024-05-11T01:01:14.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.563+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3271671382 wait complete. 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.564+0000 7fca1bf0a640 1 Processor -- start 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.564+0000 7fca1bf0a640 1 -- start start 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca1bf0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca1414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca1bf0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca141f52a0 0x7fca1414d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca1bf0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca141f5720 0x7fca1414d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca1bf0a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fca140b8810 con 0x7fca00003a50 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca1bf0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca140d40a0 con 0x7fca141f5720 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca1bf0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fca140b8990 con 0x7fca141f52a0 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca19ca6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca1414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca19ca6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca1414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39858/0 (socket says 172.21.15.16:39858) 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca19ca6640 1 -- 172.21.15.16:0/3629157913 learned_addr learned my addr 172.21.15.16:0/3629157913 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:14.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca194a5640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca141f52a0 0x7fca1414d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca1a4a7640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca141f5720 0x7fca1414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca19ca6640 1 -- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca141f52a0 msgr2=0x7fca1414d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca19ca6640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca141f52a0 0x7fca1414d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca19ca6640 1 -- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca141f5720 msgr2=0x7fca1414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca19ca6640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca141f5720 0x7fca1414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.565+0000 7fca19ca6640 1 -- 172.21.15.16:0/3629157913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1415bab0 con 0x7fca00003a50 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.566+0000 7fca19ca6640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca1414b2e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca1002acf0 tx=0x7fca140bb310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.566+0000 7fca0a7fc640 1 -- 172.21.15.16:0/3629157913 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10041020 con 0x7fca00003a50 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.566+0000 7fca0a7fc640 1 -- 172.21.15.16:0/3629157913 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca100014b0 con 0x7fca00003a50 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.566+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca141614f0 con 0x7fca00003a50 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.566+0000 7fca0a7fc640 1 -- 172.21.15.16:0/3629157913 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10007070 con 0x7fca00003a50 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.566+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1415c030 con 0x7fca00003a50 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.567+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1406a5b0 con 0x7fca00003a50 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.567+0000 7fca0a7fc640 1 -- 172.21.15.16:0/3629157913 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca10044020 con 0x7fca00003a50 2024-05-11T01:01:14.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.568+0000 7fca0a7fc640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc9f80762d0 0x7fc9f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.568+0000 7fca0a7fc640 1 -- 172.21.15.16:0/3629157913 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca100b77b0 con 0x7fca00003a50 2024-05-11T01:01:14.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.568+0000 7fca194a5640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc9f80762d0 0x7fc9f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.569+0000 7fca194a5640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc9f80762d0 0x7fc9f8078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca14161ac0 tx=0x7fca04008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.572+0000 7fca0a7fc640 1 -- 172.21.15.16:0/3629157913 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca100811a0 con 0x7fca00003a50 2024-05-11T01:01:14.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.838+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fca140c8560 con 0x7fca00003a50 2024-05-11T01:01:14.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.838+0000 7fca0a7fc640 1 -- 172.21.15.16:0/3629157913 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1032 (secure 0 0 0) 0x7fca10080aa0 con 0x7fca00003a50 2024-05-11T01:01:14.840 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:14.840 INFO:teuthology.orchestra.run.smithi016.stdout:{"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1715389263,"num_in_osds":8,"osd_in_since":1715389255,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":241467392,"bytes_avail":772852645888,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4260}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-11T01:00:53.346784+0000","services":{}},"progress_events":{}} 2024-05-11T01:01:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc9f80762d0 msgr2=0x7fc9f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc9f80762d0 0x7fc9f8078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca14161ac0 tx=0x7fca04008040 comp rx=0 tx=0).stop 2024-05-11T01:01:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 msgr2=0x7fca1414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca1414b2e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fca1002acf0 tx=0x7fca140bb310 comp rx=0 tx=0).stop 2024-05-11T01:01:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 shutdown_connections 2024-05-11T01:01:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc9f80762d0 0x7fc9f8078790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca141f5720 0x7fca1414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca141f52a0 0x7fca1414d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 --2- 172.21.15.16:0/3629157913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca00003a50 0x7fca1414b2e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 >> 172.21.15.16:0/3629157913 conn(0x7fca14074140 msgr2=0x7fca140b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 shutdown_connections 2024-05-11T01:01:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.841+0000 7fca1bf0a640 1 -- 172.21.15.16:0/3629157913 wait complete. 2024-05-11T01:01:14.853 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-11T01:01:14.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:14.932 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-05-11T01:01:14.931+0000 7f05ccfd8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-11T01:01:14.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.955+0000 7f5687ada640 1 Processor -- start 2024-05-11T01:01:14.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.955+0000 7f5687ada640 1 -- start start 2024-05-11T01:01:14.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5687ada640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56800b6d70 0x7f56800b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5687ada640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f56800d4990 0x7f568006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5687ada640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5680163e90 con 0x7f56800bac10 2024-05-11T01:01:14.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5687ada640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f56800cfad0 con 0x7f56800b6d70 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5687ada640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f56800b7690 con 0x7f56800d4990 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5685876640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56800b6d70 0x7f56800b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5685876640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56800b6d70 0x7f56800b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39870/0 (socket says 172.21.15.16:39870) 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5685876640 1 -- 172.21.15.16:0/1836665725 learned_addr learned my addr 172.21.15.16:0/1836665725 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.956+0000 7f5686077640 1 --2- 172.21.15.16:0/1836665725 >> v2:172.21.15.174:3300/0 conn(0x7f56800d4990 0x7f568006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.957+0000 7f5685876640 1 -- 172.21.15.16:0/1836665725 >> v2:172.21.15.174:3300/0 conn(0x7f56800d4990 msgr2=0x7f568006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.957+0000 7f5685876640 1 --2- 172.21.15.16:0/1836665725 >> v2:172.21.15.174:3300/0 conn(0x7f56800d4990 0x7f568006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.957+0000 7f5685876640 1 -- 172.21.15.16:0/1836665725 >> v1:172.21.15.174:6789/0 conn(0x7f56800bac10 legacy=0x7f568006d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.957+0000 7f5685876640 1 -- 172.21.15.16:0/1836665725 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5680163310 con 0x7f56800b6d70 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.957+0000 7f5686077640 1 --2- 172.21.15.16:0/1836665725 >> v2:172.21.15.174:3300/0 conn(0x7f56800d4990 0x7f568006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:14.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.957+0000 7f5685876640 1 --2- 172.21.15.16:0/1836665725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800b7150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5678009870 tx=0x7f567802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f90f77d0e8e8de0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5684874640 1 -- 172.21.15.16:0/1836665725 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678037070 con 0x7f56800b6d70 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5684874640 1 -- 172.21.15.16:0/1836665725 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5678032440 con 0x7f56800b6d70 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5684874640 1 -- 172.21.15.16:0/1836665725 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678032810 con 0x7f56800b6d70 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5687ada640 1 -- 172.21.15.16:0/1836665725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 msgr2=0x7f56800b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5687ada640 1 --2- 172.21.15.16:0/1836665725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800b7150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5678009870 tx=0x7f567802a210 comp rx=0 tx=0).stop 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5687ada640 1 -- 172.21.15.16:0/1836665725 shutdown_connections 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5687ada640 1 --2- 172.21.15.16:0/1836665725 >> v2:172.21.15.174:3300/0 conn(0x7f56800d4990 0x7f568006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5687ada640 1 --2- 172.21.15.16:0/1836665725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800b7150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5687ada640 1 -- 172.21.15.16:0/1836665725 >> 172.21.15.16:0/1836665725 conn(0x7f5680074140 msgr2=0x7f56800d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5687ada640 1 -- 172.21.15.16:0/1836665725 shutdown_connections 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.958+0000 7f5687ada640 1 -- 172.21.15.16:0/1836665725 wait complete. 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.959+0000 7f5687ada640 1 Processor -- start 2024-05-11T01:01:14.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.959+0000 7f5687ada640 1 -- start start 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5687ada640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5687ada640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800bac10 0x7f56800ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5687ada640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56800d4990 0x7f56800cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5687ada640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5680163bb0 con 0x7f56800b6d70 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5687ada640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f56801638d0 con 0x7f56800bac10 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5687ada640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f568015f830 con 0x7f56800d4990 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5685876640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5685876640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39872/0 (socket says 172.21.15.16:39872) 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5685876640 1 -- 172.21.15.16:0/3465957099 learned_addr learned my addr 172.21.15.16:0/3465957099 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5685075640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800bac10 0x7f56800ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.960+0000 7f5686077640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56800d4990 0x7f56800cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f5685876640 1 -- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56800d4990 msgr2=0x7f56800cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f5685876640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56800d4990 0x7f56800cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f5685876640 1 -- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800bac10 msgr2=0x7f56800ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f5685876640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800bac10 0x7f56800ba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f5685876640 1 -- 172.21.15.16:0/3465957099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56800cf090 con 0x7f56800b6d70 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f5685876640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800ceb50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5678000c00 tx=0x7f56780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f567e7fc640 1 -- 172.21.15.16:0/3465957099 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678041020 con 0x7f56800b6d70 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f567e7fc640 1 -- 172.21.15.16:0/3465957099 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56780306c0 con 0x7f56800b6d70 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56800cd2d0 con 0x7f56800b6d70 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f567e7fc640 1 -- 172.21.15.16:0/3465957099 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678037040 con 0x7f56800b6d70 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.961+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5680160ec0 con 0x7f56800b6d70 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.962+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f568006a5b0 con 0x7f56800b6d70 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.962+0000 7f567e7fc640 1 -- 172.21.15.16:0/3465957099 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5678044020 con 0x7f56800b6d70 2024-05-11T01:01:14.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.963+0000 7f567e7fc640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f566c0762d0 0x7f566c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:14.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.963+0000 7f567e7fc640 1 -- 172.21.15.16:0/3465957099 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f56780b7c30 con 0x7f56800b6d70 2024-05-11T01:01:14.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.963+0000 7f5685075640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f566c0762d0 0x7f566c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:14.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.964+0000 7f5685075640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f566c0762d0 0x7f566c078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f56800d0e70 tx=0x7f5674009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:14.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:14.967+0000 7f567e7fc640 1 -- 172.21.15.16:0/3465957099 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f567804b030 con 0x7f56800b6d70 2024-05-11T01:01:15.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.153+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56800d0ae0 con 0x7f566c0762d0 2024-05-11T01:01:15.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.159+0000 7f567e7fc640 1 -- 172.21.15.16:0/3465957099 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246612 (secure 0 0 0) 0x7f56800d0ae0 con 0x7f566c0762d0 2024-05-11T01:01:15.164 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:15.165 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:15.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f566c0762d0 msgr2=0x7f566c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:15.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f566c0762d0 0x7f566c078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f56800d0e70 tx=0x7f5674009040 comp rx=0 tx=0).stop 2024-05-11T01:01:15.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 msgr2=0x7f56800ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:15.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800ceb50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5678000c00 tx=0x7f56780046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:15.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 shutdown_connections 2024-05-11T01:01:15.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f566c0762d0 0x7f566c078790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:15.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f56800d4990 0x7f56800cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:15.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56800bac10 0x7f56800ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:15.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 --2- 172.21.15.16:0/3465957099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56800b6d70 0x7f56800ceb50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:15.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 >> 172.21.15.16:0/3465957099 conn(0x7f5680074140 msgr2=0x7f56800b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:15.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 shutdown_connections 2024-05-11T01:01:15.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:15.162+0000 7f5687ada640 1 -- 172.21.15.16:0/3465957099 wait complete. 2024-05-11T01:01:15.235 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-05-11T01:01:13.755895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235808,"kb_used_data":2496,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738912,"statfs":{"total":773094113280,"available":772852645888,"internally_reserved":0,"allocated":2555904,"data_stored":1605958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.117443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644587+0000","last_change":"2024-05-11T01:01:08.644587+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644587+0000","last_undegraded":"2024-05-11T01:01:08.644587+0000","last_fullsized":"2024-05-11T01:01:08.644587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642284+0000","last_change":"2024-05-11T01:01:08.642284+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642284+0000","last_undegraded":"2024-05-11T01:01:08.642284+0000","last_fullsized":"2024-05-11T01:01:08.642284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641053+0000","last_change":"2024-05-11T01:01:08.641053+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641053+0000","last_undegraded":"2024-05-11T01:01:08.641053+0000","last_fullsized":"2024-05-11T01:01:08.641053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645618+0000","last_change":"2024-05-11T01:01:08.645618+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645618+0000","last_undegraded":"2024-05-11T01:01:08.645618+0000","last_fullsized":"2024-05-11T01:01:08.645618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646252+0000","last_change":"2024-05-11T01:01:08.646252+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646252+0000","last_undegraded":"2024-05-11T01:01:08.646252+0000","last_fullsized":"2024-05-11T01:01:08.646252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645404+0000","last_change":"2024-05-11T01:01:08.645404+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645404+0000","last_undegraded":"2024-05-11T01:01:08.645404+0000","last_fullsized":"2024-05-11T01:01:08.645404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645440+0000","last_change":"2024-05-11T01:01:08.645440+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645440+0000","last_undegraded":"2024-05-11T01:01:08.645440+0000","last_fullsized":"2024-05-11T01:01:08.645440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644464+0000","last_change":"2024-05-11T01:01:08.644464+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644464+0000","last_undegraded":"2024-05-11T01:01:08.644464+0000","last_fullsized":"2024-05-11T01:01:08.644464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642961+0000","last_change":"2024-05-11T01:01:08.642961+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642961+0000","last_undegraded":"2024-05-11T01:01:08.642961+0000","last_fullsized":"2024-05-11T01:01:08.642961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.650323+0000","last_change":"2024-05-11T01:01:08.650323+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.650323+0000","last_undegraded":"2024-05-11T01:01:08.650323+0000","last_fullsized":"2024-05-11T01:01:08.650323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.648064+0000","last_change":"2024-05-11T01:01:08.648064+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.648064+0000","last_undegraded":"2024-05-11T01:01:08.648064+0000","last_fullsized":"2024-05-11T01:01:08.648064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641104+0000","last_change":"2024-05-11T01:01:08.641104+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641104+0000","last_undegraded":"2024-05-11T01:01:08.641104+0000","last_fullsized":"2024-05-11T01:01:08.641104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643598+0000","last_change":"2024-05-11T01:01:08.643598+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643598+0000","last_undegraded":"2024-05-11T01:01:08.643598+0000","last_fullsized":"2024-05-11T01:01:08.643598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646386+0000","last_change":"2024-05-11T01:01:08.646386+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646386+0000","last_undegraded":"2024-05-11T01:01:08.646386+0000","last_fullsized":"2024-05-11T01:01:08.646386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642270+0000","last_change":"2024-05-11T01:01:08.642270+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642270+0000","last_undegraded":"2024-05-11T01:01:08.642270+0000","last_fullsized":"2024-05-11T01:01:08.642270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644542+0000","last_change":"2024-05-11T01:01:08.644542+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644542+0000","last_undegraded":"2024-05-11T01:01:08.644542+0000","last_fullsized":"2024-05-11T01:01:08.644542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643764+0000","last_change":"2024-05-11T01:01:08.643764+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643764+0000","last_undegraded":"2024-05-11T01:01:08.643764+0000","last_fullsized":"2024-05-11T01:01:08.643764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640129+0000","last_change":"2024-05-11T01:01:08.640129+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640129+0000","last_undegraded":"2024-05-11T01:01:08.640129+0000","last_fullsized":"2024-05-11T01:01:08.640129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640689+0000","last_change":"2024-05-11T01:01:08.640689+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640689+0000","last_undegraded":"2024-05-11T01:01:08.640689+0000","last_fullsized":"2024-05-11T01:01:08.640689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649549+0000","last_change":"2024-05-11T01:01:08.649549+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649549+0000","last_undegraded":"2024-05-11T01:01:08.649549+0000","last_fullsized":"2024-05-11T01:01:08.649549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647484+0000","last_change":"2024-05-11T01:01:08.647484+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647484+0000","last_undegraded":"2024-05-11T01:01:08.647484+0000","last_fullsized":"2024-05-11T01:01:08.647484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644705+0000","last_change":"2024-05-11T01:01:08.644705+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644705+0000","last_undegraded":"2024-05-11T01:01:08.644705+0000","last_fullsized":"2024-05-11T01:01:08.644705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644526+0000","last_change":"2024-05-11T01:01:08.644526+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644526+0000","last_undegraded":"2024-05-11T01:01:08.644526+0000","last_fullsized":"2024-05-11T01:01:08.644526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642937+0000","last_change":"2024-05-11T01:01:08.642937+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642937+0000","last_undegraded":"2024-05-11T01:01:08.642937+0000","last_fullsized":"2024-05-11T01:01:08.642937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645521+0000","last_change":"2024-05-11T01:01:08.645521+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645521+0000","last_undegraded":"2024-05-11T01:01:08.645521+0000","last_fullsized":"2024-05-11T01:01:08.645521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649780+0000","last_change":"2024-05-11T01:01:08.649780+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649780+0000","last_undegraded":"2024-05-11T01:01:08.649780+0000","last_fullsized":"2024-05-11T01:01:08.649780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643709+0000","last_change":"2024-05-11T01:01:08.643709+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643709+0000","last_undegraded":"2024-05-11T01:01:08.643709+0000","last_fullsized":"2024-05-11T01:01:08.643709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642008+0000","last_change":"2024-05-11T01:01:08.642008+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642008+0000","last_undegraded":"2024-05-11T01:01:08.642008+0000","last_fullsized":"2024-05-11T01:01:08.642008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646983+0000","last_change":"2024-05-11T01:01:08.646983+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646983+0000","last_undegraded":"2024-05-11T01:01:08.646983+0000","last_fullsized":"2024-05-11T01:01:08.646983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644147+0000","last_change":"2024-05-11T01:01:08.644147+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644147+0000","last_undegraded":"2024-05-11T01:01:08.644147+0000","last_fullsized":"2024-05-11T01:01:08.644147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640318+0000","last_change":"2024-05-11T01:01:08.640318+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640318+0000","last_undegraded":"2024-05-11T01:01:08.640318+0000","last_fullsized":"2024-05-11T01:01:08.640318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647230+0000","last_change":"2024-05-11T01:01:08.647230+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647230+0000","last_undegraded":"2024-05-11T01:01:08.647230+0000","last_fullsized":"2024-05-11T01:01:08.647230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640153+0000","last_change":"2024-05-11T01:01:08.640153+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640153+0000","last_undegraded":"2024-05-11T01:01:08.640153+0000","last_fullsized":"2024-05-11T01:01:08.640153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658304+0000","last_change":"2024-05-11T01:01:08.656899+0000","last_active":"2024-05-11T01:01:08.658304+0000","last_peered":"2024-05-11T01:01:08.658304+0000","last_clean":"2024-05-11T01:01:08.658304+0000","last_became_active":"2024-05-11T01:01:08.656569+0000","last_became_peered":"2024-05-11T01:01:08.656569+0000","last_unstale":"2024-05-11T01:01:08.658304+0000","last_undegraded":"2024-05-11T01:01:08.658304+0000","last_fullsized":"2024-05-11T01:01:08.658304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643486+0000","last_change":"2024-05-11T01:01:08.643486+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643486+0000","last_undegraded":"2024-05-11T01:01:08.643486+0000","last_fullsized":"2024-05-11T01:01:08.643486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.655969+0000","last_change":"2024-05-11T01:01:08.651945+0000","last_active":"2024-05-11T01:01:08.655969+0000","last_peered":"2024-05-11T01:01:08.655969+0000","last_clean":"2024-05-11T01:01:08.655969+0000","last_became_active":"2024-05-11T01:01:08.651681+0000","last_became_peered":"2024-05-11T01:01:08.651681+0000","last_unstale":"2024-05-11T01:01:08.655969+0000","last_undegraded":"2024-05-11T01:01:08.655969+0000","last_fullsized":"2024-05-11T01:01:08.655969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659704+0000","last_change":"2024-05-11T01:01:08.658922+0000","last_active":"2024-05-11T01:01:08.659704+0000","last_peered":"2024-05-11T01:01:08.659704+0000","last_clean":"2024-05-11T01:01:08.659704+0000","last_became_active":"2024-05-11T01:01:08.658620+0000","last_became_peered":"2024-05-11T01:01:08.658620+0000","last_unstale":"2024-05-11T01:01:08.659704+0000","last_undegraded":"2024-05-11T01:01:08.659704+0000","last_fullsized":"2024-05-11T01:01:08.659704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643967+0000","last_change":"2024-05-11T01:01:08.643967+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643967+0000","last_undegraded":"2024-05-11T01:01:08.643967+0000","last_fullsized":"2024-05-11T01:01:08.643967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.650072+0000","last_change":"2024-05-11T01:01:08.647703+0000","last_active":"2024-05-11T01:01:08.650072+0000","last_peered":"2024-05-11T01:01:08.650072+0000","last_clean":"2024-05-11T01:01:08.650072+0000","last_became_active":"2024-05-11T01:01:08.647434+0000","last_became_peered":"2024-05-11T01:01:08.647434+0000","last_unstale":"2024-05-11T01:01:08.650072+0000","last_undegraded":"2024-05-11T01:01:08.650072+0000","last_fullsized":"2024-05-11T01:01:08.650072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644170+0000","last_change":"2024-05-11T01:01:08.644170+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644170+0000","last_undegraded":"2024-05-11T01:01:08.644170+0000","last_fullsized":"2024-05-11T01:01:08.644170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.656123+0000","last_change":"2024-05-11T01:01:08.655160+0000","last_active":"2024-05-11T01:01:08.656123+0000","last_peered":"2024-05-11T01:01:08.656123+0000","last_clean":"2024-05-11T01:01:08.656123+0000","last_became_active":"2024-05-11T01:01:08.654886+0000","last_became_peered":"2024-05-11T01:01:08.654886+0000","last_unstale":"2024-05-11T01:01:08.656123+0000","last_undegraded":"2024-05-11T01:01:08.656123+0000","last_fullsized":"2024-05-11T01:01:08.656123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643532+0000","last_change":"2024-05-11T01:01:08.643532+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643532+0000","last_undegraded":"2024-05-11T01:01:08.643532+0000","last_fullsized":"2024-05-11T01:01:08.643532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657466+0000","last_change":"2024-05-11T01:01:08.655815+0000","last_active":"2024-05-11T01:01:08.657466+0000","last_peered":"2024-05-11T01:01:08.657466+0000","last_clean":"2024-05-11T01:01:08.657466+0000","last_became_active":"2024-05-11T01:01:08.655307+0000","last_became_peered":"2024-05-11T01:01:08.655307+0000","last_unstale":"2024-05-11T01:01:08.657466+0000","last_undegraded":"2024-05-11T01:01:08.657466+0000","last_fullsized":"2024-05-11T01:01:08.657466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646042+0000","last_change":"2024-05-11T01:01:08.646042+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646042+0000","last_undegraded":"2024-05-11T01:01:08.646042+0000","last_fullsized":"2024-05-11T01:01:08.646042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654599+0000","last_change":"2024-05-11T01:01:08.653490+0000","last_active":"2024-05-11T01:01:08.654599+0000","last_peered":"2024-05-11T01:01:08.654599+0000","last_clean":"2024-05-11T01:01:08.654599+0000","last_became_active":"2024-05-11T01:01:08.653133+0000","last_became_peered":"2024-05-11T01:01:08.653133+0000","last_unstale":"2024-05-11T01:01:08.654599+0000","last_undegraded":"2024-05-11T01:01:08.654599+0000","last_fullsized":"2024-05-11T01:01:08.654599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640364+0000","last_change":"2024-05-11T01:01:08.640364+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640364+0000","last_undegraded":"2024-05-11T01:01:08.640364+0000","last_fullsized":"2024-05-11T01:01:08.640364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657197+0000","last_change":"2024-05-11T01:01:08.654417+0000","last_active":"2024-05-11T01:01:08.657197+0000","last_peered":"2024-05-11T01:01:08.657197+0000","last_clean":"2024-05-11T01:01:08.657197+0000","last_became_active":"2024-05-11T01:01:08.654147+0000","last_became_peered":"2024-05-11T01:01:08.654147+0000","last_unstale":"2024-05-11T01:01:08.657197+0000","last_undegraded":"2024-05-11T01:01:08.657197+0000","last_fullsized":"2024-05-11T01:01:08.657197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645095+0000","last_change":"2024-05-11T01:01:08.645095+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645095+0000","last_undegraded":"2024-05-11T01:01:08.645095+0000","last_fullsized":"2024-05-11T01:01:08.645095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657420+0000","last_change":"2024-05-11T01:01:08.655493+0000","last_active":"2024-05-11T01:01:08.657420+0000","last_peered":"2024-05-11T01:01:08.657420+0000","last_clean":"2024-05-11T01:01:08.657420+0000","last_became_active":"2024-05-11T01:01:08.655147+0000","last_became_peered":"2024-05-11T01:01:08.655147+0000","last_unstale":"2024-05-11T01:01:08.657420+0000","last_undegraded":"2024-05-11T01:01:08.657420+0000","last_fullsized":"2024-05-11T01:01:08.657420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641701+0000","last_change":"2024-05-11T01:01:08.641701+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641701+0000","last_undegraded":"2024-05-11T01:01:08.641701+0000","last_fullsized":"2024-05-11T01:01:08.641701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.651846+0000","last_change":"2024-05-11T01:01:08.648494+0000","last_active":"2024-05-11T01:01:08.651846+0000","last_peered":"2024-05-11T01:01:08.651846+0000","last_clean":"2024-05-11T01:01:08.651846+0000","last_became_active":"2024-05-11T01:01:08.648206+0000","last_became_peered":"2024-05-11T01:01:08.648206+0000","last_unstale":"2024-05-11T01:01:08.651846+0000","last_undegraded":"2024-05-11T01:01:08.651846+0000","last_fullsized":"2024-05-11T01:01:08.651846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642014+0000","last_change":"2024-05-11T01:01:08.642014+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642014+0000","last_undegraded":"2024-05-11T01:01:08.642014+0000","last_fullsized":"2024-05-11T01:01:08.642014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658274+0000","last_change":"2024-05-11T01:01:08.655771+0000","last_active":"2024-05-11T01:01:08.658274+0000","last_peered":"2024-05-11T01:01:08.658274+0000","last_clean":"2024-05-11T01:01:08.658274+0000","last_became_active":"2024-05-11T01:01:08.655462+0000","last_became_peered":"2024-05-11T01:01:08.655462+0000","last_unstale":"2024-05-11T01:01:08.658274+0000","last_undegraded":"2024-05-11T01:01:08.658274+0000","last_fullsized":"2024-05-11T01:01:08.658274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.646474+0000","last_change":"2024-05-11T01:01:08.646474+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.646474+0000","last_undegraded":"2024-05-11T01:01:08.646474+0000","last_fullsized":"2024-05-11T01:01:08.646474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652346+0000","last_change":"2024-05-11T01:01:08.649715+0000","last_active":"2024-05-11T01:01:08.652346+0000","last_peered":"2024-05-11T01:01:08.652346+0000","last_clean":"2024-05-11T01:01:08.652346+0000","last_became_active":"2024-05-11T01:01:08.649344+0000","last_became_peered":"2024-05-11T01:01:08.649344+0000","last_unstale":"2024-05-11T01:01:08.652346+0000","last_undegraded":"2024-05-11T01:01:08.652346+0000","last_fullsized":"2024-05-11T01:01:08.652346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640890+0000","last_change":"2024-05-11T01:01:08.640890+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640890+0000","last_undegraded":"2024-05-11T01:01:08.640890+0000","last_fullsized":"2024-05-11T01:01:08.640890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658084+0000","last_change":"2024-05-11T01:01:08.656669+0000","last_active":"2024-05-11T01:01:08.658084+0000","last_peered":"2024-05-11T01:01:08.658084+0000","last_clean":"2024-05-11T01:01:08.658084+0000","last_became_active":"2024-05-11T01:01:08.656381+0000","last_became_peered":"2024-05-11T01:01:08.656381+0000","last_unstale":"2024-05-11T01:01:08.658084+0000","last_undegraded":"2024-05-11T01:01:08.658084+0000","last_fullsized":"2024-05-11T01:01:08.658084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641185+0000","last_change":"2024-05-11T01:01:08.641185+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641185+0000","last_undegraded":"2024-05-11T01:01:08.641185+0000","last_fullsized":"2024-05-11T01:01:08.641185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652983+0000","last_change":"2024-05-11T01:01:08.651433+0000","last_active":"2024-05-11T01:01:08.652983+0000","last_peered":"2024-05-11T01:01:08.652983+0000","last_clean":"2024-05-11T01:01:08.652983+0000","last_became_active":"2024-05-11T01:01:08.650413+0000","last_became_peered":"2024-05-11T01:01:08.650413+0000","last_unstale":"2024-05-11T01:01:08.652983+0000","last_undegraded":"2024-05-11T01:01:08.652983+0000","last_fullsized":"2024-05-11T01:01:08.652983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640813+0000","last_change":"2024-05-11T01:01:08.640813+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640813+0000","last_undegraded":"2024-05-11T01:01:08.640813+0000","last_fullsized":"2024-05-11T01:01:08.640813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652563+0000","last_change":"2024-05-11T01:01:08.648337+0000","last_active":"2024-05-11T01:01:08.652563+0000","last_peered":"2024-05-11T01:01:08.652563+0000","last_clean":"2024-05-11T01:01:08.652563+0000","last_became_active":"2024-05-11T01:01:08.648027+0000","last_became_peered":"2024-05-11T01:01:08.648027+0000","last_unstale":"2024-05-11T01:01:08.652563+0000","last_undegraded":"2024-05-11T01:01:08.652563+0000","last_fullsized":"2024-05-11T01:01:08.652563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644072+0000","last_change":"2024-05-11T01:01:08.644072+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644072+0000","last_undegraded":"2024-05-11T01:01:08.644072+0000","last_fullsized":"2024-05-11T01:01:08.644072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.650047+0000","last_change":"2024-05-11T01:01:08.648806+0000","last_active":"2024-05-11T01:01:08.650047+0000","last_peered":"2024-05-11T01:01:08.650047+0000","last_clean":"2024-05-11T01:01:08.650047+0000","last_became_active":"2024-05-11T01:01:08.648140+0000","last_became_peered":"2024-05-11T01:01:08.648140+0000","last_unstale":"2024-05-11T01:01:08.650047+0000","last_undegraded":"2024-05-11T01:01:08.650047+0000","last_fullsized":"2024-05-11T01:01:08.650047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642340+0000","last_change":"2024-05-11T01:01:08.642340+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642340+0000","last_undegraded":"2024-05-11T01:01:08.642340+0000","last_fullsized":"2024-05-11T01:01:08.642340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":106,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.651516+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:08.651516+0000","last_peered":"2024-05-11T01:01:08.651516+0000","last_clean":"2024-05-11T01:01:08.651516+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:08.651516+0000","last_undegraded":"2024-05-11T01:01:08.651516+0000","last_fullsized":"2024-05-11T01:01:08.651516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654777+0000","last_change":"2024-05-11T01:01:08.649868+0000","last_active":"2024-05-11T01:01:08.654777+0000","last_peered":"2024-05-11T01:01:08.654777+0000","last_clean":"2024-05-11T01:01:08.654777+0000","last_became_active":"2024-05-11T01:01:08.649580+0000","last_became_peered":"2024-05-11T01:01:08.649580+0000","last_unstale":"2024-05-11T01:01:08.654777+0000","last_undegraded":"2024-05-11T01:01:08.654777+0000","last_fullsized":"2024-05-11T01:01:08.654777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642019+0000","last_change":"2024-05-11T01:01:08.642019+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642019+0000","last_undegraded":"2024-05-11T01:01:08.642019+0000","last_fullsized":"2024-05-11T01:01:08.642019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662245+0000","last_change":"2024-05-11T01:01:08.659302+0000","last_active":"2024-05-11T01:01:08.662245+0000","last_peered":"2024-05-11T01:01:08.662245+0000","last_clean":"2024-05-11T01:01:08.662245+0000","last_became_active":"2024-05-11T01:01:08.658788+0000","last_became_peered":"2024-05-11T01:01:08.658788+0000","last_unstale":"2024-05-11T01:01:08.662245+0000","last_undegraded":"2024-05-11T01:01:08.662245+0000","last_fullsized":"2024-05-11T01:01:08.662245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641388+0000","last_change":"2024-05-11T01:01:08.641388+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641388+0000","last_undegraded":"2024-05-11T01:01:08.641388+0000","last_fullsized":"2024-05-11T01:01:08.641388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.652177+0000","last_change":"2024-05-11T01:01:08.648835+0000","last_active":"2024-05-11T01:01:08.652177+0000","last_peered":"2024-05-11T01:01:08.652177+0000","last_clean":"2024-05-11T01:01:08.652177+0000","last_became_active":"2024-05-11T01:01:08.648420+0000","last_became_peered":"2024-05-11T01:01:08.648420+0000","last_unstale":"2024-05-11T01:01:08.652177+0000","last_undegraded":"2024-05-11T01:01:08.652177+0000","last_fullsized":"2024-05-11T01:01:08.652177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645286+0000","last_change":"2024-05-11T01:01:08.645286+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645286+0000","last_undegraded":"2024-05-11T01:01:08.645286+0000","last_fullsized":"2024-05-11T01:01:08.645286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.656834+0000","last_change":"2024-05-11T01:01:08.655055+0000","last_active":"2024-05-11T01:01:08.656834+0000","last_peered":"2024-05-11T01:01:08.656834+0000","last_clean":"2024-05-11T01:01:08.656834+0000","last_became_active":"2024-05-11T01:01:08.654780+0000","last_became_peered":"2024-05-11T01:01:08.654780+0000","last_unstale":"2024-05-11T01:01:08.656834+0000","last_undegraded":"2024-05-11T01:01:08.656834+0000","last_fullsized":"2024-05-11T01:01:08.656834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640283+0000","last_change":"2024-05-11T01:01:08.640283+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640283+0000","last_undegraded":"2024-05-11T01:01:08.640283+0000","last_fullsized":"2024-05-11T01:01:08.640283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657314+0000","last_change":"2024-05-11T01:01:08.656434+0000","last_active":"2024-05-11T01:01:08.657314+0000","last_peered":"2024-05-11T01:01:08.657314+0000","last_clean":"2024-05-11T01:01:08.657314+0000","last_became_active":"2024-05-11T01:01:08.656111+0000","last_became_peered":"2024-05-11T01:01:08.656111+0000","last_unstale":"2024-05-11T01:01:08.657314+0000","last_undegraded":"2024-05-11T01:01:08.657314+0000","last_fullsized":"2024-05-11T01:01:08.657314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643150+0000","last_change":"2024-05-11T01:01:08.643150+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643150+0000","last_undegraded":"2024-05-11T01:01:08.643150+0000","last_fullsized":"2024-05-11T01:01:08.643150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658349+0000","last_change":"2024-05-11T01:01:08.656666+0000","last_active":"2024-05-11T01:01:08.658349+0000","last_peered":"2024-05-11T01:01:08.658349+0000","last_clean":"2024-05-11T01:01:08.658349+0000","last_became_active":"2024-05-11T01:01:08.656387+0000","last_became_peered":"2024-05-11T01:01:08.656387+0000","last_unstale":"2024-05-11T01:01:08.658349+0000","last_undegraded":"2024-05-11T01:01:08.658349+0000","last_fullsized":"2024-05-11T01:01:08.658349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.642800+0000","last_change":"2024-05-11T01:01:08.642800+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.642800+0000","last_undegraded":"2024-05-11T01:01:08.642800+0000","last_fullsized":"2024-05-11T01:01:08.642800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659261+0000","last_change":"2024-05-11T01:01:08.658432+0000","last_active":"2024-05-11T01:01:08.659261+0000","last_peered":"2024-05-11T01:01:08.659261+0000","last_clean":"2024-05-11T01:01:08.659261+0000","last_became_active":"2024-05-11T01:01:08.658089+0000","last_became_peered":"2024-05-11T01:01:08.658089+0000","last_unstale":"2024-05-11T01:01:08.659261+0000","last_undegraded":"2024-05-11T01:01:08.659261+0000","last_fullsized":"2024-05-11T01:01:08.659261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645040+0000","last_change":"2024-05-11T01:01:08.645040+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645040+0000","last_undegraded":"2024-05-11T01:01:08.645040+0000","last_fullsized":"2024-05-11T01:01:08.645040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.659659+0000","last_change":"2024-05-11T01:01:08.658073+0000","last_active":"2024-05-11T01:01:08.659659+0000","last_peered":"2024-05-11T01:01:08.659659+0000","last_clean":"2024-05-11T01:01:08.659659+0000","last_became_active":"2024-05-11T01:01:08.657786+0000","last_became_peered":"2024-05-11T01:01:08.657786+0000","last_unstale":"2024-05-11T01:01:08.659659+0000","last_undegraded":"2024-05-11T01:01:08.659659+0000","last_fullsized":"2024-05-11T01:01:08.659659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645372+0000","last_change":"2024-05-11T01:01:08.645372+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645372+0000","last_undegraded":"2024-05-11T01:01:08.645372+0000","last_fullsized":"2024-05-11T01:01:08.645372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662168+0000","last_change":"2024-05-11T01:01:08.658520+0000","last_active":"2024-05-11T01:01:08.662168+0000","last_peered":"2024-05-11T01:01:08.662168+0000","last_clean":"2024-05-11T01:01:08.662168+0000","last_became_active":"2024-05-11T01:01:08.657670+0000","last_became_peered":"2024-05-11T01:01:08.657670+0000","last_unstale":"2024-05-11T01:01:08.662168+0000","last_undegraded":"2024-05-11T01:01:08.662168+0000","last_fullsized":"2024-05-11T01:01:08.662168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.640245+0000","last_change":"2024-05-11T01:01:08.640245+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.640245+0000","last_undegraded":"2024-05-11T01:01:08.640245+0000","last_fullsized":"2024-05-11T01:01:08.640245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.654911+0000","last_change":"2024-05-11T01:01:08.653589+0000","last_active":"2024-05-11T01:01:08.654911+0000","last_peered":"2024-05-11T01:01:08.654911+0000","last_clean":"2024-05-11T01:01:08.654911+0000","last_became_active":"2024-05-11T01:01:08.653254+0000","last_became_peered":"2024-05-11T01:01:08.653254+0000","last_unstale":"2024-05-11T01:01:08.654911+0000","last_undegraded":"2024-05-11T01:01:08.654911+0000","last_fullsized":"2024-05-11T01:01:08.654911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.643424+0000","last_change":"2024-05-11T01:01:08.643424+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.643424+0000","last_undegraded":"2024-05-11T01:01:08.643424+0000","last_fullsized":"2024-05-11T01:01:08.643424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.655230+0000","last_change":"2024-05-11T01:01:08.653913+0000","last_active":"2024-05-11T01:01:08.655230+0000","last_peered":"2024-05-11T01:01:08.655230+0000","last_clean":"2024-05-11T01:01:08.655230+0000","last_became_active":"2024-05-11T01:01:08.653485+0000","last_became_peered":"2024-05-11T01:01:08.653485+0000","last_unstale":"2024-05-11T01:01:08.655230+0000","last_undegraded":"2024-05-11T01:01:08.655230+0000","last_fullsized":"2024-05-11T01:01:08.655230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.641461+0000","last_change":"2024-05-11T01:01:08.641461+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.641461+0000","last_undegraded":"2024-05-11T01:01:08.641461+0000","last_fullsized":"2024-05-11T01:01:08.641461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662174+0000","last_change":"2024-05-11T01:01:08.658594+0000","last_active":"2024-05-11T01:01:08.662174+0000","last_peered":"2024-05-11T01:01:08.662174+0000","last_clean":"2024-05-11T01:01:08.662174+0000","last_became_active":"2024-05-11T01:01:08.658310+0000","last_became_peered":"2024-05-11T01:01:08.658310+0000","last_unstale":"2024-05-11T01:01:08.662174+0000","last_undegraded":"2024-05-11T01:01:08.662174+0000","last_fullsized":"2024-05-11T01:01:08.662174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.649153+0000","last_change":"2024-05-11T01:01:08.649153+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.649153+0000","last_undegraded":"2024-05-11T01:01:08.649153+0000","last_fullsized":"2024-05-11T01:01:08.649153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644055+0000","last_change":"2024-05-11T01:01:08.644055+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644055+0000","last_undegraded":"2024-05-11T01:01:08.644055+0000","last_fullsized":"2024-05-11T01:01:08.644055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657607+0000","last_change":"2024-05-11T01:01:08.656072+0000","last_active":"2024-05-11T01:01:08.657607+0000","last_peered":"2024-05-11T01:01:08.657607+0000","last_clean":"2024-05-11T01:01:08.657607+0000","last_became_active":"2024-05-11T01:01:08.655793+0000","last_became_peered":"2024-05-11T01:01:08.655793+0000","last_unstale":"2024-05-11T01:01:08.657607+0000","last_undegraded":"2024-05-11T01:01:08.657607+0000","last_fullsized":"2024-05-11T01:01:08.657607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.645151+0000","last_change":"2024-05-11T01:01:08.645151+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.645151+0000","last_undegraded":"2024-05-11T01:01:08.645151+0000","last_fullsized":"2024-05-11T01:01:08.645151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.662225+0000","last_change":"2024-05-11T01:01:08.659252+0000","last_active":"2024-05-11T01:01:08.662225+0000","last_peered":"2024-05-11T01:01:08.662225+0000","last_clean":"2024-05-11T01:01:08.662225+0000","last_became_active":"2024-05-11T01:01:08.658942+0000","last_became_peered":"2024-05-11T01:01:08.658942+0000","last_unstale":"2024-05-11T01:01:08.662225+0000","last_undegraded":"2024-05-11T01:01:08.662225+0000","last_fullsized":"2024-05-11T01:01:08.662225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.647766+0000","last_change":"2024-05-11T01:01:08.647766+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.647766+0000","last_undegraded":"2024-05-11T01:01:08.647766+0000","last_fullsized":"2024-05-11T01:01:08.647766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.657530+0000","last_change":"2024-05-11T01:01:08.655897+0000","last_active":"2024-05-11T01:01:08.657530+0000","last_peered":"2024-05-11T01:01:08.657530+0000","last_clean":"2024-05-11T01:01:08.657530+0000","last_became_active":"2024-05-11T01:01:08.655602+0000","last_became_peered":"2024-05-11T01:01:08.655602+0000","last_unstale":"2024-05-11T01:01:08.657530+0000","last_undegraded":"2024-05-11T01:01:08.657530+0000","last_fullsized":"2024-05-11T01:01:08.657530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:56.332441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-11T01:01:08.644257+0000","last_change":"2024-05-11T01:01:08.644257+0000","last_active":"2024-05-11T01:01:08.629716+0000","last_peered":"2024-05-11T01:01:08.629716+0000","last_clean":"2024-05-11T01:01:08.629716+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:08.644257+0000","last_undegraded":"2024-05-11T01:01:08.644257+0000","last_fullsized":"2024-05-11T01:01:08.644257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-11T01:01:08.658738+0000","last_change":"2024-05-11T01:01:08.657362+0000","last_active":"2024-05-11T01:01:08.658738+0000","last_peered":"2024-05-11T01:01:08.658738+0000","last_clean":"2024-05-11T01:01:08.658738+0000","last_became_active":"2024-05-11T01:01:08.657072+0000","last_became_peered":"2024-05-11T01:01:08.657072+0000","last_unstale":"2024-05-11T01:01:08.658738+0000","last_undegraded":"2024-05-11T01:01:08.658738+0000","last_fullsized":"2024-05-11T01:01:08.658738+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":774144,"data_stored":648227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":51584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":180224,"data_stored":57859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":761856,"data_stored":641952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:18.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:18.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.355+0000 7f80bc2f1640 1 Processor -- start 2024-05-11T01:01:18.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.355+0000 7f80bc2f1640 1 -- start start 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.356+0000 7f80bc2f1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f80b4160360 0x7f80b4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.356+0000 7f80bc2f1640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80b40b5400 0x7f80b40d2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.356+0000 7f80bc2f1640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80b4160c80 con 0x7f80b40d0d40 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.356+0000 7f80bc2f1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f80b40d1770 con 0x7f80b4160360 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.356+0000 7f80bc2f1640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f80b4163300 con 0x7f80b40b5400 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.356+0000 7f80ba08d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f80b4160360 0x7f80b4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.356+0000 7f80ba08d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f80b4160360 0x7f80b4160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39884/0 (socket says 172.21.15.16:39884) 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.356+0000 7f80ba08d640 1 -- 172.21.15.16:0/1616984003 learned_addr learned my addr 172.21.15.16:0/1616984003 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:18.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.357+0000 7f80ba88e640 1 --2- 172.21.15.16:0/1616984003 >> v2:172.21.15.174:3300/0 conn(0x7f80b40b5400 0x7f80b40d2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.357+0000 7f80ba08d640 1 -- 172.21.15.16:0/1616984003 >> v2:172.21.15.174:3300/0 conn(0x7f80b40b5400 msgr2=0x7f80b40d2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:18.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.357+0000 7f80ba08d640 1 --2- 172.21.15.16:0/1616984003 >> v2:172.21.15.174:3300/0 conn(0x7f80b40b5400 0x7f80b40d2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.357+0000 7f80ba08d640 1 -- 172.21.15.16:0/1616984003 >> v1:172.21.15.174:6789/0 conn(0x7f80b40d0d40 legacy=0x7f80b40b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.357+0000 7f80ba08d640 1 -- 172.21.15.16:0/1616984003 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b41635e0 con 0x7f80b4160360 2024-05-11T01:01:18.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80ba08d640 1 --2- 172.21.15.16:0/1616984003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b4160360 0x7f80b4160740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80b40d1d30 tx=0x7f80a402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127879e7fd3549a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:18.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80b908b640 1 -- 172.21.15.16:0/1616984003 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4036070 con 0x7f80b4160360 2024-05-11T01:01:18.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80b908b640 1 -- 172.21.15.16:0/1616984003 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a4031600 con 0x7f80b4160360 2024-05-11T01:01:18.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80b908b640 1 -- 172.21.15.16:0/1616984003 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a40319d0 con 0x7f80b4160360 2024-05-11T01:01:18.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80bc2f1640 1 -- 172.21.15.16:0/1616984003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b4160360 msgr2=0x7f80b4160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/1616984003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b4160360 0x7f80b4160740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80b40d1d30 tx=0x7f80a402a730 comp rx=0 tx=0).stop 2024-05-11T01:01:18.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80bc2f1640 1 -- 172.21.15.16:0/1616984003 shutdown_connections 2024-05-11T01:01:18.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/1616984003 >> v2:172.21.15.174:3300/0 conn(0x7f80b40b5400 0x7f80b40d2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/1616984003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b4160360 0x7f80b4160740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80bc2f1640 1 -- 172.21.15.16:0/1616984003 >> 172.21.15.16:0/1616984003 conn(0x7f80b40681c0 msgr2=0x7f80b40685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:18.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80bc2f1640 1 -- 172.21.15.16:0/1616984003 shutdown_connections 2024-05-11T01:01:18.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.358+0000 7f80bc2f1640 1 -- 172.21.15.16:0/1616984003 wait complete. 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80bc2f1640 1 Processor -- start 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80bc2f1640 1 -- start start 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80bc2f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b40b5400 0x7f80b40ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80bc2f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80b40d0d40 0x7f80b415bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80bc2f1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4160360 0x7f80b415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80bc2f1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f80b41640c0 con 0x7f80b40b5400 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80bc2f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f80b4163ba0 con 0x7f80b40d0d40 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80bc2f1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f80b41441a0 con 0x7f80b4160360 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.360+0000 7f80ba08d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b40b5400 0x7f80b40ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba08d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b40b5400 0x7f80b40ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39894/0 (socket says 172.21.15.16:39894) 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba08d640 1 -- 172.21.15.16:0/2656329349 learned_addr learned my addr 172.21.15.16:0/2656329349 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba88e640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4160360 0x7f80b415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80b988c640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80b40d0d40 0x7f80b415bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba08d640 1 -- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4160360 msgr2=0x7f80b415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba08d640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4160360 0x7f80b415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba08d640 1 -- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80b40d0d40 msgr2=0x7f80b415bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba08d640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80b40d0d40 0x7f80b415bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba08d640 1 -- 172.21.15.16:0/2656329349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b4147690 con 0x7f80b40b5400 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80b988c640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80b40d0d40 0x7f80b415bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80ba08d640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b40b5400 0x7f80b40ca4b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80a4034040 tx=0x7f80a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80b2ffd640 1 -- 172.21.15.16:0/2656329349 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a403f020 con 0x7f80b40b5400 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80b2ffd640 1 -- 172.21.15.16:0/2656329349 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a4037040 con 0x7f80b40b5400 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b415c920 con 0x7f80b40b5400 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80b2ffd640 1 -- 172.21.15.16:0/2656329349 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4036070 con 0x7f80b40b5400 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.361+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b41446d0 con 0x7f80b40b5400 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.362+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b406a5b0 con 0x7f80b40b5400 2024-05-11T01:01:18.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.363+0000 7f80b2ffd640 1 -- 172.21.15.16:0/2656329349 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f80a4042020 con 0x7f80b40b5400 2024-05-11T01:01:18.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.364+0000 7f80b2ffd640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f80a00762d0 0x7f80a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.364+0000 7f80b2ffd640 1 -- 172.21.15.16:0/2656329349 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f80a40b79d0 con 0x7f80b40b5400 2024-05-11T01:01:18.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.364+0000 7f80b988c640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f80a00762d0 0x7f80a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.364+0000 7f80b988c640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f80a00762d0 0x7f80a0078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80a8001740 tx=0x7f80a8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:18.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.368+0000 7f80b2ffd640 1 -- 172.21.15.16:0/2656329349 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f80a4049030 con 0x7f80b40b5400 2024-05-11T01:01:18.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.557+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80b4164240 con 0x7f80a00762d0 2024-05-11T01:01:18.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.564+0000 7f80b2ffd640 1 -- 172.21.15.16:0/2656329349 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7f80b4164240 con 0x7f80a00762d0 2024-05-11T01:01:18.567 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:18.569 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:18.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f80a00762d0 msgr2=0x7f80a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f80a00762d0 0x7f80a0078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80a8001740 tx=0x7f80a8009040 comp rx=0 tx=0).stop 2024-05-11T01:01:18.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b40b5400 msgr2=0x7f80b40ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b40b5400 0x7f80b40ca4b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f80a4034040 tx=0x7f80a4004a40 comp rx=0 tx=0).stop 2024-05-11T01:01:18.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 shutdown_connections 2024-05-11T01:01:18.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f80a00762d0 0x7f80a0078790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80b4160360 0x7f80b415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80b40d0d40 0x7f80b415bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 --2- 172.21.15.16:0/2656329349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80b40b5400 0x7f80b40ca4b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 >> 172.21.15.16:0/2656329349 conn(0x7f80b40681c0 msgr2=0x7f80b415d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:18.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 shutdown_connections 2024-05-11T01:01:18.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.567+0000 7f80bc2f1640 1 -- 172.21.15.16:0/2656329349 wait complete. 2024-05-11T01:01:18.579 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-05-11T01:01:17.757098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235648,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739072,"statfs":{"total":773094113280,"available":772852809728,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.118646"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640769+0000","last_change":"2024-05-11T01:01:09.660889+0000","last_active":"2024-05-11T01:01:10.640769+0000","last_peered":"2024-05-11T01:01:10.640769+0000","last_clean":"2024-05-11T01:01:10.640769+0000","last_became_active":"2024-05-11T01:01:09.660592+0000","last_became_peered":"2024-05-11T01:01:09.660592+0000","last_unstale":"2024-05-11T01:01:10.640769+0000","last_undegraded":"2024-05-11T01:01:10.640769+0000","last_fullsized":"2024-05-11T01:01:10.640769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:17.765368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639355+0000","last_change":"2024-05-11T01:01:09.662924+0000","last_active":"2024-05-11T01:01:10.639355+0000","last_peered":"2024-05-11T01:01:10.639355+0000","last_clean":"2024-05-11T01:01:10.639355+0000","last_became_active":"2024-05-11T01:01:09.662613+0000","last_became_peered":"2024-05-11T01:01:09.662613+0000","last_unstale":"2024-05-11T01:01:10.639355+0000","last_undegraded":"2024-05-11T01:01:10.639355+0000","last_fullsized":"2024-05-11T01:01:10.639355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779001+0000","last_change":"2024-05-11T01:01:09.650637+0000","last_active":"2024-05-11T01:01:10.779001+0000","last_peered":"2024-05-11T01:01:10.779001+0000","last_clean":"2024-05-11T01:01:10.779001+0000","last_became_active":"2024-05-11T01:01:09.650045+0000","last_became_peered":"2024-05-11T01:01:09.650045+0000","last_unstale":"2024-05-11T01:01:10.779001+0000","last_undegraded":"2024-05-11T01:01:10.779001+0000","last_fullsized":"2024-05-11T01:01:10.779001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846578+0000","last_change":"2024-05-11T01:01:09.659637+0000","last_active":"2024-05-11T01:01:10.846578+0000","last_peered":"2024-05-11T01:01:10.846578+0000","last_clean":"2024-05-11T01:01:10.846578+0000","last_became_active":"2024-05-11T01:01:09.659340+0000","last_became_peered":"2024-05-11T01:01:09.659340+0000","last_unstale":"2024-05-11T01:01:10.846578+0000","last_undegraded":"2024-05-11T01:01:10.846578+0000","last_fullsized":"2024-05-11T01:01:10.846578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:20:29.060496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641126+0000","last_change":"2024-05-11T01:01:09.659284+0000","last_active":"2024-05-11T01:01:10.641126+0000","last_peered":"2024-05-11T01:01:10.641126+0000","last_clean":"2024-05-11T01:01:10.641126+0000","last_became_active":"2024-05-11T01:01:09.658998+0000","last_became_peered":"2024-05-11T01:01:09.658998+0000","last_unstale":"2024-05-11T01:01:10.641126+0000","last_undegraded":"2024-05-11T01:01:10.641126+0000","last_fullsized":"2024-05-11T01:01:10.641126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:00:58.091438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845862+0000","last_change":"2024-05-11T01:01:09.664661+0000","last_active":"2024-05-11T01:01:10.845862+0000","last_peered":"2024-05-11T01:01:10.845862+0000","last_clean":"2024-05-11T01:01:10.845862+0000","last_became_active":"2024-05-11T01:01:09.664406+0000","last_became_peered":"2024-05-11T01:01:09.664406+0000","last_unstale":"2024-05-11T01:01:10.845862+0000","last_undegraded":"2024-05-11T01:01:10.845862+0000","last_fullsized":"2024-05-11T01:01:10.845862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:33:53.314387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640617+0000","last_change":"2024-05-11T01:01:09.659105+0000","last_active":"2024-05-11T01:01:10.640617+0000","last_peered":"2024-05-11T01:01:10.640617+0000","last_clean":"2024-05-11T01:01:10.640617+0000","last_became_active":"2024-05-11T01:01:09.658744+0000","last_became_peered":"2024-05-11T01:01:09.658744+0000","last_unstale":"2024-05-11T01:01:10.640617+0000","last_undegraded":"2024-05-11T01:01:10.640617+0000","last_fullsized":"2024-05-11T01:01:10.640617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:20:29.060496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845412+0000","last_change":"2024-05-11T01:01:09.659097+0000","last_active":"2024-05-11T01:01:10.845412+0000","last_peered":"2024-05-11T01:01:10.845412+0000","last_clean":"2024-05-11T01:01:10.845412+0000","last_became_active":"2024-05-11T01:01:09.658407+0000","last_became_peered":"2024-05-11T01:01:09.658407+0000","last_unstale":"2024-05-11T01:01:10.845412+0000","last_undegraded":"2024-05-11T01:01:10.845412+0000","last_fullsized":"2024-05-11T01:01:10.845412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:12:46.155019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641575+0000","last_change":"2024-05-11T01:01:09.654158+0000","last_active":"2024-05-11T01:01:10.641575+0000","last_peered":"2024-05-11T01:01:10.641575+0000","last_clean":"2024-05-11T01:01:10.641575+0000","last_became_active":"2024-05-11T01:01:09.653934+0000","last_became_peered":"2024-05-11T01:01:09.653934+0000","last_unstale":"2024-05-11T01:01:10.641575+0000","last_undegraded":"2024-05-11T01:01:10.641575+0000","last_fullsized":"2024-05-11T01:01:10.641575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:58:08.244849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846277+0000","last_change":"2024-05-11T01:01:09.651801+0000","last_active":"2024-05-11T01:01:10.846277+0000","last_peered":"2024-05-11T01:01:10.846277+0000","last_clean":"2024-05-11T01:01:10.846277+0000","last_became_active":"2024-05-11T01:01:09.651532+0000","last_became_peered":"2024-05-11T01:01:09.651532+0000","last_unstale":"2024-05-11T01:01:10.846277+0000","last_undegraded":"2024-05-11T01:01:10.846277+0000","last_fullsized":"2024-05-11T01:01:10.846277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846187+0000","last_change":"2024-05-11T01:01:09.651881+0000","last_active":"2024-05-11T01:01:10.846187+0000","last_peered":"2024-05-11T01:01:10.846187+0000","last_clean":"2024-05-11T01:01:10.846187+0000","last_became_active":"2024-05-11T01:01:09.651604+0000","last_became_peered":"2024-05-11T01:01:09.651604+0000","last_unstale":"2024-05-11T01:01:10.846187+0000","last_undegraded":"2024-05-11T01:01:10.846187+0000","last_fullsized":"2024-05-11T01:01:10.846187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640658+0000","last_change":"2024-05-11T01:01:09.654040+0000","last_active":"2024-05-11T01:01:10.640658+0000","last_peered":"2024-05-11T01:01:10.640658+0000","last_clean":"2024-05-11T01:01:10.640658+0000","last_became_active":"2024-05-11T01:01:09.653631+0000","last_became_peered":"2024-05-11T01:01:09.653631+0000","last_unstale":"2024-05-11T01:01:10.640658+0000","last_undegraded":"2024-05-11T01:01:10.640658+0000","last_fullsized":"2024-05-11T01:01:10.640658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:49.875866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845788+0000","last_change":"2024-05-11T01:01:09.663289+0000","last_active":"2024-05-11T01:01:10.845788+0000","last_peered":"2024-05-11T01:01:10.845788+0000","last_clean":"2024-05-11T01:01:10.845788+0000","last_became_active":"2024-05-11T01:01:09.662768+0000","last_became_peered":"2024-05-11T01:01:09.662768+0000","last_unstale":"2024-05-11T01:01:10.845788+0000","last_undegraded":"2024-05-11T01:01:10.845788+0000","last_fullsized":"2024-05-11T01:01:10.845788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:33:53.314387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778816+0000","last_change":"2024-05-11T01:01:09.658330+0000","last_active":"2024-05-11T01:01:10.778816+0000","last_peered":"2024-05-11T01:01:10.778816+0000","last_clean":"2024-05-11T01:01:10.778816+0000","last_became_active":"2024-05-11T01:01:09.658033+0000","last_became_peered":"2024-05-11T01:01:09.658033+0000","last_unstale":"2024-05-11T01:01:10.778816+0000","last_undegraded":"2024-05-11T01:01:10.778816+0000","last_fullsized":"2024-05-11T01:01:10.778816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:07:25.386437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639081+0000","last_change":"2024-05-11T01:01:09.653835+0000","last_active":"2024-05-11T01:01:10.639081+0000","last_peered":"2024-05-11T01:01:10.639081+0000","last_clean":"2024-05-11T01:01:10.639081+0000","last_became_active":"2024-05-11T01:01:09.653540+0000","last_became_peered":"2024-05-11T01:01:09.653540+0000","last_unstale":"2024-05-11T01:01:10.639081+0000","last_undegraded":"2024-05-11T01:01:10.639081+0000","last_fullsized":"2024-05-11T01:01:10.639081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845739+0000","last_change":"2024-05-11T01:01:09.666863+0000","last_active":"2024-05-11T01:01:10.845739+0000","last_peered":"2024-05-11T01:01:10.845739+0000","last_clean":"2024-05-11T01:01:10.845739+0000","last_became_active":"2024-05-11T01:01:09.666571+0000","last_became_peered":"2024-05-11T01:01:09.666571+0000","last_unstale":"2024-05-11T01:01:10.845739+0000","last_undegraded":"2024-05-11T01:01:10.845739+0000","last_fullsized":"2024-05-11T01:01:10.845739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.847013+0000","last_change":"2024-05-11T01:01:09.663210+0000","last_active":"2024-05-11T01:01:10.847013+0000","last_peered":"2024-05-11T01:01:10.847013+0000","last_clean":"2024-05-11T01:01:10.847013+0000","last_became_active":"2024-05-11T01:01:09.662958+0000","last_became_peered":"2024-05-11T01:01:09.662958+0000","last_unstale":"2024-05-11T01:01:10.847013+0000","last_undegraded":"2024-05-11T01:01:10.847013+0000","last_fullsized":"2024-05-11T01:01:10.847013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:06:53.835577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845545+0000","last_change":"2024-05-11T01:01:09.652062+0000","last_active":"2024-05-11T01:01:10.845545+0000","last_peered":"2024-05-11T01:01:10.845545+0000","last_clean":"2024-05-11T01:01:10.845545+0000","last_became_active":"2024-05-11T01:01:09.651794+0000","last_became_peered":"2024-05-11T01:01:09.651794+0000","last_unstale":"2024-05-11T01:01:10.845545+0000","last_undegraded":"2024-05-11T01:01:10.845545+0000","last_fullsized":"2024-05-11T01:01:10.845545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:54.570608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640929+0000","last_change":"2024-05-11T01:01:09.662186+0000","last_active":"2024-05-11T01:01:10.640929+0000","last_peered":"2024-05-11T01:01:10.640929+0000","last_clean":"2024-05-11T01:01:10.640929+0000","last_became_active":"2024-05-11T01:01:09.661941+0000","last_became_peered":"2024-05-11T01:01:09.661941+0000","last_unstale":"2024-05-11T01:01:10.640929+0000","last_undegraded":"2024-05-11T01:01:10.640929+0000","last_fullsized":"2024-05-11T01:01:10.640929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:22:02.787759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846174+0000","last_change":"2024-05-11T01:01:09.655262+0000","last_active":"2024-05-11T01:01:10.846174+0000","last_peered":"2024-05-11T01:01:10.846174+0000","last_clean":"2024-05-11T01:01:10.846174+0000","last_became_active":"2024-05-11T01:01:09.654951+0000","last_became_peered":"2024-05-11T01:01:09.654951+0000","last_unstale":"2024-05-11T01:01:10.846174+0000","last_undegraded":"2024-05-11T01:01:10.846174+0000","last_fullsized":"2024-05-11T01:01:10.846174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778938+0000","last_change":"2024-05-11T01:01:09.649231+0000","last_active":"2024-05-11T01:01:10.778938+0000","last_peered":"2024-05-11T01:01:10.778938+0000","last_clean":"2024-05-11T01:01:10.778938+0000","last_became_active":"2024-05-11T01:01:09.648920+0000","last_became_peered":"2024-05-11T01:01:09.648920+0000","last_unstale":"2024-05-11T01:01:10.778938+0000","last_undegraded":"2024-05-11T01:01:10.778938+0000","last_fullsized":"2024-05-11T01:01:10.778938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:12:46.155019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846056+0000","last_change":"2024-05-11T01:01:09.663855+0000","last_active":"2024-05-11T01:01:10.846056+0000","last_peered":"2024-05-11T01:01:10.846056+0000","last_clean":"2024-05-11T01:01:10.846056+0000","last_became_active":"2024-05-11T01:01:09.663614+0000","last_became_peered":"2024-05-11T01:01:09.663614+0000","last_unstale":"2024-05-11T01:01:10.846056+0000","last_undegraded":"2024-05-11T01:01:10.846056+0000","last_fullsized":"2024-05-11T01:01:10.846056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:30.522539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845782+0000","last_change":"2024-05-11T01:01:09.656048+0000","last_active":"2024-05-11T01:01:10.845782+0000","last_peered":"2024-05-11T01:01:10.845782+0000","last_clean":"2024-05-11T01:01:10.845782+0000","last_became_active":"2024-05-11T01:01:09.655764+0000","last_became_peered":"2024-05-11T01:01:09.655764+0000","last_unstale":"2024-05-11T01:01:10.845782+0000","last_undegraded":"2024-05-11T01:01:10.845782+0000","last_fullsized":"2024-05-11T01:01:10.845782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845810+0000","last_change":"2024-05-11T01:01:09.657669+0000","last_active":"2024-05-11T01:01:10.845810+0000","last_peered":"2024-05-11T01:01:10.845810+0000","last_clean":"2024-05-11T01:01:10.845810+0000","last_became_active":"2024-05-11T01:01:09.657391+0000","last_became_peered":"2024-05-11T01:01:09.657391+0000","last_unstale":"2024-05-11T01:01:10.845810+0000","last_undegraded":"2024-05-11T01:01:10.845810+0000","last_fullsized":"2024-05-11T01:01:10.845810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845432+0000","last_change":"2024-05-11T01:01:09.657628+0000","last_active":"2024-05-11T01:01:10.845432+0000","last_peered":"2024-05-11T01:01:10.845432+0000","last_clean":"2024-05-11T01:01:10.845432+0000","last_became_active":"2024-05-11T01:01:09.656250+0000","last_became_peered":"2024-05-11T01:01:09.656250+0000","last_unstale":"2024-05-11T01:01:10.845432+0000","last_undegraded":"2024-05-11T01:01:10.845432+0000","last_fullsized":"2024-05-11T01:01:10.845432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846487+0000","last_change":"2024-05-11T01:01:09.662365+0000","last_active":"2024-05-11T01:01:10.846487+0000","last_peered":"2024-05-11T01:01:10.846487+0000","last_clean":"2024-05-11T01:01:10.846487+0000","last_became_active":"2024-05-11T01:01:09.662090+0000","last_became_peered":"2024-05-11T01:01:09.662090+0000","last_unstale":"2024-05-11T01:01:10.846487+0000","last_undegraded":"2024-05-11T01:01:10.846487+0000","last_fullsized":"2024-05-11T01:01:10.846487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639359+0000","last_change":"2024-05-11T01:01:09.655565+0000","last_active":"2024-05-11T01:01:10.639359+0000","last_peered":"2024-05-11T01:01:10.639359+0000","last_clean":"2024-05-11T01:01:10.639359+0000","last_became_active":"2024-05-11T01:01:09.655268+0000","last_became_peered":"2024-05-11T01:01:09.655268+0000","last_unstale":"2024-05-11T01:01:10.639359+0000","last_undegraded":"2024-05-11T01:01:10.639359+0000","last_fullsized":"2024-05-11T01:01:10.639359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846062+0000","last_change":"2024-05-11T01:01:09.654719+0000","last_active":"2024-05-11T01:01:10.846062+0000","last_peered":"2024-05-11T01:01:10.846062+0000","last_clean":"2024-05-11T01:01:10.846062+0000","last_became_active":"2024-05-11T01:01:09.654428+0000","last_became_peered":"2024-05-11T01:01:09.654428+0000","last_unstale":"2024-05-11T01:01:10.846062+0000","last_undegraded":"2024-05-11T01:01:10.846062+0000","last_fullsized":"2024-05-11T01:01:10.846062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778974+0000","last_change":"2024-05-11T01:01:09.658293+0000","last_active":"2024-05-11T01:01:10.778974+0000","last_peered":"2024-05-11T01:01:10.778974+0000","last_clean":"2024-05-11T01:01:10.778974+0000","last_became_active":"2024-05-11T01:01:09.658017+0000","last_became_peered":"2024-05-11T01:01:09.658017+0000","last_unstale":"2024-05-11T01:01:10.778974+0000","last_undegraded":"2024-05-11T01:01:10.778974+0000","last_fullsized":"2024-05-11T01:01:10.778974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846261+0000","last_change":"2024-05-11T01:01:09.658403+0000","last_active":"2024-05-11T01:01:10.846261+0000","last_peered":"2024-05-11T01:01:10.846261+0000","last_clean":"2024-05-11T01:01:10.846261+0000","last_became_active":"2024-05-11T01:01:09.656683+0000","last_became_peered":"2024-05-11T01:01:09.656683+0000","last_unstale":"2024-05-11T01:01:10.846261+0000","last_undegraded":"2024-05-11T01:01:10.846261+0000","last_fullsized":"2024-05-11T01:01:10.846261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845249+0000","last_change":"2024-05-11T01:01:09.655041+0000","last_active":"2024-05-11T01:01:10.845249+0000","last_peered":"2024-05-11T01:01:10.845249+0000","last_clean":"2024-05-11T01:01:10.845249+0000","last_became_active":"2024-05-11T01:01:09.654512+0000","last_became_peered":"2024-05-11T01:01:09.654512+0000","last_unstale":"2024-05-11T01:01:10.845249+0000","last_undegraded":"2024-05-11T01:01:10.845249+0000","last_fullsized":"2024-05-11T01:01:10.845249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:14.595099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845846+0000","last_change":"2024-05-11T01:01:09.665750+0000","last_active":"2024-05-11T01:01:10.845846+0000","last_peered":"2024-05-11T01:01:10.845846+0000","last_clean":"2024-05-11T01:01:10.845846+0000","last_became_active":"2024-05-11T01:01:09.665461+0000","last_became_peered":"2024-05-11T01:01:09.665461+0000","last_unstale":"2024-05-11T01:01:10.845846+0000","last_undegraded":"2024-05-11T01:01:10.845846+0000","last_fullsized":"2024-05-11T01:01:10.845846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640244+0000","last_change":"2024-05-11T01:01:09.656560+0000","last_active":"2024-05-11T01:01:10.640244+0000","last_peered":"2024-05-11T01:01:10.640244+0000","last_clean":"2024-05-11T01:01:10.640244+0000","last_became_active":"2024-05-11T01:01:09.656292+0000","last_became_peered":"2024-05-11T01:01:09.656292+0000","last_unstale":"2024-05-11T01:01:10.640244+0000","last_undegraded":"2024-05-11T01:01:10.640244+0000","last_fullsized":"2024-05-11T01:01:10.640244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:13.731770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845885+0000","last_change":"2024-05-11T01:01:08.656899+0000","last_active":"2024-05-11T01:01:10.845885+0000","last_peered":"2024-05-11T01:01:10.845885+0000","last_clean":"2024-05-11T01:01:10.845885+0000","last_became_active":"2024-05-11T01:01:08.656569+0000","last_became_peered":"2024-05-11T01:01:08.656569+0000","last_unstale":"2024-05-11T01:01:10.845885+0000","last_undegraded":"2024-05-11T01:01:10.845885+0000","last_fullsized":"2024-05-11T01:01:10.845885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779096+0000","last_change":"2024-05-11T01:01:09.643951+0000","last_active":"2024-05-11T01:01:10.779096+0000","last_peered":"2024-05-11T01:01:10.779096+0000","last_clean":"2024-05-11T01:01:10.779096+0000","last_became_active":"2024-05-11T01:01:09.643326+0000","last_became_peered":"2024-05-11T01:01:09.643326+0000","last_unstale":"2024-05-11T01:01:10.779096+0000","last_undegraded":"2024-05-11T01:01:10.779096+0000","last_fullsized":"2024-05-11T01:01:10.779096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845917+0000","last_change":"2024-05-11T01:01:08.651945+0000","last_active":"2024-05-11T01:01:10.845917+0000","last_peered":"2024-05-11T01:01:10.845917+0000","last_clean":"2024-05-11T01:01:10.845917+0000","last_became_active":"2024-05-11T01:01:08.651681+0000","last_became_peered":"2024-05-11T01:01:08.651681+0000","last_unstale":"2024-05-11T01:01:10.845917+0000","last_undegraded":"2024-05-11T01:01:10.845917+0000","last_fullsized":"2024-05-11T01:01:10.845917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845858+0000","last_change":"2024-05-11T01:01:08.658922+0000","last_active":"2024-05-11T01:01:10.845858+0000","last_peered":"2024-05-11T01:01:10.845858+0000","last_clean":"2024-05-11T01:01:10.845858+0000","last_became_active":"2024-05-11T01:01:08.658620+0000","last_became_peered":"2024-05-11T01:01:08.658620+0000","last_unstale":"2024-05-11T01:01:10.845858+0000","last_undegraded":"2024-05-11T01:01:10.845858+0000","last_fullsized":"2024-05-11T01:01:10.845858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845920+0000","last_change":"2024-05-11T01:01:09.666049+0000","last_active":"2024-05-11T01:01:10.845920+0000","last_peered":"2024-05-11T01:01:10.845920+0000","last_clean":"2024-05-11T01:01:10.845920+0000","last_became_active":"2024-05-11T01:01:09.665733+0000","last_became_peered":"2024-05-11T01:01:09.665733+0000","last_unstale":"2024-05-11T01:01:10.845920+0000","last_undegraded":"2024-05-11T01:01:10.845920+0000","last_fullsized":"2024-05-11T01:01:10.845920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:30.522539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845870+0000","last_change":"2024-05-11T01:01:08.647703+0000","last_active":"2024-05-11T01:01:10.845870+0000","last_peered":"2024-05-11T01:01:10.845870+0000","last_clean":"2024-05-11T01:01:10.845870+0000","last_became_active":"2024-05-11T01:01:08.647434+0000","last_became_peered":"2024-05-11T01:01:08.647434+0000","last_unstale":"2024-05-11T01:01:10.845870+0000","last_undegraded":"2024-05-11T01:01:10.845870+0000","last_fullsized":"2024-05-11T01:01:10.845870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639149+0000","last_change":"2024-05-11T01:01:09.656131+0000","last_active":"2024-05-11T01:01:10.639149+0000","last_peered":"2024-05-11T01:01:10.639149+0000","last_clean":"2024-05-11T01:01:10.639149+0000","last_became_active":"2024-05-11T01:01:09.654812+0000","last_became_peered":"2024-05-11T01:01:09.654812+0000","last_unstale":"2024-05-11T01:01:10.639149+0000","last_undegraded":"2024-05-11T01:01:10.639149+0000","last_fullsized":"2024-05-11T01:01:10.639149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846088+0000","last_change":"2024-05-11T01:01:08.655160+0000","last_active":"2024-05-11T01:01:10.846088+0000","last_peered":"2024-05-11T01:01:10.846088+0000","last_clean":"2024-05-11T01:01:10.846088+0000","last_became_active":"2024-05-11T01:01:08.654886+0000","last_became_peered":"2024-05-11T01:01:08.654886+0000","last_unstale":"2024-05-11T01:01:10.846088+0000","last_undegraded":"2024-05-11T01:01:10.846088+0000","last_fullsized":"2024-05-11T01:01:10.846088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846657+0000","last_change":"2024-05-11T01:01:09.662654+0000","last_active":"2024-05-11T01:01:10.846657+0000","last_peered":"2024-05-11T01:01:10.846657+0000","last_clean":"2024-05-11T01:01:10.846657+0000","last_became_active":"2024-05-11T01:01:09.662404+0000","last_became_peered":"2024-05-11T01:01:09.662404+0000","last_unstale":"2024-05-11T01:01:10.846657+0000","last_undegraded":"2024-05-11T01:01:10.846657+0000","last_fullsized":"2024-05-11T01:01:10.846657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:22.764677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846814+0000","last_change":"2024-05-11T01:01:08.655815+0000","last_active":"2024-05-11T01:01:10.846814+0000","last_peered":"2024-05-11T01:01:10.846814+0000","last_clean":"2024-05-11T01:01:10.846814+0000","last_became_active":"2024-05-11T01:01:08.655307+0000","last_became_peered":"2024-05-11T01:01:08.655307+0000","last_unstale":"2024-05-11T01:01:10.846814+0000","last_undegraded":"2024-05-11T01:01:10.846814+0000","last_fullsized":"2024-05-11T01:01:10.846814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779197+0000","last_change":"2024-05-11T01:01:09.653742+0000","last_active":"2024-05-11T01:01:10.779197+0000","last_peered":"2024-05-11T01:01:10.779197+0000","last_clean":"2024-05-11T01:01:10.779197+0000","last_became_active":"2024-05-11T01:01:09.653427+0000","last_became_peered":"2024-05-11T01:01:09.653427+0000","last_unstale":"2024-05-11T01:01:10.779197+0000","last_undegraded":"2024-05-11T01:01:10.779197+0000","last_fullsized":"2024-05-11T01:01:10.779197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639415+0000","last_change":"2024-05-11T01:01:08.653490+0000","last_active":"2024-05-11T01:01:10.639415+0000","last_peered":"2024-05-11T01:01:10.639415+0000","last_clean":"2024-05-11T01:01:10.639415+0000","last_became_active":"2024-05-11T01:01:08.653133+0000","last_became_peered":"2024-05-11T01:01:08.653133+0000","last_unstale":"2024-05-11T01:01:10.639415+0000","last_undegraded":"2024-05-11T01:01:10.639415+0000","last_fullsized":"2024-05-11T01:01:10.639415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640807+0000","last_change":"2024-05-11T01:01:09.648279+0000","last_active":"2024-05-11T01:01:10.640807+0000","last_peered":"2024-05-11T01:01:10.640807+0000","last_clean":"2024-05-11T01:01:10.640807+0000","last_became_active":"2024-05-11T01:01:09.647495+0000","last_became_peered":"2024-05-11T01:01:09.647495+0000","last_unstale":"2024-05-11T01:01:10.640807+0000","last_undegraded":"2024-05-11T01:01:10.640807+0000","last_fullsized":"2024-05-11T01:01:10.640807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:14.595099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846299+0000","last_change":"2024-05-11T01:01:08.654417+0000","last_active":"2024-05-11T01:01:10.846299+0000","last_peered":"2024-05-11T01:01:10.846299+0000","last_clean":"2024-05-11T01:01:10.846299+0000","last_became_active":"2024-05-11T01:01:08.654147+0000","last_became_peered":"2024-05-11T01:01:08.654147+0000","last_unstale":"2024-05-11T01:01:10.846299+0000","last_undegraded":"2024-05-11T01:01:10.846299+0000","last_fullsized":"2024-05-11T01:01:10.846299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640575+0000","last_change":"2024-05-11T01:01:09.659281+0000","last_active":"2024-05-11T01:01:10.640575+0000","last_peered":"2024-05-11T01:01:10.640575+0000","last_clean":"2024-05-11T01:01:10.640575+0000","last_became_active":"2024-05-11T01:01:09.659047+0000","last_became_peered":"2024-05-11T01:01:09.659047+0000","last_unstale":"2024-05-11T01:01:10.640575+0000","last_undegraded":"2024-05-11T01:01:10.640575+0000","last_fullsized":"2024-05-11T01:01:10.640575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779066+0000","last_change":"2024-05-11T01:01:08.655493+0000","last_active":"2024-05-11T01:01:10.779066+0000","last_peered":"2024-05-11T01:01:10.779066+0000","last_clean":"2024-05-11T01:01:10.779066+0000","last_became_active":"2024-05-11T01:01:08.655147+0000","last_became_peered":"2024-05-11T01:01:08.655147+0000","last_unstale":"2024-05-11T01:01:10.779066+0000","last_undegraded":"2024-05-11T01:01:10.779066+0000","last_fullsized":"2024-05-11T01:01:10.779066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779183+0000","last_change":"2024-05-11T01:01:09.646387+0000","last_active":"2024-05-11T01:01:10.779183+0000","last_peered":"2024-05-11T01:01:10.779183+0000","last_clean":"2024-05-11T01:01:10.779183+0000","last_became_active":"2024-05-11T01:01:09.646114+0000","last_became_peered":"2024-05-11T01:01:09.646114+0000","last_unstale":"2024-05-11T01:01:10.779183+0000","last_undegraded":"2024-05-11T01:01:10.779183+0000","last_fullsized":"2024-05-11T01:01:10.779183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846342+0000","last_change":"2024-05-11T01:01:08.648494+0000","last_active":"2024-05-11T01:01:10.846342+0000","last_peered":"2024-05-11T01:01:10.846342+0000","last_clean":"2024-05-11T01:01:10.846342+0000","last_became_active":"2024-05-11T01:01:08.648206+0000","last_became_peered":"2024-05-11T01:01:08.648206+0000","last_unstale":"2024-05-11T01:01:10.846342+0000","last_undegraded":"2024-05-11T01:01:10.846342+0000","last_fullsized":"2024-05-11T01:01:10.846342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641026+0000","last_change":"2024-05-11T01:01:09.659174+0000","last_active":"2024-05-11T01:01:10.641026+0000","last_peered":"2024-05-11T01:01:10.641026+0000","last_clean":"2024-05-11T01:01:10.641026+0000","last_became_active":"2024-05-11T01:01:09.658863+0000","last_became_peered":"2024-05-11T01:01:09.658863+0000","last_unstale":"2024-05-11T01:01:10.641026+0000","last_undegraded":"2024-05-11T01:01:10.641026+0000","last_fullsized":"2024-05-11T01:01:10.641026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:54.872438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845810+0000","last_change":"2024-05-11T01:01:08.655771+0000","last_active":"2024-05-11T01:01:10.845810+0000","last_peered":"2024-05-11T01:01:10.845810+0000","last_clean":"2024-05-11T01:01:10.845810+0000","last_became_active":"2024-05-11T01:01:08.655462+0000","last_became_peered":"2024-05-11T01:01:08.655462+0000","last_unstale":"2024-05-11T01:01:10.845810+0000","last_undegraded":"2024-05-11T01:01:10.845810+0000","last_fullsized":"2024-05-11T01:01:10.845810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845935+0000","last_change":"2024-05-11T01:01:09.665678+0000","last_active":"2024-05-11T01:01:10.845935+0000","last_peered":"2024-05-11T01:01:10.845935+0000","last_clean":"2024-05-11T01:01:10.845935+0000","last_became_active":"2024-05-11T01:01:09.665406+0000","last_became_peered":"2024-05-11T01:01:09.665406+0000","last_unstale":"2024-05-11T01:01:10.845935+0000","last_undegraded":"2024-05-11T01:01:10.845935+0000","last_fullsized":"2024-05-11T01:01:10.845935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845152+0000","last_change":"2024-05-11T01:01:08.649715+0000","last_active":"2024-05-11T01:01:10.845152+0000","last_peered":"2024-05-11T01:01:10.845152+0000","last_clean":"2024-05-11T01:01:10.845152+0000","last_became_active":"2024-05-11T01:01:08.649344+0000","last_became_peered":"2024-05-11T01:01:08.649344+0000","last_unstale":"2024-05-11T01:01:10.845152+0000","last_undegraded":"2024-05-11T01:01:10.845152+0000","last_fullsized":"2024-05-11T01:01:10.845152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641228+0000","last_change":"2024-05-11T01:01:09.657070+0000","last_active":"2024-05-11T01:01:10.641228+0000","last_peered":"2024-05-11T01:01:10.641228+0000","last_clean":"2024-05-11T01:01:10.641228+0000","last_became_active":"2024-05-11T01:01:09.656800+0000","last_became_peered":"2024-05-11T01:01:09.656800+0000","last_unstale":"2024-05-11T01:01:10.641228+0000","last_undegraded":"2024-05-11T01:01:10.641228+0000","last_fullsized":"2024-05-11T01:01:10.641228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:06:53.835577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641100+0000","last_change":"2024-05-11T01:01:08.656669+0000","last_active":"2024-05-11T01:01:10.641100+0000","last_peered":"2024-05-11T01:01:10.641100+0000","last_clean":"2024-05-11T01:01:10.641100+0000","last_became_active":"2024-05-11T01:01:08.656381+0000","last_became_peered":"2024-05-11T01:01:08.656381+0000","last_unstale":"2024-05-11T01:01:10.641100+0000","last_undegraded":"2024-05-11T01:01:10.641100+0000","last_fullsized":"2024-05-11T01:01:10.641100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640537+0000","last_change":"2024-05-11T01:01:09.654699+0000","last_active":"2024-05-11T01:01:10.640537+0000","last_peered":"2024-05-11T01:01:10.640537+0000","last_clean":"2024-05-11T01:01:10.640537+0000","last_became_active":"2024-05-11T01:01:09.654453+0000","last_became_peered":"2024-05-11T01:01:09.654453+0000","last_unstale":"2024-05-11T01:01:10.640537+0000","last_undegraded":"2024-05-11T01:01:10.640537+0000","last_fullsized":"2024-05-11T01:01:10.640537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:30:25.516354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845632+0000","last_change":"2024-05-11T01:01:08.651433+0000","last_active":"2024-05-11T01:01:10.845632+0000","last_peered":"2024-05-11T01:01:10.845632+0000","last_clean":"2024-05-11T01:01:10.845632+0000","last_became_active":"2024-05-11T01:01:08.650413+0000","last_became_peered":"2024-05-11T01:01:08.650413+0000","last_unstale":"2024-05-11T01:01:10.845632+0000","last_undegraded":"2024-05-11T01:01:10.845632+0000","last_fullsized":"2024-05-11T01:01:10.845632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641446+0000","last_change":"2024-05-11T01:01:09.656493+0000","last_active":"2024-05-11T01:01:10.641446+0000","last_peered":"2024-05-11T01:01:10.641446+0000","last_clean":"2024-05-11T01:01:10.641446+0000","last_became_active":"2024-05-11T01:01:09.656244+0000","last_became_peered":"2024-05-11T01:01:09.656244+0000","last_unstale":"2024-05-11T01:01:10.641446+0000","last_undegraded":"2024-05-11T01:01:10.641446+0000","last_fullsized":"2024-05-11T01:01:10.641446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:07:55.577276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639446+0000","last_change":"2024-05-11T01:01:08.648337+0000","last_active":"2024-05-11T01:01:10.639446+0000","last_peered":"2024-05-11T01:01:10.639446+0000","last_clean":"2024-05-11T01:01:10.639446+0000","last_became_active":"2024-05-11T01:01:08.648027+0000","last_became_peered":"2024-05-11T01:01:08.648027+0000","last_unstale":"2024-05-11T01:01:10.639446+0000","last_undegraded":"2024-05-11T01:01:10.639446+0000","last_fullsized":"2024-05-11T01:01:10.639446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846751+0000","last_change":"2024-05-11T01:01:09.657860+0000","last_active":"2024-05-11T01:01:10.846751+0000","last_peered":"2024-05-11T01:01:10.846751+0000","last_clean":"2024-05-11T01:01:10.846751+0000","last_became_active":"2024-05-11T01:01:09.657169+0000","last_became_peered":"2024-05-11T01:01:09.657169+0000","last_unstale":"2024-05-11T01:01:10.846751+0000","last_undegraded":"2024-05-11T01:01:10.846751+0000","last_fullsized":"2024-05-11T01:01:10.846751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:22:02.787759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845376+0000","last_change":"2024-05-11T01:01:08.648806+0000","last_active":"2024-05-11T01:01:10.845376+0000","last_peered":"2024-05-11T01:01:10.845376+0000","last_clean":"2024-05-11T01:01:10.845376+0000","last_became_active":"2024-05-11T01:01:08.648140+0000","last_became_peered":"2024-05-11T01:01:08.648140+0000","last_unstale":"2024-05-11T01:01:10.845376+0000","last_undegraded":"2024-05-11T01:01:10.845376+0000","last_fullsized":"2024-05-11T01:01:10.845376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640743+0000","last_change":"2024-05-11T01:01:09.655326+0000","last_active":"2024-05-11T01:01:10.640743+0000","last_peered":"2024-05-11T01:01:10.640743+0000","last_clean":"2024-05-11T01:01:10.640743+0000","last_became_active":"2024-05-11T01:01:09.655056+0000","last_became_peered":"2024-05-11T01:01:09.655056+0000","last_unstale":"2024-05-11T01:01:10.640743+0000","last_undegraded":"2024-05-11T01:01:10.640743+0000","last_fullsized":"2024-05-11T01:01:10.640743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:22.764677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641362+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:10.641362+0000","last_peered":"2024-05-11T01:01:10.641362+0000","last_clean":"2024-05-11T01:01:10.641362+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:10.641362+0000","last_undegraded":"2024-05-11T01:01:10.641362+0000","last_fullsized":"2024-05-11T01:01:10.641362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846455+0000","last_change":"2024-05-11T01:01:08.649868+0000","last_active":"2024-05-11T01:01:10.846455+0000","last_peered":"2024-05-11T01:01:10.846455+0000","last_clean":"2024-05-11T01:01:10.846455+0000","last_became_active":"2024-05-11T01:01:08.649580+0000","last_became_peered":"2024-05-11T01:01:08.649580+0000","last_unstale":"2024-05-11T01:01:10.846455+0000","last_undegraded":"2024-05-11T01:01:10.846455+0000","last_fullsized":"2024-05-11T01:01:10.846455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845507+0000","last_change":"2024-05-11T01:01:09.653271+0000","last_active":"2024-05-11T01:01:10.845507+0000","last_peered":"2024-05-11T01:01:10.845507+0000","last_clean":"2024-05-11T01:01:10.845507+0000","last_became_active":"2024-05-11T01:01:09.652956+0000","last_became_peered":"2024-05-11T01:01:09.652956+0000","last_unstale":"2024-05-11T01:01:10.845507+0000","last_undegraded":"2024-05-11T01:01:10.845507+0000","last_fullsized":"2024-05-11T01:01:10.845507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640973+0000","last_change":"2024-05-11T01:01:08.659302+0000","last_active":"2024-05-11T01:01:10.640973+0000","last_peered":"2024-05-11T01:01:10.640973+0000","last_clean":"2024-05-11T01:01:10.640973+0000","last_became_active":"2024-05-11T01:01:08.658788+0000","last_became_peered":"2024-05-11T01:01:08.658788+0000","last_unstale":"2024-05-11T01:01:10.640973+0000","last_undegraded":"2024-05-11T01:01:10.640973+0000","last_fullsized":"2024-05-11T01:01:10.640973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778819+0000","last_change":"2024-05-11T01:01:09.645180+0000","last_active":"2024-05-11T01:01:10.778819+0000","last_peered":"2024-05-11T01:01:10.778819+0000","last_clean":"2024-05-11T01:01:10.778819+0000","last_became_active":"2024-05-11T01:01:09.644738+0000","last_became_peered":"2024-05-11T01:01:09.644738+0000","last_unstale":"2024-05-11T01:01:10.778819+0000","last_undegraded":"2024-05-11T01:01:10.778819+0000","last_fullsized":"2024-05-11T01:01:10.778819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:29:27.395704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845237+0000","last_change":"2024-05-11T01:01:08.648835+0000","last_active":"2024-05-11T01:01:10.845237+0000","last_peered":"2024-05-11T01:01:10.845237+0000","last_clean":"2024-05-11T01:01:10.845237+0000","last_became_active":"2024-05-11T01:01:08.648420+0000","last_became_peered":"2024-05-11T01:01:08.648420+0000","last_unstale":"2024-05-11T01:01:10.845237+0000","last_undegraded":"2024-05-11T01:01:10.845237+0000","last_fullsized":"2024-05-11T01:01:10.845237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639280+0000","last_change":"2024-05-11T01:01:09.653951+0000","last_active":"2024-05-11T01:01:10.639280+0000","last_peered":"2024-05-11T01:01:10.639280+0000","last_clean":"2024-05-11T01:01:10.639280+0000","last_became_active":"2024-05-11T01:01:09.653685+0000","last_became_peered":"2024-05-11T01:01:09.653685+0000","last_unstale":"2024-05-11T01:01:10.639280+0000","last_undegraded":"2024-05-11T01:01:10.639280+0000","last_fullsized":"2024-05-11T01:01:10.639280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846373+0000","last_change":"2024-05-11T01:01:08.655055+0000","last_active":"2024-05-11T01:01:10.846373+0000","last_peered":"2024-05-11T01:01:10.846373+0000","last_clean":"2024-05-11T01:01:10.846373+0000","last_became_active":"2024-05-11T01:01:08.654780+0000","last_became_peered":"2024-05-11T01:01:08.654780+0000","last_unstale":"2024-05-11T01:01:10.846373+0000","last_undegraded":"2024-05-11T01:01:10.846373+0000","last_fullsized":"2024-05-11T01:01:10.846373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641446+0000","last_change":"2024-05-11T01:01:09.648560+0000","last_active":"2024-05-11T01:01:10.641446+0000","last_peered":"2024-05-11T01:01:10.641446+0000","last_clean":"2024-05-11T01:01:10.641446+0000","last_became_active":"2024-05-11T01:01:09.647285+0000","last_became_peered":"2024-05-11T01:01:09.647285+0000","last_unstale":"2024-05-11T01:01:10.641446+0000","last_undegraded":"2024-05-11T01:01:10.641446+0000","last_fullsized":"2024-05-11T01:01:10.641446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:54.570608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639066+0000","last_change":"2024-05-11T01:01:08.656434+0000","last_active":"2024-05-11T01:01:10.639066+0000","last_peered":"2024-05-11T01:01:10.639066+0000","last_clean":"2024-05-11T01:01:10.639066+0000","last_became_active":"2024-05-11T01:01:08.656111+0000","last_became_peered":"2024-05-11T01:01:08.656111+0000","last_unstale":"2024-05-11T01:01:10.639066+0000","last_undegraded":"2024-05-11T01:01:10.639066+0000","last_fullsized":"2024-05-11T01:01:10.639066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846789+0000","last_change":"2024-05-11T01:01:09.658868+0000","last_active":"2024-05-11T01:01:10.846789+0000","last_peered":"2024-05-11T01:01:10.846789+0000","last_clean":"2024-05-11T01:01:10.846789+0000","last_became_active":"2024-05-11T01:01:09.658511+0000","last_became_peered":"2024-05-11T01:01:09.658511+0000","last_unstale":"2024-05-11T01:01:10.846789+0000","last_undegraded":"2024-05-11T01:01:10.846789+0000","last_fullsized":"2024-05-11T01:01:10.846789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:54.872438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641036+0000","last_change":"2024-05-11T01:01:08.656666+0000","last_active":"2024-05-11T01:01:10.641036+0000","last_peered":"2024-05-11T01:01:10.641036+0000","last_clean":"2024-05-11T01:01:10.641036+0000","last_became_active":"2024-05-11T01:01:08.656387+0000","last_became_peered":"2024-05-11T01:01:08.656387+0000","last_unstale":"2024-05-11T01:01:10.641036+0000","last_undegraded":"2024-05-11T01:01:10.641036+0000","last_fullsized":"2024-05-11T01:01:10.641036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:23:24.406370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639094+0000","last_change":"2024-05-11T01:01:09.652521+0000","last_active":"2024-05-11T01:01:10.639094+0000","last_peered":"2024-05-11T01:01:10.639094+0000","last_clean":"2024-05-11T01:01:10.639094+0000","last_became_active":"2024-05-11T01:01:09.652239+0000","last_became_peered":"2024-05-11T01:01:09.652239+0000","last_unstale":"2024-05-11T01:01:10.639094+0000","last_undegraded":"2024-05-11T01:01:10.639094+0000","last_fullsized":"2024-05-11T01:01:10.639094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639337+0000","last_change":"2024-05-11T01:01:08.658432+0000","last_active":"2024-05-11T01:01:10.639337+0000","last_peered":"2024-05-11T01:01:10.639337+0000","last_clean":"2024-05-11T01:01:10.639337+0000","last_became_active":"2024-05-11T01:01:08.658089+0000","last_became_peered":"2024-05-11T01:01:08.658089+0000","last_unstale":"2024-05-11T01:01:10.639337+0000","last_undegraded":"2024-05-11T01:01:10.639337+0000","last_fullsized":"2024-05-11T01:01:10.639337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845574+0000","last_change":"2024-05-11T01:01:09.661121+0000","last_active":"2024-05-11T01:01:10.845574+0000","last_peered":"2024-05-11T01:01:10.845574+0000","last_clean":"2024-05-11T01:01:10.845574+0000","last_became_active":"2024-05-11T01:01:09.660835+0000","last_became_peered":"2024-05-11T01:01:09.660835+0000","last_unstale":"2024-05-11T01:01:10.845574+0000","last_undegraded":"2024-05-11T01:01:10.845574+0000","last_fullsized":"2024-05-11T01:01:10.845574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846134+0000","last_change":"2024-05-11T01:01:08.658073+0000","last_active":"2024-05-11T01:01:10.846134+0000","last_peered":"2024-05-11T01:01:10.846134+0000","last_clean":"2024-05-11T01:01:10.846134+0000","last_became_active":"2024-05-11T01:01:08.657786+0000","last_became_peered":"2024-05-11T01:01:08.657786+0000","last_unstale":"2024-05-11T01:01:10.846134+0000","last_undegraded":"2024-05-11T01:01:10.846134+0000","last_fullsized":"2024-05-11T01:01:10.846134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779153+0000","last_change":"2024-05-11T01:01:09.658616+0000","last_active":"2024-05-11T01:01:10.779153+0000","last_peered":"2024-05-11T01:01:10.779153+0000","last_clean":"2024-05-11T01:01:10.779153+0000","last_became_active":"2024-05-11T01:01:09.657620+0000","last_became_peered":"2024-05-11T01:01:09.657620+0000","last_unstale":"2024-05-11T01:01:10.779153+0000","last_undegraded":"2024-05-11T01:01:10.779153+0000","last_fullsized":"2024-05-11T01:01:10.779153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640026+0000","last_change":"2024-05-11T01:01:08.658520+0000","last_active":"2024-05-11T01:01:10.640026+0000","last_peered":"2024-05-11T01:01:10.640026+0000","last_clean":"2024-05-11T01:01:10.640026+0000","last_became_active":"2024-05-11T01:01:08.657670+0000","last_became_peered":"2024-05-11T01:01:08.657670+0000","last_unstale":"2024-05-11T01:01:10.640026+0000","last_undegraded":"2024-05-11T01:01:10.640026+0000","last_fullsized":"2024-05-11T01:01:10.640026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640373+0000","last_change":"2024-05-11T01:01:09.653422+0000","last_active":"2024-05-11T01:01:10.640373+0000","last_peered":"2024-05-11T01:01:10.640373+0000","last_clean":"2024-05-11T01:01:10.640373+0000","last_became_active":"2024-05-11T01:01:09.652720+0000","last_became_peered":"2024-05-11T01:01:09.652720+0000","last_unstale":"2024-05-11T01:01:10.640373+0000","last_undegraded":"2024-05-11T01:01:10.640373+0000","last_fullsized":"2024-05-11T01:01:10.640373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:57.610871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639184+0000","last_change":"2024-05-11T01:01:08.653589+0000","last_active":"2024-05-11T01:01:10.639184+0000","last_peered":"2024-05-11T01:01:10.639184+0000","last_clean":"2024-05-11T01:01:10.639184+0000","last_became_active":"2024-05-11T01:01:08.653254+0000","last_became_peered":"2024-05-11T01:01:08.653254+0000","last_unstale":"2024-05-11T01:01:10.639184+0000","last_undegraded":"2024-05-11T01:01:10.639184+0000","last_fullsized":"2024-05-11T01:01:10.639184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:13.592931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845596+0000","last_change":"2024-05-11T01:01:09.659317+0000","last_active":"2024-05-11T01:01:10.845596+0000","last_peered":"2024-05-11T01:01:10.845596+0000","last_clean":"2024-05-11T01:01:10.845596+0000","last_became_active":"2024-05-11T01:01:09.658793+0000","last_became_peered":"2024-05-11T01:01:09.658793+0000","last_unstale":"2024-05-11T01:01:10.845596+0000","last_undegraded":"2024-05-11T01:01:10.845596+0000","last_fullsized":"2024-05-11T01:01:10.845596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639298+0000","last_change":"2024-05-11T01:01:08.653913+0000","last_active":"2024-05-11T01:01:10.639298+0000","last_peered":"2024-05-11T01:01:10.639298+0000","last_clean":"2024-05-11T01:01:10.639298+0000","last_became_active":"2024-05-11T01:01:08.653485+0000","last_became_peered":"2024-05-11T01:01:08.653485+0000","last_unstale":"2024-05-11T01:01:10.639298+0000","last_undegraded":"2024-05-11T01:01:10.639298+0000","last_fullsized":"2024-05-11T01:01:10.639298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845721+0000","last_change":"2024-05-11T01:01:09.663043+0000","last_active":"2024-05-11T01:01:10.845721+0000","last_peered":"2024-05-11T01:01:10.845721+0000","last_clean":"2024-05-11T01:01:10.845721+0000","last_became_active":"2024-05-11T01:01:09.662331+0000","last_became_peered":"2024-05-11T01:01:09.662331+0000","last_unstale":"2024-05-11T01:01:10.845721+0000","last_undegraded":"2024-05-11T01:01:10.845721+0000","last_fullsized":"2024-05-11T01:01:10.845721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641204+0000","last_change":"2024-05-11T01:01:08.658594+0000","last_active":"2024-05-11T01:01:10.641204+0000","last_peered":"2024-05-11T01:01:10.641204+0000","last_clean":"2024-05-11T01:01:10.641204+0000","last_became_active":"2024-05-11T01:01:08.658310+0000","last_became_peered":"2024-05-11T01:01:08.658310+0000","last_unstale":"2024-05-11T01:01:10.641204+0000","last_undegraded":"2024-05-11T01:01:10.641204+0000","last_fullsized":"2024-05-11T01:01:10.641204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:44:19.535130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845797+0000","last_change":"2024-05-11T01:01:09.653439+0000","last_active":"2024-05-11T01:01:10.845797+0000","last_peered":"2024-05-11T01:01:10.845797+0000","last_clean":"2024-05-11T01:01:10.845797+0000","last_became_active":"2024-05-11T01:01:09.653150+0000","last_became_peered":"2024-05-11T01:01:09.653150+0000","last_unstale":"2024-05-11T01:01:10.845797+0000","last_undegraded":"2024-05-11T01:01:10.845797+0000","last_fullsized":"2024-05-11T01:01:10.845797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846741+0000","last_change":"2024-05-11T01:01:09.652866+0000","last_active":"2024-05-11T01:01:10.846741+0000","last_peered":"2024-05-11T01:01:10.846741+0000","last_clean":"2024-05-11T01:01:10.846741+0000","last_became_active":"2024-05-11T01:01:09.652016+0000","last_became_peered":"2024-05-11T01:01:09.652016+0000","last_unstale":"2024-05-11T01:01:10.846741+0000","last_undegraded":"2024-05-11T01:01:10.846741+0000","last_fullsized":"2024-05-11T01:01:10.846741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:17.765368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640394+0000","last_change":"2024-05-11T01:01:08.656072+0000","last_active":"2024-05-11T01:01:10.640394+0000","last_peered":"2024-05-11T01:01:10.640394+0000","last_clean":"2024-05-11T01:01:10.640394+0000","last_became_active":"2024-05-11T01:01:08.655793+0000","last_became_peered":"2024-05-11T01:01:08.655793+0000","last_unstale":"2024-05-11T01:01:10.640394+0000","last_undegraded":"2024-05-11T01:01:10.640394+0000","last_fullsized":"2024-05-11T01:01:10.640394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:13.592931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846596+0000","last_change":"2024-05-11T01:01:09.655397+0000","last_active":"2024-05-11T01:01:10.846596+0000","last_peered":"2024-05-11T01:01:10.846596+0000","last_clean":"2024-05-11T01:01:10.846596+0000","last_became_active":"2024-05-11T01:01:09.654703+0000","last_became_peered":"2024-05-11T01:01:09.654703+0000","last_unstale":"2024-05-11T01:01:10.846596+0000","last_undegraded":"2024-05-11T01:01:10.846596+0000","last_fullsized":"2024-05-11T01:01:10.846596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:30:25.516354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640775+0000","last_change":"2024-05-11T01:01:08.659252+0000","last_active":"2024-05-11T01:01:10.640775+0000","last_peered":"2024-05-11T01:01:10.640775+0000","last_clean":"2024-05-11T01:01:10.640775+0000","last_became_active":"2024-05-11T01:01:08.658942+0000","last_became_peered":"2024-05-11T01:01:08.658942+0000","last_unstale":"2024-05-11T01:01:10.640775+0000","last_undegraded":"2024-05-11T01:01:10.640775+0000","last_fullsized":"2024-05-11T01:01:10.640775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:53.568441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779182+0000","last_change":"2024-05-11T01:01:09.653451+0000","last_active":"2024-05-11T01:01:10.779182+0000","last_peered":"2024-05-11T01:01:10.779182+0000","last_clean":"2024-05-11T01:01:10.779182+0000","last_became_active":"2024-05-11T01:01:09.653028+0000","last_became_peered":"2024-05-11T01:01:09.653028+0000","last_unstale":"2024-05-11T01:01:10.779182+0000","last_undegraded":"2024-05-11T01:01:10.779182+0000","last_fullsized":"2024-05-11T01:01:10.779182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845867+0000","last_change":"2024-05-11T01:01:08.655897+0000","last_active":"2024-05-11T01:01:10.845867+0000","last_peered":"2024-05-11T01:01:10.845867+0000","last_clean":"2024-05-11T01:01:10.845867+0000","last_became_active":"2024-05-11T01:01:08.655602+0000","last_became_peered":"2024-05-11T01:01:08.655602+0000","last_unstale":"2024-05-11T01:01:10.845867+0000","last_undegraded":"2024-05-11T01:01:10.845867+0000","last_fullsized":"2024-05-11T01:01:10.845867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845779+0000","last_change":"2024-05-11T01:01:09.663811+0000","last_active":"2024-05-11T01:01:10.845779+0000","last_peered":"2024-05-11T01:01:10.845779+0000","last_clean":"2024-05-11T01:01:10.845779+0000","last_became_active":"2024-05-11T01:01:09.663489+0000","last_became_peered":"2024-05-11T01:01:09.663489+0000","last_unstale":"2024-05-11T01:01:10.845779+0000","last_undegraded":"2024-05-11T01:01:10.845779+0000","last_fullsized":"2024-05-11T01:01:10.845779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779259+0000","last_change":"2024-05-11T01:01:08.657362+0000","last_active":"2024-05-11T01:01:10.779259+0000","last_peered":"2024-05-11T01:01:10.779259+0000","last_clean":"2024-05-11T01:01:10.779259+0000","last_became_active":"2024-05-11T01:01:08.657072+0000","last_became_peered":"2024-05-11T01:01:08.657072+0000","last_unstale":"2024-05-11T01:01:10.779259+0000","last_undegraded":"2024-05-11T01:01:10.779259+0000","last_fullsized":"2024-05-11T01:01:10.779259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:18.583 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-11T01:01:18.584 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-11T01:01:18.584 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-11T01:01:18.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-11T01:01:18.584 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-11T01:01:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.722+0000 7faa1c9e5640 1 Processor -- start 2024-05-11T01:01:18.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.722+0000 7faa1c9e5640 1 -- start start 2024-05-11T01:01:18.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.723+0000 7faa1c9e5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa180d0000 0x7faa180d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.723+0000 7faa1c9e5640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa180d0920 con 0x7faa180baed0 2024-05-11T01:01:18.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.723+0000 7faa1c9e5640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa18163820 con 0x7faa180d3bf0 2024-05-11T01:01:18.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.723+0000 7faa1c9e5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7faa18163b00 con 0x7faa180d0000 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.723+0000 7faa15d9b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faa180baed0 0x7faa18162fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48762/0 (socket says 172.21.15.16:48762) 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.723+0000 7faa15d9b640 1 -- 172.21.15.16:0/3099322220 learned_addr learned my addr 172.21.15.16:0/3099322220 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1659c640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa180d0000 0x7faa180d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997796982 0 0) 0x7faa180d0920 con 0x7faa180baed0 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa04003520 con 0x7faa180baed0 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2531298643 0 0) 0x7faa04003520 con 0x7faa180baed0 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa180d0000 msgr2=0x7faa180d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa180d0000 0x7faa180d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 >> v1:172.21.15.174:6789/0 conn(0x7faa180d3bf0 legacy=0x7faa180d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa180d33f0 con 0x7faa180baed0 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7faa000016f0 con 0x7faa180baed0 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 >> v1:172.21.15.16:6789/0 conn(0x7faa180baed0 legacy=0x7faa18162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa040039e0 0x7faa04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa180d0000 0x7faa04004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04004d40 0x7faa040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faa18163b00 con 0x7faa04004d40 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faa0400ba70 con 0x7faa040039e0 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7faa0400bc70 con 0x7faa180d0000 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa16d9d640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04004d40 0x7faa040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa1659c640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa040039e0 0x7faa04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa15d9b640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa180d0000 0x7faa04004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa16d9d640 1 -- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa180d0000 msgr2=0x7faa04004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa16d9d640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa180d0000 0x7faa04004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa16d9d640 1 -- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa040039e0 msgr2=0x7faa04003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa16d9d640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa040039e0 0x7faa04003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.724+0000 7faa16d9d640 1 -- 172.21.15.16:0/3099322220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa04003520 con 0x7faa04004d40 2024-05-11T01:01:18.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.725+0000 7faa16d9d640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04004d40 0x7faa040051c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faa08001860 tx=0x7faa04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87c8607ec979054 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.725+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08037070 con 0x7faa04004d40 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.725+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0802abd0 con 0x7faa04004d40 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.725+0000 7faa1559a640 1 -- 172.21.15.16:0/3099322220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080014b0 con 0x7faa04004d40 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.726+0000 7faa1c9e5640 1 -- 172.21.15.16:0/3099322220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04004d40 msgr2=0x7faa040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.726+0000 7faa1c9e5640 1 --2- 172.21.15.16:0/3099322220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa04004d40 0x7faa040051c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faa08001860 tx=0x7faa04005830 comp rx=0 tx=0).stop 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.726+0000 7faa16d9d640 1 -- 172.21.15.16:0/3099322220 reap_dead start 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.726+0000 7faa1c9e5640 1 -- 172.21.15.16:0/3099322220 shutdown_connections 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.726+0000 7faa1c9e5640 1 -- 172.21.15.16:0/3099322220 >> 172.21.15.16:0/3099322220 conn(0x7faa18074140 msgr2=0x7faa180b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.726+0000 7faa1c9e5640 1 -- 172.21.15.16:0/3099322220 shutdown_connections 2024-05-11T01:01:18.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.726+0000 7faa1c9e5640 1 -- 172.21.15.16:0/3099322220 wait complete. 2024-05-11T01:01:18.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.727+0000 7faa1c9e5640 1 Processor -- start 2024-05-11T01:01:18.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.727+0000 7faa1c9e5640 1 -- start start 2024-05-11T01:01:18.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa1c9e5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa04004d40 0x7faa180cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa1c9e5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa181496f0 0x7faa180cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa1c9e5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa18161380 0x7faa18161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa1c9e5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faa1815f750 con 0x7faa181496f0 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa1c9e5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faa18163de0 con 0x7faa04004d40 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa1c9e5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7faa1815f8d0 con 0x7faa18161380 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa15d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa181496f0 0x7faa180cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa15d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa181496f0 0x7faa180cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39910/0 (socket says 172.21.15.16:39910) 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa15d9b640 1 -- 172.21.15.16:0/109202010 learned_addr learned my addr 172.21.15.16:0/109202010 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa1659c640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa04004d40 0x7faa180cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa15d9b640 1 -- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa18161380 msgr2=0x7faa18161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa15d9b640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa18161380 0x7faa18161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa15d9b640 1 -- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa04004d40 msgr2=0x7faa180cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa15d9b640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa04004d40 0x7faa180cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.728+0000 7faa15d9b640 1 -- 172.21.15.16:0/109202010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa180cf200 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.729+0000 7faa15d9b640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa181496f0 0x7faa180cd990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa00007310 tx=0x7faa000077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.729+0000 7faa0effd640 1 -- 172.21.15.16:0/109202010 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0000f860 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.729+0000 7faa0effd640 1 -- 172.21.15.16:0/109202010 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa00018070 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.729+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa180ce330 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.729+0000 7faa0effd640 1 -- 172.21.15.16:0/109202010 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0000fc80 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.729+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa180cceb0 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.730+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa1806a5b0 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.730+0000 7faa0effd640 1 -- 172.21.15.16:0/109202010 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa0001d460 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.731+0000 7faa0effd640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9f8076300 0x7fa9f80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.731+0000 7faa0effd640 1 -- 172.21.15.16:0/109202010 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faa00097630 con 0x7faa181496f0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.731+0000 7faa1659c640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9f8076300 0x7fa9f80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:18.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.732+0000 7faa1659c640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9f8076300 0x7fa9f80787c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa10007440 tx=0x7faa1000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:18.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.735+0000 7faa0effd640 1 -- 172.21.15.16:0/109202010 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faa00060f00 con 0x7faa181496f0 2024-05-11T01:01:18.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:01:18.953 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:01:18.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.978+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7faa18159060 con 0x7faa181496f0 2024-05-11T01:01:18.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.981+0000 7faa0effd640 1 -- 172.21.15.16:0/109202010 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189524 (secure 0 0 0) 0x7faa00060800 con 0x7faa181496f0 2024-05-11T01:01:18.985 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:18.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9f8076300 msgr2=0x7fa9f80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9f8076300 0x7fa9f80787c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa10007440 tx=0x7faa1000b040 comp rx=0 tx=0).stop 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa181496f0 msgr2=0x7faa180cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa181496f0 0x7faa180cd990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa00007310 tx=0x7faa000077d0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 shutdown_connections 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9f8076300 0x7fa9f80787c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faa18161380 0x7faa18161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa181496f0 0x7faa180cd990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 --2- 172.21.15.16:0/109202010 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faa04004d40 0x7faa180cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 >> 172.21.15.16:0/109202010 conn(0x7faa18074140 msgr2=0x7faa18159580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 shutdown_connections 2024-05-11T01:01:18.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:18.984+0000 7faa1c9e5640 1 -- 172.21.15.16:0/109202010 wait complete. 2024-05-11T01:01:18.999 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":704865226},{"type":"v1","addr":"172.21.15.174:6833","nonce":704865226}]},"active_addr":"172.21.15.174:6833/704865226","active_change":"2024-05-11T01:00:57.743554+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":990588653}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":2159563993}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":3687919634}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":3333657563}]}]} 2024-05-11T01:01:19.004 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-11T01:01:19.004 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-11T01:01:19.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:19.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.148+0000 7fe543859640 1 Processor -- start 2024-05-11T01:01:19.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.148+0000 7fe543859640 1 -- start start 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe543859640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe53c160360 0x7fe53c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe543859640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe53c0d0d40 0x7fe53c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe543859640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53c160c80 con 0x7fe53c0d11f0 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe543859640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe53c0d1770 con 0x7fe53c0d0d40 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe543859640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fe53c163300 con 0x7fe53c160360 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe540df4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe53c0d0d40 0x7fe53c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe541df6640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe53c0d11f0 0x7fe53c06d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48778/0 (socket says 172.21.15.16:48778) 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe541df6640 1 -- 172.21.15.16:0/2668737778 learned_addr learned my addr 172.21.15.16:0/2668737778 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:19.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe5415f5640 1 --2- 172.21.15.16:0/2668737778 >> v2:172.21.15.174:3300/0 conn(0x7fe53c160360 0x7fe53c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe540df4640 1 -- 172.21.15.16:0/2668737778 >> v2:172.21.15.174:3300/0 conn(0x7fe53c160360 msgr2=0x7fe53c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe540df4640 1 --2- 172.21.15.16:0/2668737778 >> v2:172.21.15.174:3300/0 conn(0x7fe53c160360 0x7fe53c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe540df4640 1 -- 172.21.15.16:0/2668737778 >> v1:172.21.15.16:6789/0 conn(0x7fe53c0d11f0 legacy=0x7fe53c06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe533fff640 1 -- 172.21.15.16:0/2668737778 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267714021 0 0) 0x7fe53c160c80 con 0x7fe53c0d11f0 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe540df4640 1 -- 172.21.15.16:0/2668737778 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53c1635e0 con 0x7fe53c0d0d40 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.149+0000 7fe5415f5640 1 --2- 172.21.15.16:0/2668737778 >> v2:172.21.15.174:3300/0 conn(0x7fe53c160360 0x7fe53c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.150+0000 7fe540df4640 1 --2- 172.21.15.16:0/2668737778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c0b4cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0097a0 tx=0x7fe52c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1df2fb45ff08f71 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.150+0000 7fe533fff640 1 -- 172.21.15.16:0/2668737778 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c037070 con 0x7fe53c0d0d40 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.150+0000 7fe533fff640 1 -- 172.21.15.16:0/2668737778 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c032440 con 0x7fe53c0d0d40 2024-05-11T01:01:19.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.150+0000 7fe533fff640 1 -- 172.21.15.16:0/2668737778 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c032810 con 0x7fe53c0d0d40 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.151+0000 7fe543859640 1 -- 172.21.15.16:0/2668737778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 msgr2=0x7fe53c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.151+0000 7fe543859640 1 --2- 172.21.15.16:0/2668737778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c0b4cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0097a0 tx=0x7fe52c02a1e0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.151+0000 7fe543859640 1 -- 172.21.15.16:0/2668737778 shutdown_connections 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.151+0000 7fe543859640 1 --2- 172.21.15.16:0/2668737778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c0b4cf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.151+0000 7fe543859640 1 --2- 172.21.15.16:0/2668737778 >> v2:172.21.15.174:3300/0 conn(0x7fe53c160360 0x7fe53c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.151+0000 7fe543859640 1 -- 172.21.15.16:0/2668737778 >> 172.21.15.16:0/2668737778 conn(0x7fe53c0681c0 msgr2=0x7fe53c0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.151+0000 7fe543859640 1 -- 172.21.15.16:0/2668737778 shutdown_connections 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.151+0000 7fe543859640 1 -- 172.21.15.16:0/2668737778 wait complete. 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.152+0000 7fe543859640 1 Processor -- start 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.152+0000 7fe543859640 1 -- start start 2024-05-11T01:01:19.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe543859640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe543859640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe53c0d11f0 0x7fe53c161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe543859640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe53c160360 0x7fe53c161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe543859640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c0d3d80 con 0x7fe53c0d0d40 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe543859640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c163ba0 con 0x7fe53c0d11f0 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe543859640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe53c1640c0 con 0x7fe53c160360 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39928/0 (socket says 172.21.15.16:39928) 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 -- 172.21.15.16:0/2241315454 learned_addr learned my addr 172.21.15.16:0/2241315454 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe541df6640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe53c160360 0x7fe53c161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe540df4640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe53c0d11f0 0x7fe53c161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 -- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe53c160360 msgr2=0x7fe53c161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe53c160360 0x7fe53c161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 -- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe53c0d11f0 msgr2=0x7fe53c161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe53c0d11f0 0x7fe53c161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 -- 172.21.15.16:0/2241315454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53c0cd070 con 0x7fe53c0d0d40 2024-05-11T01:01:19.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe541df6640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe53c160360 0x7fe53c161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:19.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe5415f5640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c158f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe53800c7f0 tx=0x7fe53800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe531ffb640 1 -- 172.21.15.16:0/2241315454 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538015070 con 0x7fe53c0d0d40 2024-05-11T01:01:19.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe531ffb640 1 -- 172.21.15.16:0/2241315454 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe538007a30 con 0x7fe53c0d0d40 2024-05-11T01:01:19.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53c0cdb80 con 0x7fe53c0d0d40 2024-05-11T01:01:19.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.153+0000 7fe531ffb640 1 -- 172.21.15.16:0/2241315454 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538007e00 con 0x7fe53c0d0d40 2024-05-11T01:01:19.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.154+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe53c0cd5c0 con 0x7fe53c0d0d40 2024-05-11T01:01:19.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.155+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe53c06a5b0 con 0x7fe53c0d0d40 2024-05-11T01:01:19.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.155+0000 7fe531ffb640 1 -- 172.21.15.16:0/2241315454 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe538018070 con 0x7fe53c0d0d40 2024-05-11T01:01:19.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.156+0000 7fe531ffb640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe5200762d0 0x7fe520078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.156+0000 7fe531ffb640 1 -- 172.21.15.16:0/2241315454 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe538097550 con 0x7fe53c0d0d40 2024-05-11T01:01:19.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.156+0000 7fe540df4640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe5200762d0 0x7fe520078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.157+0000 7fe540df4640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe5200762d0 0x7fe520078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe52c034000 tx=0x7fe52c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.160+0000 7fe531ffb640 1 -- 172.21.15.16:0/2241315454 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe53c0cdb80 con 0x7fe53c0d0d40 2024-05-11T01:01:19.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.353+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe53c0d07b0 con 0x7fe53c0d0d40 2024-05-11T01:01:19.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.354+0000 7fe531ffb640 1 -- 172.21.15.16:0/2241315454 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fe538060eb0 con 0x7fe53c0d0d40 2024-05-11T01:01:19.355 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:19.356 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:10.636137+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:19.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe5200762d0 msgr2=0x7fe520078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe5200762d0 0x7fe520078790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe52c034000 tx=0x7fe52c02e000 comp rx=0 tx=0).stop 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 msgr2=0x7fe53c158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c158f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe53800c7f0 tx=0x7fe53800cbf0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 shutdown_connections 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe5200762d0 0x7fe520078790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe53c160360 0x7fe53c161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe53c0d11f0 0x7fe53c161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 --2- 172.21.15.16:0/2241315454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe53c0d0d40 0x7fe53c158f40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 >> 172.21.15.16:0/2241315454 conn(0x7fe53c0681c0 msgr2=0x7fe53c15f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 shutdown_connections 2024-05-11T01:01:19.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.356+0000 7fe543859640 1 -- 172.21.15.16:0/2241315454 wait complete. 2024-05-11T01:01:19.368 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-11T01:01:19.369 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:19.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.471+0000 7f8447d40640 1 Processor -- start 2024-05-11T01:01:19.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.471+0000 7f8447d40640 1 -- start start 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8447d40640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f844015d1f0 0x7f84400b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8447d40640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84400b1490 0x7f84400b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8447d40640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844015fc20 con 0x7f84400b58c0 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8447d40640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8440160510 con 0x7f844015d1f0 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8447d40640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f84400b19d0 con 0x7f84400b1490 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8445adc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f844015d1f0 0x7f84400b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8445adc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f844015d1f0 0x7f84400b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39932/0 (socket says 172.21.15.16:39932) 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8445adc640 1 -- 172.21.15.16:0/3110556865 learned_addr learned my addr 172.21.15.16:0/3110556865 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f84452db640 1 --2- 172.21.15.16:0/3110556865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84400b1490 0x7f84400b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8445adc640 1 -- 172.21.15.16:0/3110556865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84400b1490 msgr2=0x7f84400b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8445adc640 1 --2- 172.21.15.16:0/3110556865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84400b1490 0x7f84400b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8445adc640 1 -- 172.21.15.16:0/3110556865 >> v1:172.21.15.174:6789/0 conn(0x7f84400b58c0 legacy=0x7f8440073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.472+0000 7f8445adc640 1 -- 172.21.15.16:0/3110556865 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844015fec0 con 0x7f844015d1f0 2024-05-11T01:01:19.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.473+0000 7f8445adc640 1 --2- 172.21.15.16:0/3110556865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f844015d1f0 0x7f84400b0f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f843c009870 tx=0x7f843c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbab3f1220dff0d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.473+0000 7f8444ada640 1 -- 172.21.15.16:0/3110556865 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c037070 con 0x7f844015d1f0 2024-05-11T01:01:19.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.473+0000 7f8444ada640 1 -- 172.21.15.16:0/3110556865 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843c032440 con 0x7f844015d1f0 2024-05-11T01:01:19.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.473+0000 7f8444ada640 1 -- 172.21.15.16:0/3110556865 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843c032810 con 0x7f844015d1f0 2024-05-11T01:01:19.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.474+0000 7f8447d40640 1 -- 172.21.15.16:0/3110556865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f844015d1f0 msgr2=0x7f84400b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.474+0000 7f8447d40640 1 --2- 172.21.15.16:0/3110556865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f844015d1f0 0x7f84400b0f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f843c009870 tx=0x7f843c02a270 comp rx=0 tx=0).stop 2024-05-11T01:01:19.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.474+0000 7f8447d40640 1 -- 172.21.15.16:0/3110556865 shutdown_connections 2024-05-11T01:01:19.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.474+0000 7f8447d40640 1 --2- 172.21.15.16:0/3110556865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84400b1490 0x7f84400b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.474+0000 7f8447d40640 1 --2- 172.21.15.16:0/3110556865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f844015d1f0 0x7f84400b0f50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.474+0000 7f8447d40640 1 -- 172.21.15.16:0/3110556865 >> 172.21.15.16:0/3110556865 conn(0x7f84400d2060 msgr2=0x7f84400d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.474+0000 7f8447d40640 1 -- 172.21.15.16:0/3110556865 shutdown_connections 2024-05-11T01:01:19.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.474+0000 7f8447d40640 1 -- 172.21.15.16:0/3110556865 wait complete. 2024-05-11T01:01:19.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.475+0000 7f8447d40640 1 Processor -- start 2024-05-11T01:01:19.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.475+0000 7f8447d40640 1 -- start start 2024-05-11T01:01:19.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84400b1490 0x7f84400ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84400b58c0 0x7f8440161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f844015d1f0 0x7f84401622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f84400718a0 con 0x7f84400b58c0 2024-05-11T01:01:19.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f84401609a0 con 0x7f84400b1490 2024-05-11T01:01:19.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f844006d230 con 0x7f844015d1f0 2024-05-11T01:01:19.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84400b58c0 0x7f8440161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84400b58c0 0x7f8440161db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39942/0 (socket says 172.21.15.16:39942) 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 -- 172.21.15.16:0/1873977846 learned_addr learned my addr 172.21.15.16:0/1873977846 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8445adc640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84400b1490 0x7f84400ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84462dd640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f844015d1f0 0x7f84401622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 -- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f844015d1f0 msgr2=0x7f84401622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f844015d1f0 0x7f84401622f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 -- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84400b1490 msgr2=0x7f84400ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84400b1490 0x7f84400ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 -- 172.21.15.16:0/1873977846 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84401599c0 con 0x7f84400b58c0 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84462dd640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f844015d1f0 0x7f84401622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84452db640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84400b58c0 0x7f8440161db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f843000d800 tx=0x7f843000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84367fc640 1 -- 172.21.15.16:0/1873977846 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843000b6c0 con 0x7f84400b58c0 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84367fc640 1 -- 172.21.15.16:0/1873977846 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8430019070 con 0x7f84400b58c0 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84400cf0c0 con 0x7f84400b58c0 2024-05-11T01:01:19.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f84367fc640 1 -- 172.21.15.16:0/1873977846 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f843000bac0 con 0x7f84400b58c0 2024-05-11T01:01:19.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84400cf680 con 0x7f84400b58c0 2024-05-11T01:01:19.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.477+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f844006a5b0 con 0x7f84400b58c0 2024-05-11T01:01:19.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.478+0000 7f84367fc640 1 -- 172.21.15.16:0/1873977846 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f843000bc60 con 0x7f84400b58c0 2024-05-11T01:01:19.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.479+0000 7f84367fc640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f84240762d0 0x7f8424078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.479+0000 7f84367fc640 1 -- 172.21.15.16:0/1873977846 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8430097a60 con 0x7f84400b58c0 2024-05-11T01:01:19.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.479+0000 7f8445adc640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f84240762d0 0x7f8424078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.479+0000 7f8445adc640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f84240762d0 0x7f8424078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f843c034000 tx=0x7f843c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.484+0000 7f84367fc640 1 -- 172.21.15.16:0/1873977846 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f84300613c0 con 0x7f84400b58c0 2024-05-11T01:01:19.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.677+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84400ce7a0 con 0x7f84400b58c0 2024-05-11T01:01:19.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.678+0000 7f84367fc640 1 -- 172.21.15.16:0/1873977846 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f8430060cc0 con 0x7f84400b58c0 2024-05-11T01:01:19.680 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:19.680 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:10.636137+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.680+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f84240762d0 msgr2=0x7f8424078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.680+0000 7f8447d40640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f84240762d0 0x7f8424078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f843c034000 tx=0x7f843c02e000 comp rx=0 tx=0).stop 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.680+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84400b58c0 msgr2=0x7f8440161db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.680+0000 7f8447d40640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84400b58c0 0x7f8440161db0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f843000d800 tx=0x7f843000dcc0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.681+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 shutdown_connections 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.681+0000 7f8447d40640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f84240762d0 0x7f8424078790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.681+0000 7f8447d40640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f844015d1f0 0x7f84401622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.681+0000 7f8447d40640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84400b58c0 0x7f8440161db0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.681+0000 7f8447d40640 1 --2- 172.21.15.16:0/1873977846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84400b1490 0x7f84400ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.681+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 >> 172.21.15.16:0/1873977846 conn(0x7f84400d2060 msgr2=0x7f844006c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.681+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 shutdown_connections 2024-05-11T01:01:19.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.681+0000 7f8447d40640 1 -- 172.21.15.16:0/1873977846 wait complete. 2024-05-11T01:01:19.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-11T01:01:19.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-11T01:01:19.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-11T01:01:19.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-11T01:01:19.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-11T01:01:19.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-11T01:01:19.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-11T01:01:19.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-11T01:01:19.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.875+0000 7f3d65ac2640 1 Processor -- start 2024-05-11T01:01:19.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.875+0000 7f0fbb3d5640 1 Processor -- start 2024-05-11T01:01:19.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.875+0000 7f0fbb3d5640 1 -- start start 2024-05-11T01:01:19.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.875+0000 7f3d65ac2640 1 -- start start 2024-05-11T01:01:19.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.876+0000 7f3d65ac2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60145250 0x7f3d600d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.876+0000 7f3d65ac2640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3d60073320 0x7f3d60073790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.876+0000 7ff66bfff640 1 Processor -- start 2024-05-11T01:01:19.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.876+0000 7f3d65ac2640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d600b5010 con 0x7f3d6015d220 2024-05-11T01:01:19.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.876+0000 7f3d65ac2640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3d60073cd0 con 0x7f3d60073320 2024-05-11T01:01:19.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.876+0000 7f3d65ac2640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3d600d0c20 con 0x7f3d60145250 2024-05-11T01:01:19.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.876+0000 7ff66bfff640 1 -- start start 2024-05-11T01:01:19.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f0fbb3d5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0e02c0 0x7f0fac0e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f0fbb3d5640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fac056580 con 0x7f0fac0e40f0 2024-05-11T01:01:19.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f0fbb3d5640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fac056860 con 0x7f0fac0dfee0 2024-05-11T01:01:19.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f0fbb3d5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0fac0e4540 con 0x7f0fac0e02c0 2024-05-11T01:01:19.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7f0fba3d3640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0fac0dfee0 0x7f0fac0085c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:47194/0 (socket says 172.21.15.16:47194) 2024-05-11T01:01:19.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7f0fba3d3640 1 -- 172.21.15.16:0/653322354 learned_addr learned my addr 172.21.15.16:0/653322354 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:19.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c163a70 0x7ff66c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66bfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff66c06caf0 0x7ff66c06f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66bfff640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66c0b6050 con 0x7ff66c0af2f0 2024-05-11T01:01:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66bfff640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff66c0b6330 con 0x7ff66c06caf0 2024-05-11T01:01:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66bfff640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c0b6610 con 0x7ff66c163a70 2024-05-11T01:01:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7f0fb9bd2640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0e02c0 0x7f0fac0e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831658737 0 0) 0x7f0fac056580 con 0x7f0fac0e40f0 2024-05-11T01:01:19.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fa0003520 con 0x7f0fac0e40f0 2024-05-11T01:01:19.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff66c06caf0 0x7ff66c06f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff66c06caf0 0x7ff66c06f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:39944/0 (socket says 172.21.15.16:39944) 2024-05-11T01:01:19.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551398520 0 0) 0x7f0fac056860 con 0x7f0fac0dfee0 2024-05-11T01:01:19.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fac056580 con 0x7f0fac0dfee0 2024-05-11T01:01:19.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2577683843 0 0) 0x7f0fa0003520 con 0x7f0fac0e40f0 2024-05-11T01:01:19.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0e02c0 msgr2=0x7f0fac0e3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0e02c0 0x7f0fac0e3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 >> v1:172.21.15.174:6789/0 conn(0x7f0fac0dfee0 legacy=0x7f0fac0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac008e50 con 0x7f0fac0e40f0 2024-05-11T01:01:19.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f0fb4076a40 con 0x7f0fac0e40f0 2024-05-11T01:01:19.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 >> v1:172.21.15.16:6789/0 conn(0x7f0fac0e40f0 legacy=0x7f0fac0539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66b7fe640 1 -- 172.21.15.16:0/4243908070 learned_addr learned my addr 172.21.15.16:0/4243908070 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.878+0000 7ff66affd640 1 --2- 172.21.15.16:0/4243908070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c163a70 0x7ff66c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa0004bd0 0x7f0fa0004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa00037a0 0x7f0fa0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa0004160 0x7f0fa000ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac0e4540 con 0x7f0fa0004bd0 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa000e270 con 0x7f0fa00037a0 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa000e470 con 0x7f0fa0004160 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7ff66b7fe640 1 -- 172.21.15.16:0/4243908070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c163a70 msgr2=0x7ff66c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7ff66b7fe640 1 --2- 172.21.15.16:0/4243908070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c163a70 0x7ff66c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7ff66b7fe640 1 -- 172.21.15.16:0/4243908070 >> v1:172.21.15.16:6789/0 conn(0x7ff66c0af2f0 legacy=0x7ff66c06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7ff66b7fe640 1 -- 172.21.15.16:0/4243908070 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c0b68f0 con 0x7ff66c06caf0 2024-05-11T01:01:19.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fbabd4640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa0004160 0x7f0fa000ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f0fb9bd2640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0e02c0 0x7f0fac0e3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:19.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d5ffff640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f3d6015d220 0x7f3d6015faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:47184/0 (socket says 172.21.15.16:47184) 2024-05-11T01:01:19.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d5ffff640 1 -- 172.21.15.16:0/2898742417 learned_addr learned my addr 172.21.15.16:0/2898742417 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:19.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d652c1640 1 --2- 172.21.15.16:0/2898742417 >> v2:172.21.15.174:3300/0 conn(0x7f3d60073320 0x7f3d60073790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d64ac0640 1 --2- 172.21.15.16:0/2898742417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60145250 0x7f3d600d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7f0fbabd4640 1 -- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa00037a0 msgr2=0x7f0fa0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7f0fbabd4640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fa00037a0 0x7f0fa0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7f0fbabd4640 1 -- 172.21.15.16:0/653322354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa0004bd0 msgr2=0x7f0fa0004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7f0fbabd4640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa0004bd0 0x7f0fa0004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7f0fbabd4640 1 -- 172.21.15.16:0/653322354 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa0003520 con 0x7f0fa0004160 2024-05-11T01:01:19.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7ff66b7fe640 1 --2- 172.21.15.16:0/4243908070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c06caf0 0x7ff66c06f2a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff660009870 tx=0x7ff66002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3cf4fa7afbb096 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d5f7fe640 1 -- 172.21.15.16:0/2898742417 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542540646 0 0) 0x7f3d600b5010 con 0x7f3d6015d220 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d5f7fe640 1 -- 172.21.15.16:0/2898742417 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d4c00bd30 con 0x7f3d6015d220 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d652c1640 1 -- 172.21.15.16:0/2898742417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60145250 msgr2=0x7f3d600d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d652c1640 1 --2- 172.21.15.16:0/2898742417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60145250 0x7f3d600d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d652c1640 1 -- 172.21.15.16:0/2898742417 >> v1:172.21.15.174:6789/0 conn(0x7f3d6015d220 legacy=0x7f3d6015faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.877+0000 7f3d652c1640 1 -- 172.21.15.16:0/2898742417 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d601603d0 con 0x7f3d60073320 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f3d652c1640 1 --2- 172.21.15.16:0/2898742417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60073320 0x7f3d60073790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d48010b90 tx=0x7f3d4802a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3bfe063a573042 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f3d5f7fe640 1 -- 172.21.15.16:0/2898742417 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48048070 con 0x7f3d60073320 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f3d5f7fe640 1 -- 172.21.15.16:0/2898742417 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48043650 con 0x7f3d60073320 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.879+0000 7f3d5f7fe640 1 -- 172.21.15.16:0/2898742417 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48048070 con 0x7f3d60073320 2024-05-11T01:01:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7f3d65ac2640 1 -- 172.21.15.16:0/2898742417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60073320 msgr2=0x7f3d60073790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7ff669ffb640 1 -- 172.21.15.16:0/4243908070 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660037070 con 0x7ff66c06caf0 2024-05-11T01:01:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7f2035dda640 1 Processor -- start 2024-05-11T01:01:19.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.880+0000 7f2035dda640 1 -- start start 2024-05-11T01:01:19.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f3d65ac2640 1 --2- 172.21.15.16:0/2898742417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60073320 0x7f3d60073790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d48010b90 tx=0x7f3d4802a340 comp rx=0 tx=0).stop 2024-05-11T01:01:19.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7ff669ffb640 1 -- 172.21.15.16:0/4243908070 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff660032440 con 0x7ff66c06caf0 2024-05-11T01:01:19.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f3d65ac2640 1 -- 172.21.15.16:0/2898742417 shutdown_connections 2024-05-11T01:01:19.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f3d65ac2640 1 --2- 172.21.15.16:0/2898742417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d60073320 0x7f3d60073790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f3d65ac2640 1 --2- 172.21.15.16:0/2898742417 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60145250 0x7f3d600d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7ff669ffb640 1 -- 172.21.15.16:0/4243908070 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660037070 con 0x7ff66c06caf0 2024-05-11T01:01:19.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f3d65ac2640 1 -- 172.21.15.16:0/2898742417 >> 172.21.15.16:0/2898742417 conn(0x7f3d6006d4f0 msgr2=0x7f3d6006d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f0fbabd4640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa0004160 0x7f0fa000ba40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40521a0 tx=0x7f0fa0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c591fe9cd1a638f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f0ff3247640 1 Processor -- start 2024-05-11T01:01:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40b4070 con 0x7f0fa0004160 2024-05-11T01:01:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb406a740 con 0x7f0fa0004160 2024-05-11T01:01:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f0fb93d1640 1 -- 172.21.15.16:0/653322354 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40a7da0 con 0x7f0fa0004160 2024-05-11T01:01:19.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f3d65ac2640 1 -- 172.21.15.16:0/2898742417 shutdown_connections 2024-05-11T01:01:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7ff66bfff640 1 -- 172.21.15.16:0/4243908070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c06caf0 msgr2=0x7ff66c06f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7ff66bfff640 1 --2- 172.21.15.16:0/4243908070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c06caf0 0x7ff66c06f2a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff660009870 tx=0x7ff66002a130 comp rx=0 tx=0).stop 2024-05-11T01:01:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f8aee72e640 1 Processor -- start 2024-05-11T01:01:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f3d65ac2640 1 -- 172.21.15.16:0/2898742417 wait complete. 2024-05-11T01:01:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f2035dda640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2030164ac0 0x7f203006e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f2035dda640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f203006e6b0 0x7f20300b4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f2035dda640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f203006ead0 con 0x7f20301646e0 2024-05-11T01:01:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f2035dda640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f20300b4f30 con 0x7f2030164ac0 2024-05-11T01:01:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f2035dda640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f2030072920 con 0x7f203006e6b0 2024-05-11T01:01:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa0004160 msgr2=0x7f0fa000ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f8aee72e640 1 -- start start 2024-05-11T01:01:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f0fbb3d5640 1 --2- 172.21.15.16:0/653322354 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fa0004160 0x7f0fa000ba40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40521a0 tx=0x7f0fa0005830 comp rx=0 tx=0).stop 2024-05-11T01:01:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7ff66bfff640 1 -- 172.21.15.16:0/4243908070 shutdown_connections 2024-05-11T01:01:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7ff66bfff640 1 --2- 172.21.15.16:0/4243908070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c06caf0 0x7ff66c06f2a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7ff66bfff640 1 --2- 172.21.15.16:0/4243908070 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c163a70 0x7ff66c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7ff66bfff640 1 -- 172.21.15.16:0/4243908070 >> 172.21.15.16:0/4243908070 conn(0x7ff66c0d1e70 msgr2=0x7ff66c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7ff66bfff640 1 -- 172.21.15.16:0/4243908070 shutdown_connections 2024-05-11T01:01:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f0fbabd4640 1 -- 172.21.15.16:0/653322354 reap_dead start 2024-05-11T01:01:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f202f7fe640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f20301646e0 0x7f20300736e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:47208/0 (socket says 172.21.15.16:47208) 2024-05-11T01:01:19.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f202f7fe640 1 -- 172.21.15.16:0/3755521387 learned_addr learned my addr 172.21.15.16:0/3755521387 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/653322354 shutdown_connections 2024-05-11T01:01:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/653322354 >> 172.21.15.16:0/653322354 conn(0x7f0fac01ef30 msgr2=0x7f0fac055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.881+0000 7f0ff3247640 1 -- start start 2024-05-11T01:01:19.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202ffff640 1 --2- 172.21.15.16:0/3755521387 >> v2:172.21.15.174:3300/0 conn(0x7f203006e6b0 0x7f20300b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7fe220dda640 1 Processor -- start 2024-05-11T01:01:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.882+0000 7f0ff3247640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0fec073350 0x7f0fec073aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0ff3247640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0fec073fe0 0x7f0fec06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0ff3247640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fec0722b0 con 0x7f0fec1559b0 2024-05-11T01:01:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0ff3247640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0fec155d90 con 0x7f0fec073350 2024-05-11T01:01:19.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0ff3247640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f0fec074430 con 0x7f0fec073fe0 2024-05-11T01:01:19.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7ff66bfff640 1 -- 172.21.15.16:0/4243908070 wait complete. 2024-05-11T01:01:19.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202effd640 1 --2- 172.21.15.16:0/3755521387 >> v2:172.21.15.16:3300/0 conn(0x7f2030164ac0 0x7f203006e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498343946 0 0) 0x7f203006ead0 con 0x7f20301646e0 2024-05-11T01:01:19.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f201c003520 con 0x7f20301646e0 2024-05-11T01:01:19.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/653322354 shutdown_connections 2024-05-11T01:01:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3024791319 0 0) 0x7f201c003520 con 0x7f20301646e0 2024-05-11T01:01:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 >> v2:172.21.15.174:3300/0 conn(0x7f203006e6b0 msgr2=0x7f20300b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202e7fc640 1 --2- 172.21.15.16:0/3755521387 >> v2:172.21.15.174:3300/0 conn(0x7f203006e6b0 0x7f20300b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 >> v2:172.21.15.16:3300/0 conn(0x7f2030164ac0 msgr2=0x7f203006e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f202e7fc640 1 --2- 172.21.15.16:0/3755521387 >> v2:172.21.15.16:3300/0 conn(0x7f2030164ac0 0x7f203006e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2030072c00 con 0x7f20301646e0 2024-05-11T01:01:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f20180016f0 con 0x7f20301646e0 2024-05-11T01:01:19.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 >> v1:172.21.15.174:6789/0 conn(0x7f20301646e0 legacy=0x7f20300736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f8aee72e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae00ead00 0x7f8ae004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f8aee72e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ae004ffd0 0x7f8ae0037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f8aee72e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae0053720 con 0x7f8ae0038110 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f8aee72e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae0054330 con 0x7f8ae004ffd0 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f8aee72e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae0053a00 con 0x7f8ae00ead00 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f8aecf2b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ae004ffd0 0x7f8ae0037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f8aedf2d640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f8ae0038110 0x7f8ae00385a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:47232/0 (socket says 172.21.15.16:47232) 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f8aedf2d640 1 -- 172.21.15.16:0/45036230 learned_addr learned my addr 172.21.15.16:0/45036230 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:19.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7fe220dda640 1 -- start start 2024-05-11T01:01:19.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f3d65ac2640 1 Processor -- start 2024-05-11T01:01:19.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c003a50 0x7f201c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f201c004800 0x7f201c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f201c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f20300b4f30 con 0x7f201c003a50 2024-05-11T01:01:19.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2030072920 con 0x7f201c0051c0 2024-05-11T01:01:19.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f201c00c060 con 0x7f201c004800 2024-05-11T01:01:19.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f202ffff640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f201c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f3d65ac2640 1 -- start start 2024-05-11T01:01:19.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/653322354 wait complete. 2024-05-11T01:01:19.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f8aed72c640 1 --2- 172.21.15.16:0/45036230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae00ead00 0x7f8ae004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f8adffff640 1 -- 172.21.15.16:0/45036230 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487032616 0 0) 0x7f8ae0053720 con 0x7f8ae0038110 2024-05-11T01:01:19.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f202f7fe640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c003a50 0x7f201c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f202effd640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f201c004800 0x7f201c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f202ffff640 1 -- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f201c004800 msgr2=0x7f201c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f202ffff640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f201c004800 0x7f201c004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f202ffff640 1 -- 172.21.15.16:0/3755521387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c003a50 msgr2=0x7f201c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f202ffff640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c003a50 0x7f201c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f202ffff640 1 -- 172.21.15.16:0/3755521387 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c003520 con 0x7f201c0051c0 2024-05-11T01:01:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f8adffff640 1 -- 172.21.15.16:0/45036230 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad4003520 con 0x7f8ae0038110 2024-05-11T01:01:19.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f0fbb3d5640 1 Processor -- start 2024-05-11T01:01:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7fe220dda640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe21c0b7440 0x7fe21c164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7fe220dda640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c167630 con 0x7fe21c164240 2024-05-11T01:01:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7fe220dda640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c0cfc80 con 0x7fe21c164620 2024-05-11T01:01:19.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7fe220dda640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe21c0d0240 con 0x7fe21c0b7440 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0ff0fe3640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0fec1559b0 0x7f0fec0b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:47222/0 (socket says 172.21.15.16:47222) 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0ff0fe3640 1 -- 172.21.15.16:0/3059959475 learned_addr learned my addr 172.21.15.16:0/3059959475 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0febfff640 1 --2- 172.21.15.16:0/3059959475 >> v2:172.21.15.16:3300/0 conn(0x7f0fec073350 0x7f0fec073aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.883+0000 7f0ff17e4640 1 --2- 172.21.15.16:0/3059959475 >> v2:172.21.15.174:3300/0 conn(0x7f0fec073fe0 0x7f0fec06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f0feb7fe640 1 -- 172.21.15.16:0/3059959475 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895841328 0 0) 0x7f0fec0722b0 con 0x7f0fec1559b0 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f0feb7fe640 1 -- 172.21.15.16:0/3059959475 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fd4003520 con 0x7f0fec1559b0 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f0ff17e4640 1 -- 172.21.15.16:0/3059959475 >> v2:172.21.15.16:3300/0 conn(0x7f0fec073350 msgr2=0x7f0fec073aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f0ff17e4640 1 --2- 172.21.15.16:0/3059959475 >> v2:172.21.15.16:3300/0 conn(0x7f0fec073350 0x7f0fec073aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f0ff17e4640 1 -- 172.21.15.16:0/3059959475 >> v1:172.21.15.174:6789/0 conn(0x7f0fec1559b0 legacy=0x7f0fec0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.884+0000 7f0ff17e4640 1 -- 172.21.15.16:0/3059959475 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fec072590 con 0x7f0fec073fe0 2024-05-11T01:01:19.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7fe21a59c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe21c164240 0x7fe21c167df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48812/0 (socket says 172.21.15.16:48812) 2024-05-11T01:01:19.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7fe21a59c640 1 -- 172.21.15.16:0/3369820854 learned_addr learned my addr 172.21.15.16:0/3369820854 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:19.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f8aecf2b640 1 -- 172.21.15.16:0/45036230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae00ead00 msgr2=0x7f8ae004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f8aecf2b640 1 --2- 172.21.15.16:0/45036230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae00ead00 0x7f8ae004fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f8aecf2b640 1 -- 172.21.15.16:0/45036230 >> v1:172.21.15.174:6789/0 conn(0x7f8ae0038110 legacy=0x7f8ae00385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d65ac2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60073320 0x7f3d601426f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f8aecf2b640 1 -- 172.21.15.16:0/45036230 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae0053ce0 con 0x7f8ae004ffd0 2024-05-11T01:01:19.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d65ac2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d60145250 0x7f3d601407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7ff66bfff640 1 Processor -- start 2024-05-11T01:01:19.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d65ac2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d6015d220 0x7f3d60140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7ff66bfff640 1 -- start start 2024-05-11T01:01:19.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d65ac2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3d60145630 con 0x7f3d60145250 2024-05-11T01:01:19.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d65ac2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d600b5280 con 0x7f3d6015d220 2024-05-11T01:01:19.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f680227e640 1 Processor -- start 2024-05-11T01:01:19.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f680227e640 1 -- start start 2024-05-11T01:01:19.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d65ac2640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3d60160990 con 0x7f3d60073320 2024-05-11T01:01:19.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371470328 0 0) 0x7fe21c167630 con 0x7fe21c164240 2024-05-11T01:01:19.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d64ac0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60073320 0x7f3d601426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d64ac0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60073320 0x7f3d601426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57538/0 (socket says 172.21.15.16:57538) 2024-05-11T01:01:19.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f3d64ac0640 1 -- 172.21.15.16:0/3486685666 learned_addr learned my addr 172.21.15.16:0/3486685666 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff66c06caf0 0x7ff66c08ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe208003520 con 0x7fe21c164240 2024-05-11T01:01:19.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.885+0000 7f0fbb3d5640 1 -- start start 2024-05-11T01:01:19.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c0af2f0 0x7ff66c157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f0fbb3d5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa0004160 0x7f0fac04f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f3d652c1640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d6015d220 0x7f3d60140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c163a70 0x7ff66c1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66bfff640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c06f7e0 con 0x7ff66c163a70 2024-05-11T01:01:19.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66bfff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c0b5d70 con 0x7ff66c06caf0 2024-05-11T01:01:19.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66bfff640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c06f960 con 0x7ff66c0af2f0 2024-05-11T01:01:19.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f202ffff640 1 -- 172.21.15.16:0/3755521387 reap_dead start 2024-05-11T01:01:19.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f202ffff640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f201c00b9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f202000ba30 tx=0x7f201c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a4e36c6e0a57039 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020030070 con 0x7f201c0051c0 2024-05-11T01:01:19.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f202e7fc640 1 -- 172.21.15.16:0/3755521387 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202002ae50 con 0x7f201c0051c0 2024-05-11T01:01:19.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fbb3d5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fac178b30 0x7f0fac00bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fbb3d5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0dd420 0x7f0fac00c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f3d5ffff640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d60145250 0x7f3d601407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fb9bd2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fac178b30 0x7f0fac00bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fb9bd2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fac178b30 0x7f0fac00bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50344/0 (socket says 172.21.15.16:50344) 2024-05-11T01:01:19.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fbabd4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0dd420 0x7f0fac00c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fbabd4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0dd420 0x7f0fac00c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57560/0 (socket says 172.21.15.16:57560) 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fbabd4640 1 -- 172.21.15.16:0/553525985 learned_addr learned my addr 172.21.15.16:0/553525985 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac056b40 con 0x7f0fa0004160 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0fac0094a0 con 0x7f0fac178b30 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0fac0e4900 con 0x7f0fac0dd420 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f0fba3d3640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa0004160 0x7f0fac04f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66affd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff66c06caf0 0x7ff66c08ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66a7fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c0af2f0 0x7ff66c157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66affd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff66c06caf0 0x7ff66c08ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50334/0 (socket says 172.21.15.16:50334) 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66affd640 1 -- 172.21.15.16:0/2763367117 learned_addr learned my addr 172.21.15.16:0/2763367117 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7ff66b7fe640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c163a70 0x7ff66c1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2804077392 0 0) 0x7fe208003520 con 0x7fe21c164240 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 >> v2:172.21.15.16:3300/0 conn(0x7fe21c0b7440 msgr2=0x7fe21c164ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 --2- 172.21.15.16:0/3369820854 >> v2:172.21.15.16:3300/0 conn(0x7fe21c0b7440 0x7fe21c164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 >> v1:172.21.15.174:6789/0 conn(0x7fe21c164620 legacy=0x7fe21c0b6d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0cff60 con 0x7fe21c164240 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fe20c001a90 con 0x7fe21c164240 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 >> v1:172.21.15.16:6789/0 conn(0x7fe21c164240 legacy=0x7fe21c167df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe208003a50 0x7fe208003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe208004800 0x7fe208004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080053c0 0x7fe20800ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0d0240 con 0x7fe2080053c0 2024-05-11T01:01:19.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe20800c300 con 0x7fe208003a50 2024-05-11T01:01:19.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe20800c500 con 0x7fe208004800 2024-05-11T01:01:19.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f680227e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67fc0b33e0 0x7f67fc15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7fe21a59c640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe208003a50 0x7fe208003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7fe21ad9d640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080053c0 0x7fe20800ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f3d5ffff640 1 -- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60073320 msgr2=0x7f3d601426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f3d5ffff640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d60073320 0x7f3d601426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f3d5ffff640 1 -- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d6015d220 msgr2=0x7f3d60140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f3d5ffff640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d6015d220 0x7f3d60140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f3d5ffff640 1 -- 172.21.15.16:0/3486685666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d600b4690 con 0x7f3d60145250 2024-05-11T01:01:19.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7fe219d9b640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe208004800 0x7fe208004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.886+0000 7f0ff17e4640 1 --2- 172.21.15.16:0/3059959475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fec073fe0 0x7f0fec06deb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0d0d00 tx=0x7f0fe402a4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bcf02517806be3c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.887+0000 7f680227e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67fc15e010 0x7f67fc0cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f680227e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67fc142be0 con 0x7f67fc140260 2024-05-11T01:01:19.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f680227e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f67fc143510 con 0x7f67fc0b33e0 2024-05-11T01:01:19.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f680227e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc142ec0 con 0x7f67fc15e010 2024-05-11T01:01:19.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0fbabd4640 1 -- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fac178b30 msgr2=0x7f0fac00bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0fbabd4640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fac178b30 0x7f0fac00bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0fbabd4640 1 -- 172.21.15.16:0/553525985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa0004160 msgr2=0x7f0fac04f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0fbabd4640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fa0004160 0x7f0fac04f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0fbabd4640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fac050330 con 0x7f0fac0dd420 2024-05-11T01:01:19.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0feb7fe640 1 -- 172.21.15.16:0/3059959475 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4007740 con 0x7f0fec073fe0 2024-05-11T01:01:19.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0feb7fe640 1 -- 172.21.15.16:0/3059959475 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe40078e0 con 0x7f0fec073fe0 2024-05-11T01:01:19.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f67fb7fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67fc0b33e0 0x7f67fc15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f2035dda640 1 -- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 msgr2=0x7f201c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f8aecf2b640 1 --2- 172.21.15.16:0/45036230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae004ffd0 0x7f8ae0037bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40097a0 tx=0x7f8ae402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0db95901d403e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f2035dda640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f201c00b9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f202000ba30 tx=0x7f201c005830 comp rx=0 tx=0).stop 2024-05-11T01:01:19.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f2035dda640 1 -- 172.21.15.16:0/3755521387 shutdown_connections 2024-05-11T01:01:19.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f2035dda640 1 --2- 172.21.15.16:0/3755521387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f201c00b9c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f2035dda640 1 -- 172.21.15.16:0/3755521387 >> 172.21.15.16:0/3755521387 conn(0x7f20300d0f90 msgr2=0x7f20300d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f2035dda640 1 -- 172.21.15.16:0/3755521387 shutdown_connections 2024-05-11T01:01:19.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f3d5ffff640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d60145250 0x7f3d601407a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c410 tx=0x7f3d5000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f67fb7fe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67fc0b33e0 0x7f67fc15dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50362/0 (socket says 172.21.15.16:50362) 2024-05-11T01:01:19.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f67fb7fe640 1 -- 172.21.15.16:0/933679275 learned_addr learned my addr 172.21.15.16:0/933679275 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0feb7fe640 1 -- 172.21.15.16:0/3059959475 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4007cb0 con 0x7f0fec073fe0 2024-05-11T01:01:19.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0fbabd4640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0dd420 0x7f0fac00c200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4064020 tx=0x7f0fac0376e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f8adffff640 1 -- 172.21.15.16:0/45036230 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4037070 con 0x7f8ae004ffd0 2024-05-11T01:01:19.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f8adffff640 1 -- 172.21.15.16:0/45036230 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae4032440 con 0x7f8ae004ffd0 2024-05-11T01:01:19.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f8adffff640 1 -- 172.21.15.16:0/45036230 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4032810 con 0x7f8ae004ffd0 2024-05-11T01:01:19.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7fe21ad9d640 1 -- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe208004800 msgr2=0x7fe208004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7fe21ad9d640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe208004800 0x7fe208004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7fe21ad9d640 1 -- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe208003a50 msgr2=0x7fe208003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:19.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7ff66b7fe640 1 -- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c0af2f0 msgr2=0x7ff66c157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7ff66b7fe640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff66c0af2f0 0x7ff66c157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7ff66b7fe640 1 -- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff66c06caf0 msgr2=0x7ff66c08ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7ff66b7fe640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff66c06caf0 0x7ff66c08ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7ff66b7fe640 1 -- 172.21.15.16:0/2763367117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c1659f0 con 0x7ff66c163a70 2024-05-11T01:01:19.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40b4040 con 0x7f0fac0dd420 2024-05-11T01:01:19.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fac04eae0 con 0x7f0fac0dd420 2024-05-11T01:01:19.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f0fbb3d5640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fac04edc0 con 0x7f0fac0dd420 2024-05-11T01:01:19.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7ff66b7fe640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c163a70 0x7ff66c1583b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff660031000 tx=0x7ff6600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7fe21ad9d640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe208003a50 0x7fe208003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7fe21ad9d640 1 -- 172.21.15.16:0/3369820854 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe208003520 con 0x7fe2080053c0 2024-05-11T01:01:19.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7fe21a59c640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe208003a50 0x7fe208003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:19.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f3d5d7fa640 1 -- 172.21.15.16:0/3486685666 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d500074e0 con 0x7f3d60145250 2024-05-11T01:01:19.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff660037040 con 0x7ff66c163a70 2024-05-11T01:01:19.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff660042070 con 0x7ff66c163a70 2024-05-11T01:01:19.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6600327f0 con 0x7ff66c163a70 2024-05-11T01:01:19.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f3d65ac2640 1 -- 172.21.15.16:0/3486685666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d600b5d70 con 0x7f3d60145250 2024-05-11T01:01:19.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f0ff3247640 1 -- 172.21.15.16:0/3059959475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fec073fe0 msgr2=0x7f0fec06deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f0ff3247640 1 --2- 172.21.15.16:0/3059959475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fec073fe0 0x7f0fec06deb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0d0d00 tx=0x7f0fe402a4b0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f3d65ac2640 1 -- 172.21.15.16:0/3486685666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d60142c30 con 0x7f3d60145250 2024-05-11T01:01:19.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f8aee72e640 1 -- 172.21.15.16:0/45036230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae004ffd0 msgr2=0x7f8ae0037bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f8aee72e640 1 --2- 172.21.15.16:0/45036230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae004ffd0 0x7f8ae0037bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40097a0 tx=0x7f8ae402a180 comp rx=0 tx=0).stop 2024-05-11T01:01:19.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f8aee72e640 1 -- 172.21.15.16:0/45036230 shutdown_connections 2024-05-11T01:01:19.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f8aee72e640 1 --2- 172.21.15.16:0/45036230 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae004ffd0 0x7f8ae0037bd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f67fb7fe640 1 -- 172.21.15.16:0/933679275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67fc15e010 msgr2=0x7f67fc0cfa80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-11T01:01:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f67fb7fe640 1 --2- 172.21.15.16:0/933679275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67fc15e010 0x7f67fc0cfa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f67fb7fe640 1 -- 172.21.15.16:0/933679275 >> v1:172.21.15.174:6789/0 conn(0x7f67fc140260 legacy=0x7f67fc0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f67fb7fe640 1 -- 172.21.15.16:0/933679275 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc1431a0 con 0x7f67fc0b33e0 2024-05-11T01:01:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f8aee72e640 1 --2- 172.21.15.16:0/45036230 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae00ead00 0x7f8ae004fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7fe21ad9d640 1 -- 172.21.15.16:0/3369820854 reap_dead start 2024-05-11T01:01:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.888+0000 7f2035dda640 1 -- 172.21.15.16:0/3755521387 wait complete. 2024-05-11T01:01:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.889+0000 7f8aee72e640 1 -- 172.21.15.16:0/45036230 >> 172.21.15.16:0/45036230 conn(0x7f8ae0009fb0 msgr2=0x7f8ae000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f8aee72e640 1 -- 172.21.15.16:0/45036230 shutdown_connections 2024-05-11T01:01:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f8aee72e640 1 -- 172.21.15.16:0/45036230 wait complete. 2024-05-11T01:01:19.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66c164e70 con 0x7ff66c163a70 2024-05-11T01:01:19.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7fe21ad9d640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080053c0 0x7fe20800ba20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe21c165010 tx=0x7fe208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175f4623826eca63 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66c165430 con 0x7ff66c163a70 2024-05-11T01:01:19.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f2035dda640 1 Processor -- start 2024-05-11T01:01:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0ff3247640 1 -- 172.21.15.16:0/3059959475 shutdown_connections 2024-05-11T01:01:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0ff3247640 1 --2- 172.21.15.16:0/3059959475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fec073fe0 0x7f0fec06deb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0ff3247640 1 --2- 172.21.15.16:0/3059959475 >> v2:172.21.15.16:3300/0 conn(0x7f0fec073350 0x7f0fec073aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0ff3247640 1 -- 172.21.15.16:0/3059959475 >> 172.21.15.16:0/3059959475 conn(0x7f0fec06c5c0 msgr2=0x7f0fec06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0ff3247640 1 -- 172.21.15.16:0/3059959475 shutdown_connections 2024-05-11T01:01:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0ff3247640 1 -- 172.21.15.16:0/3059959475 wait complete. 2024-05-11T01:01:19.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f2035dda640 1 -- start start 2024-05-11T01:01:19.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.891+0000 7f67fb7fe640 1 --2- 172.21.15.16:0/933679275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 0x7f67fc15dad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009870 tx=0x7f67e402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f6f489c0886be6 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb4076a40 con 0x7f0fac0dd420 2024-05-11T01:01:19.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40af940 con 0x7f0fac0dd420 2024-05-11T01:01:19.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f90001030 con 0x7f0fac0dd420 2024-05-11T01:01:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f3d5d7fa640 1 -- 172.21.15.16:0/3486685666 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d500047e0 con 0x7f3d60145250 2024-05-11T01:01:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.890+0000 7f3d5d7fa640 1 -- 172.21.15.16:0/3486685666 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50004bd0 con 0x7f3d60145250 2024-05-11T01:01:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.891+0000 7f8aee72e640 1 Processor -- start 2024-05-11T01:01:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f2035dda640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f20300c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f2035dda640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2030201990 0x7f20302057b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f2035dda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2030161c10 0x7f20300cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f2035dda640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f203006e170 con 0x7f2030161c10 2024-05-11T01:01:19.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f2035dda640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f20300731c0 con 0x7f201c0051c0 2024-05-11T01:01:19.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f2035dda640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f203006e2f0 con 0x7f2030201990 2024-05-11T01:01:19.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f3d5d7fa640 1 -- 172.21.15.16:0/3486685666 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d5001d3f0 con 0x7f3d60145250 2024-05-11T01:01:19.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff66c0507f0 con 0x7ff66c163a70 2024-05-11T01:01:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f0ff3247640 1 Processor -- start 2024-05-11T01:01:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.891+0000 7f8aee72e640 1 -- start start 2024-05-11T01:01:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.891+0000 7f67faffd640 1 -- 172.21.15.16:0/933679275 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4037070 con 0x7f67fc0b33e0 2024-05-11T01:01:19.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f67faffd640 1 -- 172.21.15.16:0/933679275 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e402ad90 con 0x7f67fc0b33e0 2024-05-11T01:01:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f0ff3247640 1 -- start start 2024-05-11T01:01:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fb40afae0 con 0x7f0fac0dd420 2024-05-11T01:01:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c00a450 con 0x7fe2080053c0 2024-05-11T01:01:19.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.892+0000 7f67faffd640 1 -- 172.21.15.16:0/933679275 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e4032660 con 0x7f67fc0b33e0 2024-05-11T01:01:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe214004240 con 0x7fe2080053c0 2024-05-11T01:01:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202effd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2030201990 0x7f20302057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2030161c10 0x7f20300cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f20300c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202f7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f20300c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50372/0 (socket says 172.21.15.16:50372) 2024-05-11T01:01:19.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2030161c10 0x7f20300cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40054/0 (socket says 172.21.15.16:40054) 2024-05-11T01:01:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202f7fe640 1 -- 172.21.15.16:0/2937021272 learned_addr learned my addr 172.21.15.16:0/2937021272 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202effd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2030201990 0x7f20302057b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57582/0 (socket says 172.21.15.16:57582) 2024-05-11T01:01:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f3d5d7fa640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3d400763a0 0x7f3d40078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f3d64ac0640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3d400763a0 0x7f3d40078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f3d5d7fa640 1 -- 172.21.15.16:0/3486685666 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3d50096f90 con 0x7f3d60145250 2024-05-11T01:01:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f3d65ac2640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7f3d44001650 0x7f3d44003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f3d65ac2640 1 -- 172.21.15.16:0/3486685666 --> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d44006bb0 con 0x7f3d44001650 2024-05-11T01:01:19.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f3d64ac0640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3d400763a0 0x7f3d40078860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009a40 tx=0x7f3d5800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0faaffd640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0f98076340 0x7f0f98078800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0fba3d3640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0f98076340 0x7f0f98078800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff660032990 con 0x7ff66c163a70 2024-05-11T01:01:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7fe21959a640 1 -- 172.21.15.16:0/3369820854 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214009460 con 0x7fe2080053c0 2024-05-11T01:01:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7fe220dda640 1 -- 172.21.15.16:0/3369820854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080053c0 msgr2=0x7fe20800ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7fe220dda640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080053c0 0x7fe20800ba20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe21c165010 tx=0x7fe208005830 comp rx=0 tx=0).stop 2024-05-11T01:01:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0ff3247640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fec073350 0x7f0fec147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0ff3247640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fec073fe0 0x7f0fec1e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0ff3247640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fec1559b0 0x7f0fec06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aee72e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae0038110 0x7f8ae0047150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aee72e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae004ffd0 0x7f8ae0043680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aee72e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae00ead00 0x7f8ae00df220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aee72e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae00547c0 con 0x7f8ae004ffd0 2024-05-11T01:01:19.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aee72e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae0038cb0 con 0x7f8ae00ead00 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aee72e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae0054940 con 0x7f8ae0038110 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aed72c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae0038110 0x7f8ae0047150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aed72c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae0038110 0x7f8ae0047150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57592/0 (socket says 172.21.15.16:57592) 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aed72c640 1 -- 172.21.15.16:0/3368089695 learned_addr learned my addr 172.21.15.16:0/3368089695 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f8aedf2d640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae00ead00 0x7f8ae00df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f680227e640 1 -- 172.21.15.16:0/933679275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 msgr2=0x7f67fc15dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f680227e640 1 --2- 172.21.15.16:0/933679275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 0x7f67fc15dad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009870 tx=0x7f67e402a100 comp rx=0 tx=0).stop 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f680227e640 1 -- 172.21.15.16:0/933679275 shutdown_connections 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f680227e640 1 --2- 172.21.15.16:0/933679275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67fc15e010 0x7f67fc0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f680227e640 1 --2- 172.21.15.16:0/933679275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 0x7f67fc15dad0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f680227e640 1 -- 172.21.15.16:0/933679275 >> 172.21.15.16:0/933679275 conn(0x7f67fc06fce0 msgr2=0x7f67fc06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f680227e640 1 -- 172.21.15.16:0/933679275 shutdown_connections 2024-05-11T01:01:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7ff6537fe640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff6580763a0 0x7ff658078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f8aed72c640 1 -- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae00ead00 msgr2=0x7f8ae00df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f8aed72c640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ae00ead00 0x7f8ae00df220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f8aed72c640 1 -- 172.21.15.16:0/3368089695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae004ffd0 msgr2=0x7f8ae0043680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f8aed72c640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ae004ffd0 0x7f8ae0043680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f8aed72c640 1 -- 172.21.15.16:0/3368089695 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae00df760 con 0x7f8ae0038110 2024-05-11T01:01:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f8aed72c640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae0038110 0x7f8ae0047150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800e870 tx=0x7f8ad800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.893+0000 7f680227e640 1 -- 172.21.15.16:0/933679275 wait complete. 2024-05-11T01:01:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0ff3247640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec072b50 con 0x7f0fec1559b0 2024-05-11T01:01:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0ff3247640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0fec072ec0 con 0x7f0fec073350 2024-05-11T01:01:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0ff3247640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0fec0b4120 con 0x7f0fec073fe0 2024-05-11T01:01:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0ff17e4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fec1559b0 0x7f0fec06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0febfff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fec073fe0 0x7f0fec1e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0febfff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fec073fe0 0x7f0fec1e8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57602/0 (socket says 172.21.15.16:57602) 2024-05-11T01:01:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0febfff640 1 -- 172.21.15.16:0/2075064376 learned_addr learned my addr 172.21.15.16:0/2075064376 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202effd640 1 -- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 msgr2=0x7f20300c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202effd640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f201c0051c0 0x7f20300c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202effd640 1 -- 172.21.15.16:0/2937021272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2030161c10 msgr2=0x7f20300cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202effd640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2030161c10 0x7f20300cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0fb4132eb0 con 0x7f0fac0dd420 2024-05-11T01:01:19.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f202effd640 1 -- 172.21.15.16:0/2937021272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20302021d0 con 0x7f2030201990 2024-05-11T01:01:19.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff6600b7d40 con 0x7ff66c163a70 2024-05-11T01:01:19.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f3d652c1640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7f3d44001650 0x7f3d44003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.894+0000 7f0fba3d3640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0f98076340 0x7f0f98078800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0000c00 tx=0x7f0fb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7ff6537fe640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7ff65807e5c0 0x7ff6580809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0faaffd640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f0f9807e5c0 0x7f0f980809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f202effd640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2030201990 0x7f20302057b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2028007f50 tx=0x7f202800f560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0febfff640 1 -- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fec073350 msgr2=0x7f0fec147610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-11T01:01:19.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0febfff640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fec073350 0x7f0fec147610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0febfff640 1 -- 172.21.15.16:0/2075064376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fec1559b0 msgr2=0x7f0fec06deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0febfff640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fec1559b0 0x7f0fec06deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0febfff640 1 -- 172.21.15.16:0/2075064376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fec147b50 con 0x7f0fec073fe0 2024-05-11T01:01:19.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0fb9bd2640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f0f9807e5c0 0x7f0f980809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7fe220dda640 1 -- 172.21.15.16:0/3369820854 shutdown_connections 2024-05-11T01:01:19.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7fe220dda640 1 --2- 172.21.15.16:0/3369820854 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080053c0 0x7fe20800ba20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7fe220dda640 1 -- 172.21.15.16:0/3369820854 >> 172.21.15.16:0/3369820854 conn(0x7fe21c0741a0 msgr2=0x7fe21c0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8017070 con 0x7f8ae0038110 2024-05-11T01:01:19.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad800c940 con 0x7f8ae0038110 2024-05-11T01:01:19.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad800cd30 con 0x7f8ae0038110 2024-05-11T01:01:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 --> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff66002be50 con 0x7ff65807e5c0 2024-05-11T01:01:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff6600bc030 con 0x7ff66c163a70 2024-05-11T01:01:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0febfff640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fec073fe0 0x7f0fec1e8b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000d800 tx=0x7f0fe000dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202801c070 con 0x7f2030201990 2024-05-11T01:01:19.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2028017600 con 0x7f2030201990 2024-05-11T01:01:19.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7ff66a7fc640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7ff65807e5c0 0x7ff6580809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202800fea0 con 0x7f2030201990 2024-05-11T01:01:19.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20302024b0 con 0x7f2030201990 2024-05-11T01:01:19.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2030204fb0 con 0x7f2030201990 2024-05-11T01:01:19.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f3d652c1640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7f3d44001650 0x7f3d44003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae0043dd0 con 0x7f8ae0038110 2024-05-11T01:01:19.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7f0fb9bd2640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f0f9807e5c0 0x7f0f980809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fb406a740 con 0x7f0f9807e5c0 2024-05-11T01:01:19.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0fb4135510 con 0x7f0fac0dd420 2024-05-11T01:01:19.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000b6c0 con 0x7f0fec073fe0 2024-05-11T01:01:19.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe0019070 con 0x7f0fec073fe0 2024-05-11T01:01:19.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000ba80 con 0x7f0fec073fe0 2024-05-11T01:01:19.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7f0ff3247640 1 -- 172.21.15.16:0/2075064376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fec1e9380 con 0x7f0fec073fe0 2024-05-11T01:01:19.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7f0ff3247640 1 -- 172.21.15.16:0/2075064376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fec1e9940 con 0x7f0fec073fe0 2024-05-11T01:01:19.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f680227e640 1 Processor -- start 2024-05-11T01:01:19.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f680227e640 1 -- start start 2024-05-11T01:01:19.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7fe220dda640 1 -- 172.21.15.16:0/3369820854 shutdown_connections 2024-05-11T01:01:19.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.895+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae0044390 con 0x7f8ae0038110 2024-05-11T01:01:19.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7f680227e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 0x7f67fc0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2014001030 con 0x7f2030201990 2024-05-11T01:01:19.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7ff66affd640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff6580763a0 0x7ff658078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f680227e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc140260 0x7f67fc0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.896+0000 7fe220dda640 1 -- 172.21.15.16:0/3369820854 wait complete. 2024-05-11T01:01:19.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f3d5d7fa640 1 -- 172.21.15.16:0/3486685666 <== osd.1 v2:172.21.15.16:6809/3113723574 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d44006bb0 con 0x7f3d44001650 2024-05-11T01:01:19.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ae0044a50 con 0x7f8ae0038110 2024-05-11T01:01:19.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f67fbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 0x7f67fc0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f67fbfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 0x7f67fc0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50412/0 (socket says 172.21.15.16:50412) 2024-05-11T01:01:19.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc140260 0x7f67fc0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f67fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc140260 0x7f67fc0b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40102/0 (socket says 172.21.15.16:40102) 2024-05-11T01:01:19.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f680227e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67fc15e010 0x7f67fc0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7ff66a7fc640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7ff65807e5c0 0x7ff6580809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f67fbfff640 1 -- 172.21.15.16:0/1937007470 learned_addr learned my addr 172.21.15.16:0/1937007470 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f680227e640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc0cffc0 con 0x7f67fc140260 2024-05-11T01:01:19.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f680227e640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc15e4c0 con 0x7f67fc0b33e0 2024-05-11T01:01:19.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f680227e640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc0d0140 con 0x7f67fc15e010 2024-05-11T01:01:19.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f680081b640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67fc15e010 0x7f67fc0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 <== osd.2 v2:172.21.15.16:6808/800114890 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0fb406a740 con 0x7f0f9807e5c0 2024-05-11T01:01:19.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 <== osd.3 v2:172.21.15.16:6824/142472944 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff66002be50 con 0x7ff65807e5c0 2024-05-11T01:01:19.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.897+0000 7f0ff3247640 1 -- 172.21.15.16:0/2075064376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0fec1e4ca0 con 0x7f0fec073fe0 2024-05-11T01:01:19.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ad801a070 con 0x7f8ae0038110 2024-05-11T01:01:19.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7f67fbfff640 1 -- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67fc15e010 msgr2=0x7f67fc0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7fe220dda640 1 Processor -- start 2024-05-11T01:01:19.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7f67fbfff640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67fc15e010 0x7f67fc0b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7f67fbfff640 1 -- 172.21.15.16:0/1937007470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc140260 msgr2=0x7f67fc0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7f67fbfff640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc140260 0x7f67fc0b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7f67fbfff640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc15eb70 con 0x7f67fc0b33e0 2024-05-11T01:01:19.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.898+0000 7f67fb7fe640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc140260 0x7f67fc0b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:19.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f67fbfff640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 0x7f67fc0735d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c760 tx=0x7f67f400cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7fe220dda640 1 -- start start 2024-05-11T01:01:19.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f8addffb640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8acc0763d0 0x7f8acc078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8ad80973e0 con 0x7f8ae0038110 2024-05-11T01:01:19.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4017070 con 0x7f67fc0b33e0 2024-05-11T01:01:19.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f8addffb640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f8acc07e570 0x7f8acc080990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2028005d10 con 0x7f2030201990 2024-05-11T01:01:19.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f8aecf2b640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8acc0763d0 0x7f8acc078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fe000bc20 con 0x7f0fec073fe0 2024-05-11T01:01:19.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.900+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 --> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8acc081040 con 0x7f8acc07e570 2024-05-11T01:01:19.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.900+0000 7f8aedf2d640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f8acc07e570 0x7f8acc080990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.900+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8ad809e050 con 0x7f8ae0038110 2024-05-11T01:01:19.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.900+0000 7f8aecf2b640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8acc0763d0 0x7f8acc078890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4034000 tx=0x7f8ae402c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f680227e640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc15ee70 con 0x7f67fc0b33e0 2024-05-11T01:01:19.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.899+0000 7f680227e640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc15f6b0 con 0x7f67fc0b33e0 2024-05-11T01:01:19.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.900+0000 7fe220dda640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2080053c0 0x7fe21c157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f4005270 con 0x7f67fc0b33e0 2024-05-11T01:01:19.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe220dda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe21c0ceea0 0x7fe21c14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f8aedf2d640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f8acc07e570 0x7f8acc080990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.900+0000 7f2027fff640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f20100762d0 0x7f2010078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.900+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f20280983c0 con 0x7f2030201990 2024-05-11T01:01:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f2027fff640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f201007e470 0x7f2010080890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f202f7fe640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f20100762d0 0x7f2010078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 --> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2010080f40 con 0x7f201007e470 2024-05-11T01:01:19.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2028098850 con 0x7f2030201990 2024-05-11T01:01:19.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe21a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2080053c0 0x7fe21c157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe21a59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2080053c0 0x7fe21c157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50420/0 (socket says 172.21.15.16:50420) 2024-05-11T01:01:19.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe21a59c640 1 -- 172.21.15.16:0/1797389632 learned_addr learned my addr 172.21.15.16:0/1797389632 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:19.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f202ffff640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f201007e470 0x7f2010080890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe220dda640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe21c14ca00 0x7fe21c0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0cf900 con 0x7fe21c0ceea0 2024-05-11T01:01:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f0fe97fa640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd80763a0 0x7f0fd8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0fe0097ab0 con 0x7f0fec073fe0 2024-05-11T01:01:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f0ff0fe3640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd80763a0 0x7f0fd8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f0fe97fa640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f0fd807e620 0x7f0fd8080a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 --> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0fd80810f0 con 0x7f0fd807e620 2024-05-11T01:01:19.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0fe009c2a0 con 0x7f0fec073fe0 2024-05-11T01:01:19.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe21ad9d640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe21c14ca00 0x7fe21c0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0d2bc0 con 0x7fe2080053c0 2024-05-11T01:01:19.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c164ad0 con 0x7fe21c14ca00 2024-05-11T01:01:19.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7ff66affd640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff6580763a0 0x7ff658078860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff65c003b80 tx=0x7ff65c0098d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7f202ffff640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f201007e470 0x7f2010080890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7f0ff17e4640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f0fd807e620 0x7f0fd8080a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f400a640 con 0x7f67fc0b33e0 2024-05-11T01:01:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.901+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67e0001030 con 0x7f67fc0b33e0 2024-05-11T01:01:19.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7f202f7fe640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f20100762d0 0x7f2010078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2018001860 tx=0x7f20180016c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7fe219d9b640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe21c0ceea0 0x7fe21c14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7fe21a59c640 1 -- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe21c14ca00 msgr2=0x7fe21c0caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7fe21a59c640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe21c14ca00 0x7fe21c0caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7fe21a59c640 1 -- 172.21.15.16:0/1797389632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe21c0ceea0 msgr2=0x7fe21c14c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 <== osd.6 v2:172.21.15.174:6816/3065840134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8acc081040 con 0x7f8acc07e570 2024-05-11T01:01:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f67f401a070 con 0x7f67fc0b33e0 2024-05-11T01:01:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7fe21a59c640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe21c0ceea0 0x7fe21c14c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7fe21a59c640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0c9ed0 con 0x7fe2080053c0 2024-05-11T01:01:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7fe219d9b640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe21c0ceea0 0x7fe21c14c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:19.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.902+0000 7f0ff0fe3640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd80763a0 0x7f0fd8078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc007fd0 tx=0x7f0fdc007960 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.903+0000 7fe21a59c640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2080053c0 0x7fe21c157e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe20c007a20 tx=0x7fe20c00a6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.903+0000 7f0ff17e4640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f0fd807e620 0x7f0fd8080a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.903+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c017020 con 0x7fe2080053c0 2024-05-11T01:01:19.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.903+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 <== osd.0 v2:172.21.15.16:6800/126374263 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2010080f40 con 0x7f201007e470 2024-05-11T01:01:19.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.903+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe20c0133f0 con 0x7fe2080053c0 2024-05-11T01:01:19.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.903+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c0ca1b0 con 0x7fe2080053c0 2024-05-11T01:01:19.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.903+0000 7f67f8ff9640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f67dc076320 0x7f67dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.903+0000 7f67fb7fe640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f67dc076320 0x7f67dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.904+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67f4096990 con 0x7f67fc0b33e0 2024-05-11T01:01:19.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.904+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 <== osd.5 v2:172.21.15.174:6817/3546567206 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0fd80810f0 con 0x7f0fd807e620 2024-05-11T01:01:19.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.904+0000 7f67fb7fe640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f67dc076320 0x7f67dc0787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67e4034000 tx=0x7f67e402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.904+0000 7f67f8ff9640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f67dc07e540 0x7f67dc080960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.904+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c0ca770 con 0x7fe2080053c0 2024-05-11T01:01:19.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.904+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67f401ee50 con 0x7f67dc07e540 2024-05-11T01:01:19.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.904+0000 7f680081b640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f67dc07e540 0x7f67dc080960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.905+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f67f409b2a0 con 0x7f67fc0b33e0 2024-05-11T01:01:19.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.905+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0137c0 con 0x7fe2080053c0 2024-05-11T01:01:19.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.905+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe21c06a5b0 con 0x7fe2080053c0 2024-05-11T01:01:19.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.905+0000 7f680081b640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f67dc07e540 0x7f67dc080960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.906+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 <== osd.7 v2:172.21.15.174:6808/3689065409 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67f401ee50 con 0x7f67dc07e540 2024-05-11T01:01:19.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.906+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe20c01a020 con 0x7fe2080053c0 2024-05-11T01:01:19.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.907+0000 7fe212ffd640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe1fc0763a0 0x7fe1fc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.907+0000 7fe219d9b640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe1fc0763a0 0x7fe1fc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.908+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe20c098810 con 0x7fe2080053c0 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.908+0000 7fe219d9b640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe1fc0763a0 0x7fe1fc078860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe21c14d490 tx=0x7fe204008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.908+0000 7fe212ffd640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7fe1fc07e5c0 0x7fe1fc0809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.908+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe20c039e80 con 0x7fe1fc07e5c0 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.908+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe20c098c00 con 0x7fe2080053c0 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.910+0000 7fe21ad9d640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7fe1fc07e5c0 0x7fe1fc0809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.910+0000 7fe21ad9d640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7fe1fc07e5c0 0x7fe1fc0809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:19.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.911+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 <== osd.4 v2:172.21.15.174:6800/1586428458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe20c039e80 con 0x7fe1fc07e5c0 2024-05-11T01:01:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.930+0000 7f3d65ac2640 1 -- 172.21.15.16:0/3486685666 --> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d44005c40 con 0x7f3d44001650 2024-05-11T01:01:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.931+0000 7f3d5d7fa640 1 -- 172.21.15.16:0/3486685666 <== osd.1 v2:172.21.15.16:6809/3113723574 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d44005c40 con 0x7f3d44001650 2024-05-11T01:01:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.931+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 --> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff66c06c510 con 0x7ff65807e5c0 2024-05-11T01:01:19.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7ff6537fe640 1 -- 172.21.15.16:0/2763367117 <== osd.3 v2:172.21.15.16:6824/142472944 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff66c06c510 con 0x7ff65807e5c0 2024-05-11T01:01:19.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7f3d56ffd640 1 -- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7f3d44001650 msgr2=0x7f3d44003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7f3d56ffd640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7f3d44001650 0x7f3d44003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7f3d56ffd640 1 -- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3d400763a0 msgr2=0x7f3d40078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7f3d56ffd640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3d400763a0 0x7f3d40078860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3d58009a40 tx=0x7f3d5800b040 comp rx=0 tx=0).stop 2024-05-11T01:01:19.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7f3d56ffd640 1 -- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d60145250 msgr2=0x7f3d601407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7f3d56ffd640 1 --2- 172.21.15.16:0/3486685666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d60145250 0x7f3d601407a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c410 tx=0x7f3d5000c8d0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7f3d652c1640 1 -- 172.21.15.16:0/3486685666 reap_dead start 2024-05-11T01:01:19.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.932+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 --> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f90002dd0 con 0x7f0f9807e5c0 2024-05-11T01:01:19.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7f3d56ffd640 1 -- 172.21.15.16:0/3486685666 shutdown_connections 2024-05-11T01:01:19.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7f3d56ffd640 1 -- 172.21.15.16:0/3486685666 >> 172.21.15.16:0/3486685666 conn(0x7f3d6006d4f0 msgr2=0x7f3d6006faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7f3d56ffd640 1 -- 172.21.15.16:0/3486685666 shutdown_connections 2024-05-11T01:01:19.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7f3d56ffd640 1 -- 172.21.15.16:0/3486685666 wait complete. 2024-05-11T01:01:19.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7f0faaffd640 1 -- 172.21.15.16:0/553525985 <== osd.2 v2:172.21.15.16:6808/800114890 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0f90002dd0 con 0x7f0f9807e5c0 2024-05-11T01:01:19.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7ff65807e5c0 msgr2=0x7ff6580809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7ff65807e5c0 0x7ff6580809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff6580763a0 msgr2=0x7ff658078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff6580763a0 0x7ff658078860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff65c003b80 tx=0x7ff65c0098d0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c163a70 msgr2=0x7ff66c1583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 --2- 172.21.15.16:0/2763367117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff66c163a70 0x7ff66c1583b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff660031000 tx=0x7ff6600046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66b7fe640 1 -- 172.21.15.16:0/2763367117 reap_dead start 2024-05-11T01:01:19.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 shutdown_connections 2024-05-11T01:01:19.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 >> 172.21.15.16:0/2763367117 conn(0x7ff66c0d1e70 msgr2=0x7ff66c070000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 shutdown_connections 2024-05-11T01:01:19.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7ff66bfff640 1 -- 172.21.15.16:0/2763367117 wait complete. 2024-05-11T01:01:19.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f0f9807e5c0 msgr2=0x7f0f980809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.933+0000 7f0fa8ff9640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f0f9807e5c0 0x7f0f980809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.934+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0f98076340 msgr2=0x7f0f98078800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.934+0000 7f0fa8ff9640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0f98076340 0x7f0f98078800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0000c00 tx=0x7f0fb0009040 comp rx=0 tx=0).stop 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.934+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0dd420 msgr2=0x7f0fac00c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.934+0000 7f0fa8ff9640 1 --2- 172.21.15.16:0/553525985 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fac0dd420 0x7f0fac00c200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4064020 tx=0x7f0fac0376e0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.934+0000 7f0fbabd4640 1 -- 172.21.15.16:0/553525985 reap_dead start 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.934+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 shutdown_connections 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.934+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 >> 172.21.15.16:0/553525985 conn(0x7f0fac01ef30 msgr2=0x7f0fac0dd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.936+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 shutdown_connections 2024-05-11T01:01:19.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.936+0000 7f0fa8ff9640 1 -- 172.21.15.16:0/553525985 wait complete. 2024-05-11T01:01:19.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.936+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 --> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2014002d50 con 0x7f201007e470 2024-05-11T01:01:19.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.937+0000 7f2027fff640 1 -- 172.21.15.16:0/2937021272 <== osd.0 v2:172.21.15.16:6800/126374263 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2014002d50 con 0x7f201007e470 2024-05-11T01:01:19.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.937+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 --> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f67e0002dd0 con 0x7f67dc07e540 2024-05-11T01:01:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.937+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f201007e470 msgr2=0x7f2010080890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.937+0000 7f2035dda640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f201007e470 0x7f2010080890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f20100762d0 msgr2=0x7f2010078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f2035dda640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f20100762d0 0x7f2010078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2018001860 tx=0x7f20180016c0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f0ff3247640 1 -- 172.21.15.16:0/2075064376 --> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0fec09f120 con 0x7f0fd807e620 2024-05-11T01:01:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2030201990 msgr2=0x7f20302057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f2035dda640 1 --2- 172.21.15.16:0/2937021272 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2030201990 0x7f20302057b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2028007f50 tx=0x7f202800f560 comp rx=0 tx=0).stop 2024-05-11T01:01:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f202ffff640 1 -- 172.21.15.16:0/2937021272 reap_dead start 2024-05-11T01:01:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 shutdown_connections 2024-05-11T01:01:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 >> 172.21.15.16:0/2937021272 conn(0x7f20300d0f90 msgr2=0x7f20300cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 shutdown_connections 2024-05-11T01:01:19.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f67f8ff9640 1 -- 172.21.15.16:0/1937007470 <== osd.7 v2:172.21.15.174:6808/3689065409 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f67e0002dd0 con 0x7f67dc07e540 2024-05-11T01:01:19.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 --> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ae0048840 con 0x7f8acc07e570 2024-05-11T01:01:19.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f2035dda640 1 -- 172.21.15.16:0/2937021272 wait complete. 2024-05-11T01:01:19.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.938+0000 7f0fe97fa640 1 -- 172.21.15.16:0/2075064376 <== osd.5 v2:172.21.15.174:6817/3546567206 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0fec09f120 con 0x7f0fd807e620 2024-05-11T01:01:19.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f8addffb640 1 -- 172.21.15.16:0/3368089695 <== osd.6 v2:172.21.15.174:6816/3065840134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8ae0048840 con 0x7f8acc07e570 2024-05-11T01:01:19.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f67dc07e540 msgr2=0x7f67dc080960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f67dc07e540 0x7f67dc080960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f67dc076320 msgr2=0x7f67dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f67dc076320 0x7f67dc0787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f67e4034000 tx=0x7f67e402e000 comp rx=0 tx=0).stop 2024-05-11T01:01:19.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 msgr2=0x7f67fc0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 --2- 172.21.15.16:0/1937007470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67fc0b33e0 0x7f67fc0735d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c760 tx=0x7f67f400cc20 comp rx=0 tx=0).stop 2024-05-11T01:01:19.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f680081b640 1 -- 172.21.15.16:0/1937007470 reap_dead start 2024-05-11T01:01:19.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 shutdown_connections 2024-05-11T01:01:19.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 >> 172.21.15.16:0/1937007470 conn(0x7f67fc06fce0 msgr2=0x7f67fc152c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f8acc07e570 msgr2=0x7f8acc080990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f8aee72e640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f8acc07e570 0x7f8acc080990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 shutdown_connections 2024-05-11T01:01:19.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.939+0000 7f67f27fc640 1 -- 172.21.15.16:0/1937007470 wait complete. 2024-05-11T01:01:19.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8acc0763d0 msgr2=0x7f8acc078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f8aee72e640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8acc0763d0 0x7f8acc078890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4034000 tx=0x7f8ae402c000 comp rx=0 tx=0).stop 2024-05-11T01:01:19.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae0038110 msgr2=0x7f8ae0047150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f8aee72e640 1 --2- 172.21.15.16:0/3368089695 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ae0038110 0x7f8ae0047150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800e870 tx=0x7f8ad800ed30 comp rx=0 tx=0).stop 2024-05-11T01:01:19.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f8aedf2d640 1 -- 172.21.15.16:0/3368089695 reap_dead start 2024-05-11T01:01:19.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 shutdown_connections 2024-05-11T01:01:19.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 >> 172.21.15.16:0/3368089695 conn(0x7f8ae0009fb0 msgr2=0x7f8ae004a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f0fd2ffd640 1 -- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f0fd807e620 msgr2=0x7f0fd8080a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f0fd2ffd640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f0fd807e620 0x7f0fd8080a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f0fd2ffd640 1 -- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd80763a0 msgr2=0x7f0fd8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f0fd2ffd640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fd80763a0 0x7f0fd8078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc007fd0 tx=0x7f0fdc007960 comp rx=0 tx=0).stop 2024-05-11T01:01:19.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f0fd2ffd640 1 -- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fec073fe0 msgr2=0x7f0fec1e8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:19.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f0fd2ffd640 1 --2- 172.21.15.16:0/2075064376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fec073fe0 0x7f0fec1e8b30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fe000d800 tx=0x7f0fe000dcc0 comp rx=0 tx=0).stop 2024-05-11T01:01:19.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.940+0000 7f0ff17e4640 1 -- 172.21.15.16:0/2075064376 reap_dead start 2024-05-11T01:01:19.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.941+0000 7f0fd2ffd640 1 -- 172.21.15.16:0/2075064376 shutdown_connections 2024-05-11T01:01:19.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.941+0000 7f0fd2ffd640 1 -- 172.21.15.16:0/2075064376 >> 172.21.15.16:0/2075064376 conn(0x7f0fec06c5c0 msgr2=0x7f0fec15c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:19.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.941+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 shutdown_connections 2024-05-11T01:01:19.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.941+0000 7f8aee72e640 1 -- 172.21.15.16:0/3368089695 wait complete. 2024-05-11T01:01:19.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.943+0000 7f0fd2ffd640 1 -- 172.21.15.16:0/2075064376 shutdown_connections 2024-05-11T01:01:20.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.943+0000 7f0fd2ffd640 1 -- 172.21.15.16:0/2075064376 wait complete. 2024-05-11T01:01:20.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.943+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 --> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe21c0d1a70 con 0x7fe1fc07e5c0 2024-05-11T01:01:20.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.944+0000 7fe212ffd640 1 -- 172.21.15.16:0/1797389632 <== osd.4 v2:172.21.15.174:6800/1586428458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe21c0d1a70 con 0x7fe1fc07e5c0 2024-05-11T01:01:20.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.945+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7fe1fc07e5c0 msgr2=0x7fe1fc0809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.945+0000 7fe220dda640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7fe1fc07e5c0 0x7fe1fc0809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.945+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe1fc0763a0 msgr2=0x7fe1fc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.945+0000 7fe220dda640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe1fc0763a0 0x7fe1fc078860 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe21c14d490 tx=0x7fe204008040 comp rx=0 tx=0).stop 2024-05-11T01:01:20.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.946+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2080053c0 msgr2=0x7fe21c157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.946+0000 7fe220dda640 1 --2- 172.21.15.16:0/1797389632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2080053c0 0x7fe21c157e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe20c007a20 tx=0x7fe20c00a6e0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.947+0000 7fe21ad9d640 1 -- 172.21.15.16:0/1797389632 reap_dead start 2024-05-11T01:01:20.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.947+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 shutdown_connections 2024-05-11T01:01:20.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.947+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 >> 172.21.15.16:0/1797389632 conn(0x7fe21c0741a0 msgr2=0x7fe21c1664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.947+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 shutdown_connections 2024-05-11T01:01:20.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:19.947+0000 7fe220dda640 1 -- 172.21.15.16:0/1797389632 wait complete. 2024-05-11T01:01:20.002 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:20.003 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-11T01:01:20.004 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-11T01:01:20.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-11T01:01:20.005 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-11T01:01:20.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-11T01:01:20.006 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:20.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-11T01:01:20.006 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:20.007 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2024-05-11T01:01:20.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-11T01:01:20.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-11T01:01:20.009 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2024-05-11T01:01:20.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-11T01:01:20.010 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:20.010 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-11T01:01:20.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.223+0000 7fc985578640 1 Processor -- start 2024-05-11T01:01:20.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.222+0000 7fce1cc50640 1 Processor -- start 2024-05-11T01:01:20.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.222+0000 7fce1cc50640 1 -- start start 2024-05-11T01:01:20.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7fce1cc50640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce10006ae0 0x7fce10048f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7fce1cc50640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fce10049710 0x7fce10006ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7fce1cc50640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce10007400 con 0x7fce100543a0 2024-05-11T01:01:20.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7fce1cc50640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fce10048cb0 con 0x7fce10049710 2024-05-11T01:01:20.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7fce1cc50640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fce100538c0 con 0x7fce10006ae0 2024-05-11T01:01:20.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7fce16d9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fce100543a0 0x7fce10054830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48818/0 (socket says 172.21.15.16:48818) 2024-05-11T01:01:20.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.223+0000 7fc985578640 1 -- start start 2024-05-11T01:01:20.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7fce16d9d640 1 -- 172.21.15.16:0/946568834 learned_addr learned my addr 172.21.15.16:0/946568834 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:20.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fa20dcbd640 1 Processor -- start 2024-05-11T01:01:20.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7f8ddf286640 1 Processor -- start 2024-05-11T01:01:20.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7f8ddf286640 1 -- start start 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fc985578640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc978005e80 0x7fc9780062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fc985578640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc978006800 0x7fc978006c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fc985578640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc978053710 con 0x7fc9780eacf0 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fc985578640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc978054320 con 0x7fc978005e80 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fc985578640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc9780539f0 con 0x7fc978006800 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fc97effd640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc9780eacf0 0x7fc97804fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:47268/0 (socket says 172.21.15.16:47268) 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fc97effd640 1 -- 172.21.15.16:0/2364058810 learned_addr learned my addr 172.21.15.16:0/2364058810 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fc97f7fe640 1 --2- 172.21.15.16:0/2364058810 >> v2:172.21.15.174:3300/0 conn(0x7fc978006800 0x7fc978006c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fc97e7fc640 1 --2- 172.21.15.16:0/2364058810 >> v2:172.21.15.16:3300/0 conn(0x7fc978005e80 0x7fc9780062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7f8eb8fb0640 1 Processor -- start 2024-05-11T01:01:20.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7f8eb8fb0640 1 -- start start 2024-05-11T01:01:20.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7f8eb8fb0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8eb40cd2d0 0x7f8eb4146c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.224+0000 7fca27f7f640 1 Processor -- start 2024-05-11T01:01:20.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445150718 0 0) 0x7fce10007400 con 0x7fce100543a0 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1659c640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce10006ae0 0x7fce10048f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce00003520 con 0x7fce100543a0 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce15d9b640 1 --2- 172.21.15.16:0/946568834 >> v2:172.21.15.174:3300/0 conn(0x7fce10049710 0x7fce10006ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2731832521 0 0) 0x7fce00003520 con 0x7fce100543a0 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce10006ae0 msgr2=0x7fce10048f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce10006ae0 0x7fce10048f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 >> v2:172.21.15.174:3300/0 conn(0x7fce10049710 msgr2=0x7fce10006ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 --2- 172.21.15.16:0/946568834 >> v2:172.21.15.174:3300/0 conn(0x7fce10049710 0x7fce10006ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce10053ba0 con 0x7fce100543a0 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fce0c0016f0 con 0x7fce100543a0 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 >> v1:172.21.15.16:6789/0 conn(0x7fce100543a0 legacy=0x7fce10054830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce1559a640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce10006ae0 0x7fce00003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce1559a640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce00004020 0x7fce00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce1659c640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce10006ae0 0x7fce00003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce1559a640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce00004d40 0x7fce000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce15d9b640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce00004020 0x7fce00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fce10048cb0 con 0x7fce00004020 2024-05-11T01:01:20.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fce100538c0 con 0x7fce00004d40 2024-05-11T01:01:20.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fc97dffb640 1 -- 172.21.15.16:0/2364058810 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031477654 0 0) 0x7fc978053710 con 0x7fc9780eacf0 2024-05-11T01:01:20.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7f8eb37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8eb40cd2d0 0x7f8eb4146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7f8eb37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8eb40cd2d0 0x7f8eb4146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40134/0 (socket says 172.21.15.16:40134) 2024-05-11T01:01:20.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7f8eb37fe640 1 -- 172.21.15.16:0/2384119149 learned_addr learned my addr 172.21.15.16:0/2384119149 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2384119149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb40cd6b0 0x7f8eb40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fce0000bc50 con 0x7fce10006ae0 2024-05-11T01:01:20.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fce16d9d640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce00004d40 0x7fce000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fca27f7f640 1 -- start start 2024-05-11T01:01:20.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fca27f7f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fca2006ecc0 0x7fca20166310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fca27f7f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca2015bec0 con 0x7fca20155ac0 2024-05-11T01:01:20.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fca27f7f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca2015c1a0 con 0x7fca2015b990 2024-05-11T01:01:20.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fca27f7f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fca200b4e80 con 0x7fca2006ecc0 2024-05-11T01:01:20.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fca2651c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fca2006ecc0 0x7fca20166310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7f8eb2ffd640 1 --2- 172.21.15.16:0/2384119149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb40cd6b0 0x7f8eb40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fca2651c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fca2006ecc0 0x7fca20166310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40138/0 (socket says 172.21.15.16:40138) 2024-05-11T01:01:20.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fca2651c640 1 -- 172.21.15.16:0/98090299 learned_addr learned my addr 172.21.15.16:0/98090299 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.226+0000 7fc97dffb640 1 -- 172.21.15.16:0/2364058810 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc968003520 con 0x7fc9780eacf0 2024-05-11T01:01:20.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2384119149 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb406ea00 con 0x7f8eb4147160 2024-05-11T01:01:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.225+0000 7fa20dcbd640 1 -- start start 2024-05-11T01:01:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa20dcbd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20806d430 0x7fa2080b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa20dcbd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2080b72d0 0x7fa2080d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa20dcbd640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20806d9a0 con 0x7fa20815f500 2024-05-11T01:01:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa20dcbd640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa20815f8e0 con 0x7fa2080b72d0 2024-05-11T01:01:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa20dcbd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa2080b82d0 con 0x7fa20806d430 2024-05-11T01:01:20.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fc97e7fc640 1 -- 172.21.15.16:0/2364058810 >> v2:172.21.15.174:3300/0 conn(0x7fc978006800 msgr2=0x7fc978006c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa207fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2080b72d0 0x7fa2080d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa207fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa2080b72d0 0x7fa2080d38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50452/0 (socket says 172.21.15.16:50452) 2024-05-11T01:01:20.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa207fff640 1 -- 172.21.15.16:0/3243070524 learned_addr learned my addr 172.21.15.16:0/3243070524 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa2067fc640 1 -- 172.21.15.16:0/3243070524 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300120754 0 0) 0x7fa20806d9a0 con 0x7fa20815f500 2024-05-11T01:01:20.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa2067fc640 1 -- 172.21.15.16:0/3243070524 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f0003520 con 0x7fa20815f500 2024-05-11T01:01:20.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2384119149 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb406ece0 con 0x7f8eb40cd2d0 2024-05-11T01:01:20.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2384119149 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb406efc0 con 0x7f8eb40cd6b0 2024-05-11T01:01:20.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fca24d19640 1 -- 172.21.15.16:0/98090299 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826116823 0 0) 0x7fca2015c1a0 con 0x7fca2015b990 2024-05-11T01:01:20.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fca2651c640 1 -- 172.21.15.16:0/98090299 >> v1:172.21.15.174:6789/0 conn(0x7fca2015b990 legacy=0x7fca2006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fca2651c640 1 -- 172.21.15.16:0/98090299 >> v1:172.21.15.16:6789/0 conn(0x7fca20155ac0 legacy=0x7fca20070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fca2651c640 1 -- 172.21.15.16:0/98090299 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2015c480 con 0x7fca2006ecc0 2024-05-11T01:01:20.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fce16d9d640 1 -- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce10006ae0 msgr2=0x7fce00003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fce16d9d640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce10006ae0 0x7fce00003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fce16d9d640 1 -- 172.21.15.16:0/946568834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce00004020 msgr2=0x7fce00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fce16d9d640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce00004020 0x7fce00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fce16d9d640 1 -- 172.21.15.16:0/946568834 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce00003520 con 0x7fce00004d40 2024-05-11T01:01:20.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f073efe4640 1 Processor -- start 2024-05-11T01:01:20.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f073efe4640 1 -- start start 2024-05-11T01:01:20.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f8eb37fe640 1 -- 172.21.15.16:0/2384119149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb40cd6b0 msgr2=0x7f8eb40b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f8eb37fe640 1 --2- 172.21.15.16:0/2384119149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb40cd6b0 0x7f8eb40b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f8eb37fe640 1 -- 172.21.15.16:0/2384119149 >> v1:172.21.15.16:6789/0 conn(0x7f8eb4147160 legacy=0x7f8eb406f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7f8eb37fe640 1 -- 172.21.15.16:0/2384119149 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb406f2a0 con 0x7f8eb40cd2d0 2024-05-11T01:01:20.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.228+0000 7f8ddf286640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8dd8155820 0x7f8dd815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fc97dffb640 1 -- 172.21.15.16:0/2364058810 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3868947862 0 0) 0x7fc968003520 con 0x7fc9780eacf0 2024-05-11T01:01:20.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.228+0000 7fc97e7fc640 1 --2- 172.21.15.16:0/2364058810 >> v2:172.21.15.174:3300/0 conn(0x7fc978006800 0x7fc978006c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.228+0000 7fc97e7fc640 1 -- 172.21.15.16:0/2364058810 >> v1:172.21.15.174:6789/0 conn(0x7fc9780eacf0 legacy=0x7fc97804fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.228+0000 7fc97e7fc640 1 -- 172.21.15.16:0/2364058810 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc978053cd0 con 0x7fc978005e80 2024-05-11T01:01:20.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa207fff640 1 -- 172.21.15.16:0/3243070524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20806d430 msgr2=0x7fa2080b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa207fff640 1 --2- 172.21.15.16:0/3243070524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20806d430 0x7fa2080b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa207fff640 1 -- 172.21.15.16:0/3243070524 >> v1:172.21.15.174:6789/0 conn(0x7fa20815f500 legacy=0x7fa2080bac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.227+0000 7fa207fff640 1 -- 172.21.15.16:0/3243070524 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20806dc80 con 0x7fa2080b72d0 2024-05-11T01:01:20.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.228+0000 7f8dde284640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8dd8155820 0x7f8dd815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.228+0000 7f8dde284640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8dd8155820 0x7f8dd815c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50460/0 (socket says 172.21.15.16:50460) 2024-05-11T01:01:20.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.228+0000 7f8dde284640 1 -- 172.21.15.16:0/3115888131 learned_addr learned my addr 172.21.15.16:0/3115888131 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fce16d9d640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce00004d40 0x7fce000051c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00c190 tx=0x7fce00005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6e5db60fdeefee server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.228+0000 7f073efe4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f073004b3b0 0x7f0730034010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8ddf286640 1 -- 172.21.15.16:0/3115888131 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd8074160 con 0x7f8dd815cf00 2024-05-11T01:01:20.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8ddf286640 1 -- 172.21.15.16:0/3115888131 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd815c3e0 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8ddf286640 1 -- 172.21.15.16:0/3115888131 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8dd80cf010 con 0x7f8dd8155820 2024-05-11T01:01:20.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fc97f7fe640 1 --2- 172.21.15.16:0/2364058810 >> v2:172.21.15.174:3300/0 conn(0x7fc978006800 0x7fc978006c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:20.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f073cd80640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f073004b3b0 0x7f0730034010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f073cd80640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f073004b3b0 0x7f0730034010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50472/0 (socket says 172.21.15.16:50472) 2024-05-11T01:01:20.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f073cd80640 1 -- 172.21.15.16:0/2985342320 learned_addr learned my addr 172.21.15.16:0/2985342320 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c007ce0 con 0x7fce00004d40 2024-05-11T01:01:20.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f073efe4640 1 -- 172.21.15.16:0/2985342320 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0730054c00 con 0x7f073004f4c0 2024-05-11T01:01:20.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c005af0 con 0x7fce00004d40 2024-05-11T01:01:20.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fca2651c640 1 --2- 172.21.15.16:0/98090299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca20166310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca10009870 tx=0x7fca1002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00537d7cd19124e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8ddd282640 1 -- 172.21.15.16:0/3115888131 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443584782 0 0) 0x7f8dd815c3e0 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8ddd282640 1 -- 172.21.15.16:0/3115888131 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc4003520 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f073efe4640 1 -- 172.21.15.16:0/2985342320 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0730053a40 con 0x7f0730006a40 2024-05-11T01:01:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f073efe4640 1 -- 172.21.15.16:0/2985342320 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f07300062d0 con 0x7f073004b3b0 2024-05-11T01:01:20.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fc97e7fc640 1 --2- 172.21.15.16:0/2364058810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978005e80 0x7fc9780062c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc98002e140 tx=0x7fc9800a6790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f886f210e7a0d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fa207fff640 1 --2- 172.21.15.16:0/3243070524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2080b72d0 0x7fa2080d38f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa200009e50 tx=0x7fa20002a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3da7f6fec623e1d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fa2067fc640 1 -- 172.21.15.16:0/3243070524 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200036070 con 0x7fa2080b72d0 2024-05-11T01:01:20.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fa2067fc640 1 -- 172.21.15.16:0/3243070524 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa200031600 con 0x7fa2080b72d0 2024-05-11T01:01:20.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fce1559a640 1 -- 172.21.15.16:0/946568834 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c007070 con 0x7fce00004d40 2024-05-11T01:01:20.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7fa2067fc640 1 -- 172.21.15.16:0/3243070524 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2000319f0 con 0x7fa2080b72d0 2024-05-11T01:01:20.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8eb37fe640 1 --2- 172.21.15.16:0/2384119149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 0x7f8eb4146c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009e50 tx=0x7f8eac02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cbd610c77a6020 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f07377fe640 1 -- 172.21.15.16:0/2985342320 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363048915 0 0) 0x7f0730053a40 con 0x7f0730006a40 2024-05-11T01:01:20.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f07377fe640 1 -- 172.21.15.16:0/2985342320 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0728003520 con 0x7f0730006a40 2024-05-11T01:01:20.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7f073cd80640 1 -- 172.21.15.16:0/2985342320 >> v1:172.21.15.174:6789/0 conn(0x7f0730006a40 legacy=0x7f0730006e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7f073cd80640 1 -- 172.21.15.16:0/2985342320 >> v1:172.21.15.16:6789/0 conn(0x7f073004f4c0 legacy=0x7f073004f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7f8eb27fc640 1 -- 172.21.15.16:0/2384119149 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac036070 con 0x7f8eb40cd2d0 2024-05-11T01:01:20.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7f8eb27fc640 1 -- 172.21.15.16:0/2384119149 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac031600 con 0x7f8eb40cd2d0 2024-05-11T01:01:20.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7f8eb27fc640 1 -- 172.21.15.16:0/2384119149 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0319d0 con 0x7f8eb40cd2d0 2024-05-11T01:01:20.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7f073cd80640 1 -- 172.21.15.16:0/2985342320 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0730053d20 con 0x7f073004b3b0 2024-05-11T01:01:20.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fef042c8640 1 Processor -- start 2024-05-11T01:01:20.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fc97dffb640 1 -- 172.21.15.16:0/2364058810 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b2070 con 0x7fc978005e80 2024-05-11T01:01:20.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fc97dffb640 1 -- 172.21.15.16:0/2364058810 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800ab5d0 con 0x7fc978005e80 2024-05-11T01:01:20.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fef042c8640 1 -- start start 2024-05-11T01:01:20.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fce1cc50640 1 -- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce00004d40 msgr2=0x7fce000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fce1cc50640 1 --2- 172.21.15.16:0/946568834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce00004d40 0x7fce000051c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fce0c00c190 tx=0x7fce00005830 comp rx=0 tx=0).stop 2024-05-11T01:01:20.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fa20dcbd640 1 -- 172.21.15.16:0/3243070524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2080b72d0 msgr2=0x7fa2080d38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8dde284640 1 -- 172.21.15.16:0/3115888131 >> v1:172.21.15.174:6789/0 conn(0x7f8dd80cfbb0 legacy=0x7f8dd80d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8dde284640 1 -- 172.21.15.16:0/3115888131 >> v1:172.21.15.16:6789/0 conn(0x7f8dd815cf00 legacy=0x7f8dd80cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.229+0000 7f8dde284640 1 -- 172.21.15.16:0/3115888131 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd815c6c0 con 0x7f8dd8155820 2024-05-11T01:01:20.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fce16d9d640 1 -- 172.21.15.16:0/946568834 reap_dead start 2024-05-11T01:01:20.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fa20dcbd640 1 --2- 172.21.15.16:0/3243070524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2080b72d0 0x7fa2080d38f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa200009e50 tx=0x7fa20002a7c0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fce1cc50640 1 -- 172.21.15.16:0/946568834 shutdown_connections 2024-05-11T01:01:20.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fce1cc50640 1 -- 172.21.15.16:0/946568834 >> 172.21.15.16:0/946568834 conn(0x7fce10055bc0 msgr2=0x7fce10055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fa20dcbd640 1 -- 172.21.15.16:0/3243070524 shutdown_connections 2024-05-11T01:01:20.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fc97dffb640 1 -- 172.21.15.16:0/2364058810 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b2070 con 0x7fc978005e80 2024-05-11T01:01:20.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7f8dde284640 1 --2- 172.21.15.16:0/3115888131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd8155820 0x7f8dd815c9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009870 tx=0x7f8dd402c5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d225e6d42431cc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fa20dcbd640 1 --2- 172.21.15.16:0/3243070524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2080b72d0 0x7fa2080d38f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fca24d19640 1 -- 172.21.15.16:0/98090299 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10037070 con 0x7fca2006ecc0 2024-05-11T01:01:20.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fca24d19640 1 -- 172.21.15.16:0/98090299 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10032440 con 0x7fca2006ecc0 2024-05-11T01:01:20.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fca24d19640 1 -- 172.21.15.16:0/98090299 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10032810 con 0x7fca2006ecc0 2024-05-11T01:01:20.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8ddd282640 1 -- 172.21.15.16:0/3115888131 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4038070 con 0x7f8dd8155820 2024-05-11T01:01:20.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fa20dcbd640 1 --2- 172.21.15.16:0/3243070524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa20806d430 0x7fa2080b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fa20dcbd640 1 -- 172.21.15.16:0/3243070524 >> 172.21.15.16:0/3243070524 conn(0x7fa208074140 msgr2=0x7fa2080d1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fa20dcbd640 1 -- 172.21.15.16:0/3243070524 shutdown_connections 2024-05-11T01:01:20.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.230+0000 7fa20dcbd640 1 -- 172.21.15.16:0/3243070524 wait complete. 2024-05-11T01:01:20.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fce1cc50640 1 -- 172.21.15.16:0/946568834 shutdown_connections 2024-05-11T01:01:20.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8ddd282640 1 -- 172.21.15.16:0/3115888131 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd4031710 con 0x7f8dd8155820 2024-05-11T01:01:20.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8ddd282640 1 -- 172.21.15.16:0/3115888131 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4031ac0 con 0x7f8dd8155820 2024-05-11T01:01:20.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2384119149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 msgr2=0x7f8eb4146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2384119149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 0x7f8eb4146c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009e50 tx=0x7f8eac02a680 comp rx=0 tx=0).stop 2024-05-11T01:01:20.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fc985578640 1 -- 172.21.15.16:0/2364058810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978005e80 msgr2=0x7fc9780062c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fc985578640 1 --2- 172.21.15.16:0/2364058810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978005e80 0x7fc9780062c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc98002e140 tx=0x7fc9800a6790 comp rx=0 tx=0).stop 2024-05-11T01:01:20.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f073cd80640 1 --2- 172.21.15.16:0/2985342320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004b3b0 0x7f0730034010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0730006450 tx=0x7f072c02a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2160d09eb0be0eda server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fc985578640 1 -- 172.21.15.16:0/2364058810 shutdown_connections 2024-05-11T01:01:20.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fce1cc50640 1 -- 172.21.15.16:0/946568834 wait complete. 2024-05-11T01:01:20.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fc985578640 1 --2- 172.21.15.16:0/2364058810 >> v2:172.21.15.174:3300/0 conn(0x7fc978006800 0x7fc978006c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fc985578640 1 --2- 172.21.15.16:0/2364058810 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978005e80 0x7fc9780062c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fc985578640 1 -- 172.21.15.16:0/2364058810 >> 172.21.15.16:0/2364058810 conn(0x7fc978009fa0 msgr2=0x7fc97800a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f07377fe640 1 -- 172.21.15.16:0/2985342320 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c037070 con 0x7f073004b3b0 2024-05-11T01:01:20.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f07377fe640 1 -- 172.21.15.16:0/2985342320 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c032640 con 0x7f073004b3b0 2024-05-11T01:01:20.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f07377fe640 1 -- 172.21.15.16:0/2985342320 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c032a10 con 0x7f073004b3b0 2024-05-11T01:01:20.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fc985578640 1 -- 172.21.15.16:0/2364058810 shutdown_connections 2024-05-11T01:01:20.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fef042c8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feefc073350 0x7feefc06e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fef042c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc073aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2384119149 shutdown_connections 2024-05-11T01:01:20.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2384119149 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb40cd6b0 0x7f8eb40b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2384119149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 0x7f8eb4146c20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2384119149 >> 172.21.15.16:0/2384119149 conn(0x7f8eb406c830 msgr2=0x7f8eb406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fc985578640 1 -- 172.21.15.16:0/2364058810 wait complete. 2024-05-11T01:01:20.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fca27f7f640 1 -- 172.21.15.16:0/98090299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 msgr2=0x7fca20166310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fca27f7f640 1 --2- 172.21.15.16:0/98090299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca20166310 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fca10009870 tx=0x7fca1002a1c0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2384119149 shutdown_connections 2024-05-11T01:01:20.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8ddf286640 1 -- 172.21.15.16:0/3115888131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd8155820 msgr2=0x7f8dd815c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8ddf286640 1 --2- 172.21.15.16:0/3115888131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd8155820 0x7f8dd815c9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009870 tx=0x7f8dd402c5b0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fca27f7f640 1 -- 172.21.15.16:0/98090299 shutdown_connections 2024-05-11T01:01:20.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fca27f7f640 1 --2- 172.21.15.16:0/98090299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca20166310 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fca27f7f640 1 -- 172.21.15.16:0/98090299 >> 172.21.15.16:0/98090299 conn(0x7fca200d0f90 msgr2=0x7fca200d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2384119149 wait complete. 2024-05-11T01:01:20.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8ddf286640 1 -- 172.21.15.16:0/3115888131 shutdown_connections 2024-05-11T01:01:20.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8ddf286640 1 --2- 172.21.15.16:0/3115888131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd8155820 0x7f8dd815c9c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fef042c8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc072590 con 0x7feefc0d0d00 2024-05-11T01:01:20.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fef042c8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7feefc072ec0 con 0x7feefc073350 2024-05-11T01:01:20.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.231+0000 7fef042c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7feefc06ec80 con 0x7feefc0b4710 2024-05-11T01:01:20.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fef01863640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feefc073350 0x7feefc06e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fef01863640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feefc073350 0x7feefc06e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40144/0 (socket says 172.21.15.16:40144) 2024-05-11T01:01:20.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8ddf286640 1 -- 172.21.15.16:0/3115888131 >> 172.21.15.16:0/3115888131 conn(0x7f8dd80b2b10 msgr2=0x7f8dd80b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fef01863640 1 -- 172.21.15.16:0/4285353927 learned_addr learned my addr 172.21.15.16:0/4285353927 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8ddf286640 1 -- 172.21.15.16:0/3115888131 shutdown_connections 2024-05-11T01:01:20.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7f8ddf286640 1 -- 172.21.15.16:0/3115888131 wait complete. 2024-05-11T01:01:20.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fef02865640 1 --2- 172.21.15.16:0/4285353927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc073aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fef01863640 1 -- 172.21.15.16:0/4285353927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 msgr2=0x7feefc073aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:20.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fef01863640 1 --2- 172.21.15.16:0/4285353927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc073aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fef01863640 1 -- 172.21.15.16:0/4285353927 >> v1:172.21.15.16:6789/0 conn(0x7feefc0d0d00 legacy=0x7feefc155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.232+0000 7fef01863640 1 -- 172.21.15.16:0/4285353927 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc072870 con 0x7feefc073350 2024-05-11T01:01:20.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7f073efe4640 1 -- 172.21.15.16:0/2985342320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004b3b0 msgr2=0x7f0730034010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7f073efe4640 1 --2- 172.21.15.16:0/2985342320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004b3b0 0x7f0730034010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0730006450 tx=0x7f072c02a2e0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7fa20dcbd640 1 Processor -- start 2024-05-11T01:01:20.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7f073efe4640 1 -- 172.21.15.16:0/2985342320 shutdown_connections 2024-05-11T01:01:20.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7f073efe4640 1 --2- 172.21.15.16:0/2985342320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004b3b0 0x7f0730034010 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0730006450 tx=0x7f072c02a2e0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7f073efe4640 1 -- 172.21.15.16:0/2985342320 >> 172.21.15.16:0/2985342320 conn(0x7f073000a3f0 msgr2=0x7f073000a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7f073efe4640 1 -- 172.21.15.16:0/2985342320 shutdown_connections 2024-05-11T01:01:20.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7fa20dcbd640 1 -- start start 2024-05-11T01:01:20.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7fc985578640 1 Processor -- start 2024-05-11T01:01:20.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7fc985578640 1 -- start start 2024-05-11T01:01:20.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.233+0000 7f073efe4640 1 -- 172.21.15.16:0/2985342320 wait complete. 2024-05-11T01:01:20.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7fce1cc50640 1 Processor -- start 2024-05-11T01:01:20.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7fef01863640 1 --2- 172.21.15.16:0/4285353927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc073350 0x7feefc06e740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feeec00def0 tx=0x7feeec02e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a80facba9c805f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7f8eb8fb0640 1 Processor -- start 2024-05-11T01:01:20.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7fca27f7f640 1 -- 172.21.15.16:0/98090299 shutdown_connections 2024-05-11T01:01:20.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7fce1cc50640 1 -- start start 2024-05-11T01:01:20.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7fef01062640 1 -- 172.21.15.16:0/4285353927 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec03a070 con 0x7feefc073350 2024-05-11T01:01:20.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7fef01062640 1 -- 172.21.15.16:0/4285353927 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec00b450 con 0x7feefc073350 2024-05-11T01:01:20.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7fef01062640 1 -- 172.21.15.16:0/4285353927 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec00d2d0 con 0x7feefc073350 2024-05-11T01:01:20.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fa20dcbd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20806d430 0x7fa2081f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fa20dcbd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2080b72d0 0x7fa2080b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fa20dcbd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20815f500 0x7fa2080ba100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fc985578640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978005e80 0x7fc9781792f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fa20dcbd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2080d33d0 con 0x7fa20815f500 2024-05-11T01:01:20.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fa20dcbd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa20806e240 con 0x7fa20806d430 2024-05-11T01:01:20.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fa20dcbd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa2080d3e30 con 0x7fa2080b72d0 2024-05-11T01:01:20.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fc985578640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978006800 0x7fc9780d8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7fca27f7f640 1 -- 172.21.15.16:0/98090299 wait complete. 2024-05-11T01:01:20.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fc97effd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978005e80 0x7fc9781792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fc97effd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978005e80 0x7fc9781792f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50482/0 (socket says 172.21.15.16:50482) 2024-05-11T01:01:20.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fc97effd640 1 -- 172.21.15.16:0/2758281496 learned_addr learned my addr 172.21.15.16:0/2758281496 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7f8eb8fb0640 1 -- start start 2024-05-11T01:01:20.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7f8eb8fb0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 0x7f8eb415e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7f8eb8fb0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8eb40cd6b0 0x7f8eb415f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7f8eb8fb0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb4147160 0x7f8eb4162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7f8eb8fb0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb40b5310 con 0x7f8eb40cd2d0 2024-05-11T01:01:20.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7f8eb8fb0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb40700e0 con 0x7f8eb40cd6b0 2024-05-11T01:01:20.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7f8eb8fb0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb40b5490 con 0x7f8eb4147160 2024-05-11T01:01:20.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fce1cc50640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce10180370 0x7fce100e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fce1cc50640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce10180750 0x7fce100e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fce1cc50640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce100da870 0x7fce100dad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fce1cc50640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fce100558e0 con 0x7fce10180750 2024-05-11T01:01:20.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fce1cc50640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fce100e79e0 con 0x7fce10180370 2024-05-11T01:01:20.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fce1cc50640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fce10054f40 con 0x7fce100da870 2024-05-11T01:01:20.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fc985578640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9780eacf0 0x7fc9780d87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fef042c8640 1 -- 172.21.15.16:0/4285353927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc073350 msgr2=0x7feefc06e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7fef042c8640 1 --2- 172.21.15.16:0/4285353927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc073350 0x7feefc06e740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feeec00def0 tx=0x7feeec02e720 comp rx=0 tx=0).stop 2024-05-11T01:01:20.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7f8ddf286640 1 Processor -- start 2024-05-11T01:01:20.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.234+0000 7f8ddf286640 1 -- start start 2024-05-11T01:01:20.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7f073efe4640 1 Processor -- start 2024-05-11T01:01:20.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.235+0000 7f073efe4640 1 -- start start 2024-05-11T01:01:20.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8eb3fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb4147160 0x7f8eb4162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8eb3fff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb4147160 0x7f8eb4162c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57648/0 (socket says 172.21.15.16:57648) 2024-05-11T01:01:20.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8eb3fff640 1 -- 172.21.15.16:0/2572387991 learned_addr learned my addr 172.21.15.16:0/2572387991 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc9780547b0 con 0x7fc978006800 2024-05-11T01:01:20.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc978050190 con 0x7fc978005e80 2024-05-11T01:01:20.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc978054930 con 0x7fc9780eacf0 2024-05-11T01:01:20.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc97e7fc640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978006800 0x7fc9780d8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc97f7fe640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9780eacf0 0x7fc9780d87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fce15d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce10180750 0x7fce100e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fce15d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce10180750 0x7fce100e9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40174/0 (socket says 172.21.15.16:40174) 2024-05-11T01:01:20.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fce15d9b640 1 -- 172.21.15.16:0/463582488 learned_addr learned my addr 172.21.15.16:0/463582488 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fce1659c640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce10180370 0x7fce100e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fa2077fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20806d430 0x7fa2081f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fa2077fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20806d430 0x7fa2081f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50498/0 (socket says 172.21.15.16:50498) 2024-05-11T01:01:20.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fa2077fe640 1 -- 172.21.15.16:0/882850267 learned_addr learned my addr 172.21.15.16:0/882850267 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fa207fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20815f500 0x7fa2080ba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fa206ffd640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2080b72d0 0x7fa2080b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fce16d9d640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce100da870 0x7fce100dad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fef042c8640 1 -- 172.21.15.16:0/4285353927 shutdown_connections 2024-05-11T01:01:20.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fef042c8640 1 --2- 172.21.15.16:0/4285353927 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc073aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fef042c8640 1 --2- 172.21.15.16:0/4285353927 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc073350 0x7feefc06e740 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fef042c8640 1 -- 172.21.15.16:0/4285353927 >> 172.21.15.16:0/4285353927 conn(0x7feefc06c5c0 msgr2=0x7feefc06c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fef042c8640 1 -- 172.21.15.16:0/4285353927 shutdown_connections 2024-05-11T01:01:20.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8eb37fe640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 0x7f8eb415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8ddf286640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cfbb0 0x7f8dd8142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8ddf286640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8155820 0x7f8dd81f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fa2077fe640 1 -- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2080b72d0 msgr2=0x7fa2080b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fa2077fe640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2080b72d0 0x7fa2080b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fa2077fe640 1 -- 172.21.15.16:0/882850267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20815f500 msgr2=0x7fa2080ba100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fa2077fe640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20815f500 0x7fa2080ba100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8ddf286640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dd815cf00 0x7f8dd8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8ddf286640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd80ce8c0 con 0x7f8dd815cf00 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8ddf286640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd8155c00 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8ddf286640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd80cea40 con 0x7f8dd8155820 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc97e7fc640 1 -- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9780eacf0 msgr2=0x7fc9780d87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc97e7fc640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9780eacf0 0x7fc9780d87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc97e7fc640 1 -- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978005e80 msgr2=0x7fc9781792f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc97e7fc640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978005e80 0x7fc9781792f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc97e7fc640 1 -- 172.21.15.16:0/2758281496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc978185840 con 0x7fc978006800 2024-05-11T01:01:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fc97f7fe640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9780eacf0 0x7fc9780d87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fc97effd640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978005e80 0x7fc9781792f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7f8eb2ffd640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8eb40cd6b0 0x7f8eb415f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eb3fff640 1 -- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8eb40cd6b0 msgr2=0x7f8eb415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eb3fff640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8eb40cd6b0 0x7f8eb415f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eb3fff640 1 -- 172.21.15.16:0/2572387991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 msgr2=0x7f8eb415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eb3fff640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 0x7f8eb415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eb3fff640 1 -- 172.21.15.16:0/2572387991 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb415e7f0 con 0x7f8eb4147160 2024-05-11T01:01:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fca27f7f640 1 Processor -- start 2024-05-11T01:01:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fa2077fe640 1 -- 172.21.15.16:0/882850267 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2081f5ce0 con 0x7fa20806d430 2024-05-11T01:01:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8dde284640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cfbb0 0x7f8dd8142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8dde284640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cfbb0 0x7f8dd8142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50512/0 (socket says 172.21.15.16:50512) 2024-05-11T01:01:20.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8dde284640 1 -- 172.21.15.16:0/2272574027 learned_addr learned my addr 172.21.15.16:0/2272574027 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fce1659c640 1 -- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce100da870 msgr2=0x7fce100dad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fce1659c640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce100da870 0x7fce100dad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8ddea85640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dd815cf00 0x7f8dd8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8ddda83640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8155820 0x7f8dd81f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eb3fff640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb4147160 0x7f8eb4162c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00c360 tx=0x7f8e9c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eabfff640 1 -- 172.21.15.16:0/2572387991 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c017070 con 0x7f8eb4147160 2024-05-11T01:01:20.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fce1659c640 1 -- 172.21.15.16:0/463582488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce10180750 msgr2=0x7fce100e9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fce1659c640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce10180750 0x7fce100e9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fce1659c640 1 -- 172.21.15.16:0/463582488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce100dec00 con 0x7fce10180370 2024-05-11T01:01:20.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fce15d9b640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce10180750 0x7fce100e9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:20.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073efe4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0730006a40 0x7f0730039ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073efe4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f073004f4c0 0x7f073004e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073efe4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004ee80 0x7f07300ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073efe4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0730050050 con 0x7f0730006a40 2024-05-11T01:01:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073efe4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f073004b790 con 0x7f073004ee80 2024-05-11T01:01:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073efe4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0730054820 con 0x7f073004f4c0 2024-05-11T01:01:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073cd80640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0730006a40 0x7f0730039ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.236+0000 7fef042c8640 1 -- 172.21.15.16:0/4285353927 wait complete. 2024-05-11T01:01:20.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fca27f7f640 1 -- start start 2024-05-11T01:01:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073cd80640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0730006a40 0x7f0730039ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40206/0 (socket says 172.21.15.16:40206) 2024-05-11T01:01:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f073cd80640 1 -- 172.21.15.16:0/21506550 learned_addr learned my addr 172.21.15.16:0/21506550 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8dde284640 1 -- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8155820 msgr2=0x7f8dd81f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8dde284640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8155820 0x7f8dd81f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8dde284640 1 -- 172.21.15.16:0/2272574027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dd815cf00 msgr2=0x7f8dd8157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8dde284640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dd815cf00 0x7f8dd8157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8dde284640 1 -- 172.21.15.16:0/2272574027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd81589c0 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb415ead0 con 0x7f8eb4147160 2024-05-11T01:01:20.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb415f090 con 0x7f8eb4147160 2024-05-11T01:01:20.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.237+0000 7fce1659c640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce10180370 0x7fce100e93f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce08011590 tx=0x7fce08011a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f8eabfff640 1 -- 172.21.15.16:0/2572387991 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0035f0 con 0x7f8eb4147160 2024-05-11T01:01:20.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f073cd80640 1 -- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f073004f4c0 msgr2=0x7f073004e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f0737fff640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f073004f4c0 0x7f073004e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f8eabfff640 1 -- 172.21.15.16:0/2572387991 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c003a20 con 0x7f8eb4147160 2024-05-11T01:01:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f073cd80640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f073004f4c0 0x7f073004e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f073cd80640 1 -- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004ee80 msgr2=0x7f07300ea3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f073d581640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004ee80 0x7f07300ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f073cd80640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004ee80 0x7f07300ea3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f073cd80640 1 -- 172.21.15.16:0/21506550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07300e3360 con 0x7f0730006a40 2024-05-11T01:01:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f0737fff640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f073004f4c0 0x7f073004e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:20.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f073d581640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004ee80 0x7f07300ea3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fc97e7fc640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978006800 0x7fc9780d8280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc980075320 tx=0x7fc980076980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f073cd80640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0730006a40 0x7f0730039ff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f072c02a850 tx=0x7f072c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fa2077fe640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20806d430 0x7fa2081f5ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c430 tx=0x7fa1f800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca27f7f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca2015df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca27f7f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca20155ac0 0x7fca200ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca27f7f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015b990 0x7fca201521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca27f7f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fca200729b0 con 0x7fca2006ecc0 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca27f7f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fca20155ea0 con 0x7fca20155ac0 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca27f7f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fca200d1a80 con 0x7fca2015b990 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca25d1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca2015df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca25d1b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca2015df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40212/0 (socket says 172.21.15.16:40212) 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca25d1b640 1 -- 172.21.15.16:0/2483398069 learned_addr learned my addr 172.21.15.16:0/2483398069 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fca2551a640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca20155ac0 0x7fca200ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7f8dde284640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cfbb0 0x7f8dd8142d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4000c00 tx=0x7f8dd40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fc9677fe640 1 -- 172.21.15.16:0/2758281496 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b2050 con 0x7fc978006800 2024-05-11T01:01:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fc9677fe640 1 -- 172.21.15.16:0/2758281496 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800be070 con 0x7fc978006800 2024-05-11T01:01:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9780d71e0 con 0x7fc978006800 2024-05-11T01:01:20.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9780d77a0 con 0x7fc978006800 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fca25d1b640 1 -- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015b990 msgr2=0x7fca201521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fca2651c640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015b990 0x7fca201521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fca25d1b640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015b990 0x7fca201521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fca25d1b640 1 -- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca20155ac0 msgr2=0x7fca200ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fca25d1b640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca20155ac0 0x7fca200ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fca25d1b640 1 -- 172.21.15.16:0/2483398069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca200cf5e0 con 0x7fca2006ecc0 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fce06ffd640 1 -- 172.21.15.16:0/463582488 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08019070 con 0x7fce10180370 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fce1cc50640 1 -- 172.21.15.16:0/463582488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce100deee0 con 0x7fce10180370 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fce1cc50640 1 -- 172.21.15.16:0/463582488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce100db260 con 0x7fce10180370 2024-05-11T01:01:20.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fce06ffd640 1 -- 172.21.15.16:0/463582488 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce08003610 con 0x7fce10180370 2024-05-11T01:01:20.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7f07357fa640 1 -- 172.21.15.16:0/21506550 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c041020 con 0x7f0730006a40 2024-05-11T01:01:20.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7f07357fa640 1 -- 172.21.15.16:0/21506550 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c0306f0 con 0x7f0730006a40 2024-05-11T01:01:20.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7f07357fa640 1 -- 172.21.15.16:0/21506550 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c037040 con 0x7f0730006a40 2024-05-11T01:01:20.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0730038c70 con 0x7f0730006a40 2024-05-11T01:01:20.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0730039230 con 0x7f0730006a40 2024-05-11T01:01:20.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fef042c8640 1 Processor -- start 2024-05-11T01:01:20.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.238+0000 7fef042c8640 1 -- start start 2024-05-11T01:01:20.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fca25d1b640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca2015df40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c430 tx=0x7fca1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7f8dceffd640 1 -- 172.21.15.16:0/2272574027 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4044070 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fa1effff640 1 -- 172.21.15.16:0/882850267 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8017070 con 0x7fa20806d430 2024-05-11T01:01:20.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7f8dceffd640 1 -- 172.21.15.16:0/2272574027 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd403e670 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fa20dcbd640 1 -- 172.21.15.16:0/882850267 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2081f5720 con 0x7fa20806d430 2024-05-11T01:01:20.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fce06ffd640 1 -- 172.21.15.16:0/463582488 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce080039c0 con 0x7fce10180370 2024-05-11T01:01:20.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fa20dcbd640 1 -- 172.21.15.16:0/882850267 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2080cc510 con 0x7fa20806d430 2024-05-11T01:01:20.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7f8dceffd640 1 -- 172.21.15.16:0/2272574027 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4038040 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fce1cc50640 1 -- 172.21.15.16:0/463582488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdfc005290 con 0x7fce10180370 2024-05-11T01:01:20.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fca167fc640 1 -- 172.21.15.16:0/2483398069 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c011790 con 0x7fca2006ecc0 2024-05-11T01:01:20.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fca167fc640 1 -- 172.21.15.16:0/2483398069 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c017070 con 0x7fca2006ecc0 2024-05-11T01:01:20.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fca167fc640 1 -- 172.21.15.16:0/2483398069 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c011bb0 con 0x7fca2006ecc0 2024-05-11T01:01:20.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca200cf300 con 0x7fca2006ecc0 2024-05-11T01:01:20.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201f1590 con 0x7fca2006ecc0 2024-05-11T01:01:20.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7f8ddf286640 1 -- 172.21.15.16:0/2272574027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd8158ca0 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fef042c8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc073350 0x7feefc09de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fef042c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fef042c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0d0d00 0x7feefc0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fef01863640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef01863640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57698/0 (socket says 172.21.15.16:57698) 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef01863640 1 -- 172.21.15.16:0/1520771936 learned_addr learned my addr 172.21.15.16:0/1520771936 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0b42a0 con 0x7feefc0d0d00 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0b4120 con 0x7feefc073350 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7feefc0b4ba0 con 0x7feefc0b4710 2024-05-11T01:01:20.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef02865640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0d0d00 0x7feefc0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef01863640 1 -- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc073350 msgr2=0x7feefc09de50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-11T01:01:20.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef01863640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc073350 0x7feefc09de50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef01863640 1 -- 172.21.15.16:0/1520771936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0d0d00 msgr2=0x7feefc0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef01863640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0d0d00 0x7feefc0b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef01863640 1 -- 172.21.15.16:0/1520771936 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc09c030 con 0x7feefc0b4710 2024-05-11T01:01:20.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fef02865640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0d0d00 0x7feefc0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:20.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7f8ddf286640 1 -- 172.21.15.16:0/2272574027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd8142810 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07300057d0 con 0x7f0730006a40 2024-05-11T01:01:20.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.241+0000 7fa1effff640 1 -- 172.21.15.16:0/882850267 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f80052f0 con 0x7fa20806d430 2024-05-11T01:01:20.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.242+0000 7fef01863640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc151c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feeec00def0 tx=0x7feeec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.242+0000 7fa1effff640 1 -- 172.21.15.16:0/882850267 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8003830 con 0x7fa20806d430 2024-05-11T01:01:20.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.239+0000 7fc9677fe640 1 -- 172.21.15.16:0/2758281496 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9700016f0 con 0x7fc978006800 2024-05-11T01:01:20.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.240+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc978005380 con 0x7fc978006800 2024-05-11T01:01:20.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.242+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca08005290 con 0x7fca2006ecc0 2024-05-11T01:01:20.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.242+0000 7f07357fa640 1 -- 172.21.15.16:0/21506550 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f072c044020 con 0x7f0730006a40 2024-05-11T01:01:20.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.242+0000 7feef2ffd640 1 -- 172.21.15.16:0/1520771936 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec04f420 con 0x7feefc0b4710 2024-05-11T01:01:20.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.242+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc09c310 con 0x7feefc0b4710 2024-05-11T01:01:20.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.242+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc09c8d0 con 0x7feefc0b4710 2024-05-11T01:01:20.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.243+0000 7fa20dcbd640 1 -- 172.21.15.16:0/882850267 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20806a5b0 con 0x7fa20806d430 2024-05-11T01:01:20.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.242+0000 7feef2ffd640 1 -- 172.21.15.16:0/1520771936 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec04b070 con 0x7feefc0b4710 2024-05-11T01:01:20.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.243+0000 7feef2ffd640 1 -- 172.21.15.16:0/1520771936 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec04f7e0 con 0x7feefc0b4710 2024-05-11T01:01:20.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.243+0000 7f8eabfff640 1 -- 172.21.15.16:0/2572387991 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e9c01a070 con 0x7f8eb4147160 2024-05-11T01:01:20.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.243+0000 7f07357fa640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f071c0763d0 0x7f071c078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.243+0000 7f07357fa640 1 -- 172.21.15.16:0/21506550 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f072c0b7c10 con 0x7f0730006a40 2024-05-11T01:01:20.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.243+0000 7f0737fff640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f071c0763d0 0x7f071c078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.244+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e98005290 con 0x7f8eb4147160 2024-05-11T01:01:20.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.244+0000 7f8eabfff640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8e940762d0 0x7f8e94078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.244+0000 7fc9677fe640 1 -- 172.21.15.16:0/2758281496 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc9800b9450 con 0x7fc978006800 2024-05-11T01:01:20.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.244+0000 7f8dccff9640 1 -- 172.21.15.16:0/2272574027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd8142a10 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.244+0000 7fce06ffd640 1 -- 172.21.15.16:0/463582488 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce0801c070 con 0x7fce10180370 2024-05-11T01:01:20.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.244+0000 7f8eabfff640 1 -- 172.21.15.16:0/2572387991 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8e9c096910 con 0x7f8eb4147160 2024-05-11T01:01:20.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.244+0000 7f0737fff640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f071c0763d0 0x7f071c078890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0738065f80 tx=0x7f073806f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7feef2ffd640 1 -- 172.21.15.16:0/1520771936 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feeec04d030 con 0x7feefc0b4710 2024-05-11T01:01:20.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7fca167fc640 1 -- 172.21.15.16:0/2483398069 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca1c01c460 con 0x7fca2006ecc0 2024-05-11T01:01:20.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc09f120 con 0x7feefc0b4710 2024-05-11T01:01:20.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7fce06ffd640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcdf80763d0 0x7fcdf8078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7f8eb37fe640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8e940762d0 0x7f8e94078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7fce06ffd640 1 -- 172.21.15.16:0/463582488 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fce08097cf0 con 0x7fce10180370 2024-05-11T01:01:20.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7fce15d9b640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcdf80763d0 0x7fcdf8078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7fc9677fe640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc96c076320 0x7fc96c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.245+0000 7fca167fc640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fca04076320 0x7fca040787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7fc9677fe640 1 -- 172.21.15.16:0/2758281496 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc980134c80 con 0x7fc978006800 2024-05-11T01:01:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7fc97effd640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc96c076320 0x7fc96c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7feef2ffd640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7feee00763a0 0x7feee0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7fce15d9b640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcdf80763d0 0x7fcdf8078890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce18075320 tx=0x7fce1806f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7fca2551a640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fca04076320 0x7fca040787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7fa1effff640 1 -- 172.21.15.16:0/882850267 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1f801a070 con 0x7fa20806d430 2024-05-11T01:01:20.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7f8eb37fe640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8e940762d0 0x7f8e94078790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8eac033000 tx=0x7f8eac009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7fef02064640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7feee00763a0 0x7feee0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7feef2ffd640 1 -- 172.21.15.16:0/1520771936 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feeec0c7be0 con 0x7feefc0b4710 2024-05-11T01:01:20.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7fca2551a640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fca04076320 0x7fca040787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca200af590 tx=0x7fca18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.246+0000 7fa1effff640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa1f40763a0 0x7fa1f4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.247+0000 7fc97effd640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc96c076320 0x7fc96c0787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc970005880 tx=0x7fc970009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.247+0000 7fef02064640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7feee00763a0 0x7feee0078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feef8000f60 tx=0x7feef80079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.247+0000 7fa1effff640 1 -- 172.21.15.16:0/882850267 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1f8096860 con 0x7fa20806d430 2024-05-11T01:01:20.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.247+0000 7fce06ffd640 1 -- 172.21.15.16:0/463582488 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce08060fe0 con 0x7fce10180370 2024-05-11T01:01:20.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.247+0000 7fa206ffd640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa1f40763a0 0x7fa1f4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.247+0000 7fa206ffd640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa1f40763a0 0x7fa1f4078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa208161d60 tx=0x7fa1fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.248+0000 7f8dceffd640 1 -- 172.21.15.16:0/2272574027 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8dd4047070 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.249+0000 7f8dceffd640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8dbc076320 0x7f8dbc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.249+0000 7f8ddda83640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8dbc076320 0x7f8dbc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.249+0000 7f8ddda83640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8dbc076320 0x7f8dbc0787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8145d50 tx=0x7f8dd00094d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.249+0000 7fc9677fe640 1 -- 172.21.15.16:0/2758281496 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc9800fe5c0 con 0x7fc978006800 2024-05-11T01:01:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.249+0000 7f8eabfff640 1 -- 172.21.15.16:0/2572387991 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8e9c05fc10 con 0x7f8eb4147160 2024-05-11T01:01:20.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.252+0000 7f8dceffd640 1 -- 172.21.15.16:0/2272574027 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8dd40817e0 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.252+0000 7fa1effff640 1 -- 172.21.15.16:0/882850267 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2081f5ce0 con 0x7fa20806d430 2024-05-11T01:01:20.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.254+0000 7feef2ffd640 1 -- 172.21.15.16:0/1520771936 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feeec091520 con 0x7feefc0b4710 2024-05-11T01:01:20.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.255+0000 7f07357fa640 1 -- 172.21.15.16:0/21506550 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f072c04b030 con 0x7f0730006a40 2024-05-11T01:01:20.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.255+0000 7fca167fc640 1 -- 172.21.15.16:0/2483398069 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca1c003800 con 0x7fca2006ecc0 2024-05-11T01:01:20.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.258+0000 7f8dceffd640 1 -- 172.21.15.16:0/2272574027 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8dd8142a10 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.260+0000 7fca167fc640 1 -- 172.21.15.16:0/2483398069 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca1c060cb0 con 0x7fca2006ecc0 2024-05-11T01:01:20.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.696+0000 7fce1cc50640 1 -- 172.21.15.16:0/463582488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcdfc005850 con 0x7fce10180370 2024-05-11T01:01:20.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.697+0000 7fce06ffd640 1 -- 172.21.15.16:0/463582488 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce080652e0 con 0x7fce10180370 2024-05-11T01:01:20.697 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-11T01:01:20.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.697+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc97804f930 con 0x7fc978006800 2024-05-11T01:01:20.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.698+0000 7fc9677fe640 1 -- 172.21.15.16:0/2758281496 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9800fdec0 con 0x7fc978006800 2024-05-11T01:01:20.698 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-05-11T01:01:20.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.700+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8e98005580 con 0x7f8eb4147160 2024-05-11T01:01:20.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 -- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcdf80763d0 msgr2=0x7fcdf8078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcdf80763d0 0x7fcdf8078890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce18075320 tx=0x7fce1806f040 comp rx=0 tx=0).stop 2024-05-11T01:01:20.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 -- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce10180370 msgr2=0x7fce100e93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce10180370 0x7fce100e93f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce08011590 tx=0x7fce08011a50 comp rx=0 tx=0).stop 2024-05-11T01:01:20.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 -- 172.21.15.16:0/463582488 shutdown_connections 2024-05-11T01:01:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcdf80763d0 0x7fcdf8078890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce100da870 0x7fce100dad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce10180750 0x7fce100e9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 --2- 172.21.15.16:0/463582488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce10180370 0x7fce100e93f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 -- 172.21.15.16:0/463582488 >> 172.21.15.16:0/463582488 conn(0x7fce10055bc0 msgr2=0x7fce10007700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7f8eabfff640 1 -- 172.21.15.16:0/2572387991 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e9c063f10 con 0x7f8eb4147160 2024-05-11T01:01:20.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 -- 172.21.15.16:0/463582488 shutdown_connections 2024-05-11T01:01:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fce04ff9640 1 -- 172.21.15.16:0/463582488 wait complete. 2024-05-11T01:01:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc96c076320 msgr2=0x7fc96c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fc985578640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc96c076320 0x7fc96c0787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc970005880 tx=0x7fc970009040 comp rx=0 tx=0).stop 2024-05-11T01:01:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978006800 msgr2=0x7fc9780d8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.701+0000 7fc985578640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978006800 0x7fc9780d8280 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc980075320 tx=0x7fc980076980 comp rx=0 tx=0).stop 2024-05-11T01:01:20.704 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-11T01:01:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.702+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 shutdown_connections 2024-05-11T01:01:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.702+0000 7fc985578640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc96c076320 0x7fc96c0787e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.702+0000 7fc985578640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc9780eacf0 0x7fc9780d87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.702+0000 7fc985578640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc978006800 0x7fc9780d8280 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.702+0000 7fc985578640 1 --2- 172.21.15.16:0/2758281496 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc978005e80 0x7fc9781792f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.702+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 >> 172.21.15.16:0/2758281496 conn(0x7fc978009fa0 msgr2=0x7fc97804a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.702+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 shutdown_connections 2024-05-11T01:01:20.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.702+0000 7fc985578640 1 -- 172.21.15.16:0/2758281496 wait complete. 2024-05-11T01:01:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.704+0000 7fa20dcbd640 1 -- 172.21.15.16:0/882850267 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa20806c3e0 con 0x7fa20806d430 2024-05-11T01:01:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8e940762d0 msgr2=0x7f8e94078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8e940762d0 0x7f8e94078790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8eac033000 tx=0x7f8eac009000 comp rx=0 tx=0).stop 2024-05-11T01:01:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb4147160 msgr2=0x7f8eb4162c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb4147160 0x7f8eb4162c40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00c360 tx=0x7f8e9c00c820 comp rx=0 tx=0).stop 2024-05-11T01:01:20.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7fa1effff640 1 -- 172.21.15.16:0/882850267 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa1f8068220 con 0x7fa20806d430 2024-05-11T01:01:20.707 INFO:teuthology.orchestra.run.smithi016.stdout:55834574852 2024-05-11T01:01:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 shutdown_connections 2024-05-11T01:01:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8e940762d0 0x7f8e94078790 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8eb4147160 0x7f8eb4162c40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8eb40cd6b0 0x7f8eb415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 --2- 172.21.15.16:0/2572387991 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8eb40cd2d0 0x7f8eb415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 >> 172.21.15.16:0/2572387991 conn(0x7f8eb406c830 msgr2=0x7f8eb4148dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 shutdown_connections 2024-05-11T01:01:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.705+0000 7f8eb8fb0640 1 -- 172.21.15.16:0/2572387991 wait complete. 2024-05-11T01:01:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.707+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7feefc0508d0 con 0x7feefc0b4710 2024-05-11T01:01:20.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f073003a530 con 0x7f0730006a40 2024-05-11T01:01:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7feef2ffd640 1 -- 172.21.15.16:0/1520771936 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feeec090e20 con 0x7feefc0b4710 2024-05-11T01:01:20.709 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-11T01:01:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.709+0000 7f07357fa640 1 -- 172.21.15.16:0/21506550 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f072c0b7020 con 0x7f0730006a40 2024-05-11T01:01:20.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 -- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa1f40763a0 msgr2=0x7fa1f4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa1f40763a0 0x7fa1f4078860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa208161d60 tx=0x7fa1fc008040 comp rx=0 tx=0).stop 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 -- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20806d430 msgr2=0x7fa2081f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20806d430 0x7fa2081f5ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c430 tx=0x7fa1f800c8f0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 -- 172.21.15.16:0/882850267 shutdown_connections 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa1f40763a0 0x7fa1f4078860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20815f500 0x7fa2080ba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2080b72d0 0x7fa2080b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 --2- 172.21.15.16:0/882850267 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa20806d430 0x7fa2081f5ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.708+0000 7fa1edffb640 1 -- 172.21.15.16:0/882850267 >> 172.21.15.16:0/882850267 conn(0x7fa208074140 msgr2=0x7fa2080cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.709+0000 7fa1edffb640 1 -- 172.21.15.16:0/882850267 shutdown_connections 2024-05-11T01:01:20.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.709+0000 7fa1edffb640 1 -- 172.21.15.16:0/882850267 wait complete. 2024-05-11T01:01:20.711 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.712+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f071c0763d0 msgr2=0x7f071c078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.712+0000 7f073efe4640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f071c0763d0 0x7f071c078890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0738065f80 tx=0x7f073806f040 comp rx=0 tx=0).stop 2024-05-11T01:01:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.712+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7feee00763a0 msgr2=0x7feee0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.712+0000 7fef042c8640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7feee00763a0 0x7feee0078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feef8000f60 tx=0x7feef80079b0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.712+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 msgr2=0x7feefc151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.712+0000 7fef042c8640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc151c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feeec00def0 tx=0x7feeec0046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.712+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0730006a40 msgr2=0x7f0730039ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.712+0000 7f073efe4640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0730006a40 0x7f0730039ff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f072c02a850 tx=0x7f072c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 shutdown_connections 2024-05-11T01:01:20.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7fef042c8640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7feee00763a0 0x7feee0078860 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 shutdown_connections 2024-05-11T01:01:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7f073efe4640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f071c0763d0 0x7f071c078890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7f073efe4640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f073004ee80 0x7f07300ea3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7fef042c8640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0d0d00 0x7feefc0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7fef042c8640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0b4710 0x7feefc151c40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7fef042c8640 1 --2- 172.21.15.16:0/1520771936 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc073350 0x7feefc09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 >> 172.21.15.16:0/1520771936 conn(0x7feefc06c5c0 msgr2=0x7feefc15d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7f073efe4640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f073004f4c0 0x7f073004e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7f073efe4640 1 --2- 172.21.15.16:0/21506550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0730006a40 0x7f0730039ff0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 shutdown_connections 2024-05-11T01:01:20.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 >> 172.21.15.16:0/21506550 conn(0x7f073000a3f0 msgr2=0x7f073004f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7fef042c8640 1 -- 172.21.15.16:0/1520771936 wait complete. 2024-05-11T01:01:20.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 shutdown_connections 2024-05-11T01:01:20.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.713+0000 7f073efe4640 1 -- 172.21.15.16:0/21506550 wait complete. 2024-05-11T01:01:20.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.717+0000 7f8dccff9640 1 -- 172.21.15.16:0/2272574027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8dd8050860 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.717+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fca08005580 con 0x7fca2006ecc0 2024-05-11T01:01:20.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.718+0000 7fca167fc640 1 -- 172.21.15.16:0/2483398069 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca1c0605b0 con 0x7fca2006ecc0 2024-05-11T01:01:20.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.718+0000 7f8dceffd640 1 -- 172.21.15.16:0/2272574027 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8dd4085c50 con 0x7f8dd80cfbb0 2024-05-11T01:01:20.718 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-11T01:01:20.719 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:20.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 -- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8dbc076320 msgr2=0x7f8dbc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fca04076320 msgr2=0x7fca040787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8dbc076320 0x7f8dbc0787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8145d50 tx=0x7f8dd00094d0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 -- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cfbb0 msgr2=0x7f8dd8142d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fca04076320 0x7fca040787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca200af590 tx=0x7fca18009040 comp rx=0 tx=0).stop 2024-05-11T01:01:20.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cfbb0 0x7f8dd8142d30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4000c00 tx=0x7f8dd40046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 -- 172.21.15.16:0/2272574027 shutdown_connections 2024-05-11T01:01:20.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8dbc076320 0x7f8dbc0787e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8dd815cf00 0x7f8dd8157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8dd8155820 0x7f8dd81f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 --2- 172.21.15.16:0/2272574027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8dd80cfbb0 0x7f8dd8142d30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7f8dccff9640 1 -- 172.21.15.16:0/2272574027 >> 172.21.15.16:0/2272574027 conn(0x7f8dd80b2b10 msgr2=0x7f8dd80b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 msgr2=0x7fca2015df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca2015df40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00c430 tx=0x7fca1c00c8f0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 shutdown_connections 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fca04076320 0x7fca040787e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fca2015b990 0x7fca201521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca20155ac0 0x7fca200ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 --2- 172.21.15.16:0/2483398069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca2006ecc0 0x7fca2015df40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.722+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 >> 172.21.15.16:0/2483398069 conn(0x7fca200d0f90 msgr2=0x7fca20073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:20.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.723+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 shutdown_connections 2024-05-11T01:01:20.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.723+0000 7f8dccff9640 1 -- 172.21.15.16:0/2272574027 shutdown_connections 2024-05-11T01:01:20.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.723+0000 7fca27f7f640 1 -- 172.21.15.16:0/2483398069 wait complete. 2024-05-11T01:01:20.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:20.723+0000 7f8dccff9640 1 -- 172.21.15.16:0/2272574027 wait complete. 2024-05-11T01:01:20.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-05-11T01:01:20.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-05-11T01:01:20.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-05-11T01:01:20.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-05-11T01:01:20.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-05-11T01:01:20.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-05-11T01:01:20.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-05-11T01:01:20.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-05-11T01:01:21.727 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-11T01:01:21.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-11T01:01:21.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-11T01:01:21.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-11T01:01:21.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-11T01:01:21.739 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-11T01:01:21.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-11T01:01:21.744 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-11T01:01:21.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.904+0000 7f55ef59e640 1 Processor -- start 2024-05-11T01:01:21.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.904+0000 7f55ef59e640 1 -- start start 2024-05-11T01:01:21.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.906+0000 7f55ef59e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f55e804a3d0 0x7f55e8038740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.906+0000 7f55ef59e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e8051bb0 con 0x7f55e80e7a60 2024-05-11T01:01:21.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.906+0000 7f55ef59e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e8051e90 con 0x7f55e80e7680 2024-05-11T01:01:21.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.906+0000 7f55ef59e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f55e80527c0 con 0x7f55e804a3d0 2024-05-11T01:01:21.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.906+0000 7f55ee59c640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f55e80e7680 0x7f55e8052c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:47302/0 (socket says 172.21.15.16:47302) 2024-05-11T01:01:21.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.906+0000 7f55ee59c640 1 -- 172.21.15.16:0/768937685 learned_addr learned my addr 172.21.15.16:0/768937685 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:21.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.906+0000 7f55edd9b640 1 --2- 172.21.15.16:0/768937685 >> v2:172.21.15.16:3300/0 conn(0x7f55e804a3d0 0x7f55e8038740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866221656 0 0) 0x7f55e8051e90 con 0x7f55e80e7680 2024-05-11T01:01:21.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d8003520 con 0x7f55e80e7680 2024-05-11T01:01:21.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 901593547 0 0) 0x7f55d8003520 con 0x7f55e80e7680 2024-05-11T01:01:21.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 >> v2:172.21.15.16:3300/0 conn(0x7f55e804a3d0 msgr2=0x7f55e8038740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 --2- 172.21.15.16:0/768937685 >> v2:172.21.15.16:3300/0 conn(0x7f55e804a3d0 0x7f55e8038740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 >> v1:172.21.15.16:6789/0 conn(0x7f55e80e7a60 legacy=0x7f55e8007bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e8052170 con 0x7f55e80e7680 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55edd9b640 1 --2- 172.21.15.16:0/768937685 >> v2:172.21.15.16:3300/0 conn(0x7f55e804a3d0 0x7f55e8038740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f55e40016f0 con 0x7f55e80e7680 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 >> v1:172.21.15.174:6789/0 conn(0x7f55e80e7680 legacy=0x7f55e8052c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d8003a50 0x7f55d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8004800 0x7f55d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.907+0000 7f55ed59a640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80052e0 0x7f55d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80527c0 con 0x7f55d80052e0 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55d800c1e0 con 0x7f55d8003a50 2024-05-11T01:01:21.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f55d800c3e0 con 0x7f55d8004800 2024-05-11T01:01:21.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55edd9b640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8004800 0x7f55d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ee59c640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d8003a50 0x7f55d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55eed9d640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80052e0 0x7f55d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f6950acf640 1 Processor -- start 2024-05-11T01:01:21.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f6950acf640 1 -- start start 2024-05-11T01:01:21.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ee59c640 1 -- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8004800 msgr2=0x7f55d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ee59c640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8004800 0x7f55d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ee59c640 1 -- 172.21.15.16:0/768937685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80052e0 msgr2=0x7f55d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ee59c640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80052e0 0x7f55d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55ee59c640 1 -- 172.21.15.16:0/768937685 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e8052170 con 0x7f55d8003a50 2024-05-11T01:01:21.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55eed9d640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80052e0 0x7f55d800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:21.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55eed9d640 1 -- 172.21.15.16:0/768937685 reap_dead start 2024-05-11T01:01:21.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.908+0000 7f55edd9b640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8004800 0x7f55d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:21.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.910+0000 7f55ee59c640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d8003a50 0x7f55d8003e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f55e400c240 tx=0x7f55d8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d95f099a79b55e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.911+0000 7f6950acf640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6944049fa0 0x7f6944051840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.911+0000 7f6950acf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944057470 0x7f6944051d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f694a59c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6944049fa0 0x7f6944051840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.911+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4007d70 con 0x7f55d8003a50 2024-05-11T01:01:21.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.911+0000 7f55ed59a640 1 -- 172.21.15.16:0/768937685 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e402e070 con 0x7f55d8003a50 2024-05-11T01:01:21.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f55ef59e640 1 -- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d8003a50 msgr2=0x7f55d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f55ef59e640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d8003a50 0x7f55d8003e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f55e400c240 tx=0x7f55d8005830 comp rx=0 tx=0).stop 2024-05-11T01:01:21.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f694a59c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6944049fa0 0x7f6944051840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50538/0 (socket says 172.21.15.16:50538) 2024-05-11T01:01:21.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f694a59c640 1 -- 172.21.15.16:0/1242855697 learned_addr learned my addr 172.21.15.16:0/1242855697 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f6949d9b640 1 --2- 172.21.15.16:0/1242855697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944057470 0x7f6944051d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f55ef59e640 1 -- 172.21.15.16:0/768937685 shutdown_connections 2024-05-11T01:01:21.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f55ef59e640 1 --2- 172.21.15.16:0/768937685 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55d8003a50 0x7f55d8003e70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f55ef59e640 1 -- 172.21.15.16:0/768937685 >> 172.21.15.16:0/768937685 conn(0x7f55e8053740 msgr2=0x7f55e8053b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:21.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.913+0000 7f6950acf640 1 -- 172.21.15.16:0/1242855697 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69440545b0 con 0x7f694404a380 2024-05-11T01:01:21.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.913+0000 7f6950acf640 1 -- 172.21.15.16:0/1242855697 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f69440513b0 con 0x7f6944049fa0 2024-05-11T01:01:21.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.913+0000 7f6950acf640 1 -- 172.21.15.16:0/1242855697 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6944007c50 con 0x7f6944057470 2024-05-11T01:01:21.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f55ef59e640 1 -- 172.21.15.16:0/768937685 shutdown_connections 2024-05-11T01:01:21.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.912+0000 7f55ef59e640 1 -- 172.21.15.16:0/768937685 wait complete. 2024-05-11T01:01:21.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.914+0000 7f694959a640 1 -- 172.21.15.16:0/1242855697 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012571663 0 0) 0x7f69440545b0 con 0x7f694404a380 2024-05-11T01:01:21.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.914+0000 7f694959a640 1 -- 172.21.15.16:0/1242855697 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6934003520 con 0x7f694404a380 2024-05-11T01:01:21.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.914+0000 7f694a59c640 1 -- 172.21.15.16:0/1242855697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944057470 msgr2=0x7f6944051d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.914+0000 7f694a59c640 1 --2- 172.21.15.16:0/1242855697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944057470 0x7f6944051d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.915+0000 7f55ef59e640 1 Processor -- start 2024-05-11T01:01:21.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.915+0000 7f55ef59e640 1 -- start start 2024-05-11T01:01:21.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.914+0000 7f694a59c640 1 -- 172.21.15.16:0/1242855697 >> v1:172.21.15.16:6789/0 conn(0x7f694404a380 legacy=0x7f69440522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.914+0000 7f694a59c640 1 -- 172.21.15.16:0/1242855697 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6944007f30 con 0x7f6944049fa0 2024-05-11T01:01:21.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.915+0000 7f694a59c640 1 --2- 172.21.15.16:0/1242855697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6944049fa0 0x7f6944051840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6940009870 tx=0x7f694002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded24c1c05c00aca server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.916+0000 7f694959a640 1 -- 172.21.15.16:0/1242855697 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940037070 con 0x7f6944049fa0 2024-05-11T01:01:21.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.916+0000 7f55ef59e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8003a50 0x7f55e80e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.916+0000 7f55ef59e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80e2090 0x7f55e803bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.916+0000 7f55ef59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55e80cc7d0 0x7f55e80ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f55eed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55e80cc7d0 0x7f55e80ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f55eed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55e80cc7d0 0x7f55e80ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40254/0 (socket says 172.21.15.16:40254) 2024-05-11T01:01:21.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.916+0000 7f694959a640 1 -- 172.21.15.16:0/1242855697 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6940032440 con 0x7f6944049fa0 2024-05-11T01:01:21.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.916+0000 7f694959a640 1 -- 172.21.15.16:0/1242855697 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400327f0 con 0x7f6944049fa0 2024-05-11T01:01:21.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f6950acf640 1 -- 172.21.15.16:0/1242855697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6944049fa0 msgr2=0x7f6944051840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f6950acf640 1 --2- 172.21.15.16:0/1242855697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6944049fa0 0x7f6944051840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6940009870 tx=0x7f694002a270 comp rx=0 tx=0).stop 2024-05-11T01:01:21.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f55ee59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8003a50 0x7f55e80e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f55ee59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8003a50 0x7f55e80e6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57730/0 (socket says 172.21.15.16:57730) 2024-05-11T01:01:21.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f55eed9d640 1 -- 172.21.15.16:0/3530148434 learned_addr learned my addr 172.21.15.16:0/3530148434 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f6950acf640 1 -- 172.21.15.16:0/1242855697 shutdown_connections 2024-05-11T01:01:21.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f6950acf640 1 --2- 172.21.15.16:0/1242855697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944057470 0x7f6944051d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f6950acf640 1 --2- 172.21.15.16:0/1242855697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6944049fa0 0x7f6944051840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f6950acf640 1 -- 172.21.15.16:0/1242855697 >> 172.21.15.16:0/1242855697 conn(0x7f6944020030 msgr2=0x7f6944056d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:21.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f6950acf640 1 -- 172.21.15.16:0/1242855697 shutdown_connections 2024-05-11T01:01:21.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.917+0000 7f6950acf640 1 -- 172.21.15.16:0/1242855697 wait complete. 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.918+0000 7f55ef59e640 1 -- 172.21.15.16:0/3530148434 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80517d0 con 0x7f55e80cc7d0 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.918+0000 7f55ef59e640 1 -- 172.21.15.16:0/3530148434 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f55e8055be0 con 0x7f55e80e2090 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.919+0000 7f55ef59e640 1 -- 172.21.15.16:0/3530148434 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f55e8051950 con 0x7f55d8003a50 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.919+0000 7f55edd9b640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80e2090 0x7f55e803bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.919+0000 7f55ee59c640 1 -- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80e2090 msgr2=0x7f55e803bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.919+0000 7f55ee59c640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80e2090 0x7f55e803bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.919+0000 7f55ee59c640 1 -- 172.21.15.16:0/3530148434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55e80cc7d0 msgr2=0x7f55e80ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.919+0000 7f55ee59c640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55e80cc7d0 0x7f55e80ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.919+0000 7f55ee59c640 1 -- 172.21.15.16:0/3530148434 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e80506e0 con 0x7f55d8003a50 2024-05-11T01:01:21.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.920+0000 7f6950acf640 1 Processor -- start 2024-05-11T01:01:21.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.920+0000 7f55ee59c640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8003a50 0x7f55e80e6a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55e4001920 tx=0x7f55e4001890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.920+0000 7f6950acf640 1 -- start start 2024-05-11T01:01:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.921+0000 7f6950acf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944049fa0 0x7f69440da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.921+0000 7f6950acf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f694404a380 0x7f6944033e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.920+0000 7f55deffd640 1 -- 172.21.15.16:0/3530148434 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4041020 con 0x7f55d8003a50 2024-05-11T01:01:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.920+0000 7f55deffd640 1 -- 172.21.15.16:0/3530148434 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e4007280 con 0x7f55d8003a50 2024-05-11T01:01:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.920+0000 7f55deffd640 1 -- 172.21.15.16:0/3530148434 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e4007630 con 0x7f55d8003a50 2024-05-11T01:01:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.921+0000 7f55ef59e640 1 -- 172.21.15.16:0/3530148434 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e80e2510 con 0x7f55d8003a50 2024-05-11T01:01:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.921+0000 7f55ef59e640 1 -- 172.21.15.16:0/3530148434 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e80e5f60 con 0x7f55d8003a50 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f694a59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944049fa0 0x7f69440da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f694a59c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944049fa0 0x7f69440da0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57740/0 (socket says 172.21.15.16:57740) 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f6950acf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6944057470 0x7f694404c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f6949d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f694404a380 0x7f6944033e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f6949d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f694404a380 0x7f6944033e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50556/0 (socket says 172.21.15.16:50556) 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f694ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6944057470 0x7f694404c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f694ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6944057470 0x7f694404c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40270/0 (socket says 172.21.15.16:40270) 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f694a59c640 1 -- 172.21.15.16:0/1417121929 learned_addr learned my addr 172.21.15.16:0/1417121929 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.922+0000 7f6950acf640 1 -- 172.21.15.16:0/1417121929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69440529d0 con 0x7f6944057470 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.923+0000 7f6950acf640 1 -- 172.21.15.16:0/1417121929 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6944038570 con 0x7f694404a380 2024-05-11T01:01:21.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.923+0000 7f6950acf640 1 -- 172.21.15.16:0/1417121929 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6944052b50 con 0x7f6944049fa0 2024-05-11T01:01:21.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.923+0000 7f55ef59e640 1 -- 172.21.15.16:0/3530148434 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e80057d0 con 0x7f55d8003a50 2024-05-11T01:01:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.923+0000 7f6949d9b640 1 -- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944049fa0 msgr2=0x7f69440da0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.923+0000 7f6949d9b640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944049fa0 0x7f69440da0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.923+0000 7f6949d9b640 1 -- 172.21.15.16:0/1417121929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6944057470 msgr2=0x7f694404c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.924+0000 7f6949d9b640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6944057470 0x7f694404c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.924+0000 7f6949d9b640 1 -- 172.21.15.16:0/1417121929 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69440da620 con 0x7f694404a380 2024-05-11T01:01:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.924+0000 7f694ad9d640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6944057470 0x7f694404c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.924+0000 7f6949d9b640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f694404a380 0x7f6944033e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f693c00e870 tx=0x7f693c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.924+0000 7f693affd640 1 -- 172.21.15.16:0/1417121929 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c017070 con 0x7f694404a380 2024-05-11T01:01:21.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.925+0000 7f6950acf640 1 -- 172.21.15.16:0/1417121929 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69440dc9e0 con 0x7f694404a380 2024-05-11T01:01:21.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.925+0000 7f55deffd640 1 -- 172.21.15.16:0/3530148434 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f55e4044020 con 0x7f55d8003a50 2024-05-11T01:01:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.925+0000 7f6950acf640 1 -- 172.21.15.16:0/1417121929 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69440dcfa0 con 0x7f694404a380 2024-05-11T01:01:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.926+0000 7f693affd640 1 -- 172.21.15.16:0/1417121929 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f693c00ee60 con 0x7f694404a380 2024-05-11T01:01:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.926+0000 7f693affd640 1 -- 172.21.15.16:0/1417121929 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c00cb60 con 0x7f694404a380 2024-05-11T01:01:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.926+0000 7f55deffd640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f55d00763d0 0x7f55d0078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.926+0000 7f55deffd640 1 -- 172.21.15.16:0/3530148434 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f55e40b8360 con 0x7f55d8003a50 2024-05-11T01:01:21.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.926+0000 7f55edd9b640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f55d00763d0 0x7f55d0078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.927+0000 7f55edd9b640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f55d00763d0 0x7f55d0078890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55e804b140 tx=0x7f55e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.928+0000 7f6950acf640 1 -- 172.21.15.16:0/1417121929 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69440057d0 con 0x7f694404a380 2024-05-11T01:01:21.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.928+0000 7f693affd640 1 -- 172.21.15.16:0/1417121929 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f693c01a070 con 0x7f694404a380 2024-05-11T01:01:21.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.929+0000 7f55deffd640 1 -- 172.21.15.16:0/3530148434 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f55e404b020 con 0x7f55d8003a50 2024-05-11T01:01:21.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.929+0000 7f693affd640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f692c076320 0x7f692c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.930+0000 7f693affd640 1 -- 172.21.15.16:0/1417121929 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f693c0972a0 con 0x7f694404a380 2024-05-11T01:01:21.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.931+0000 7f694a59c640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f692c076320 0x7f692c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.931+0000 7f694a59c640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f692c076320 0x7f692c0787e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6940035040 tx=0x7f694002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.934+0000 7f693affd640 1 -- 172.21.15.16:0/1417121929 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f693c060610 con 0x7f694404a380 2024-05-11T01:01:21.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.955+0000 7fbf76fa6640 1 Processor -- start 2024-05-11T01:01:21.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.955+0000 7fbf76fa6640 1 -- start start 2024-05-11T01:01:21.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7f050bfbe640 1 Processor -- start 2024-05-11T01:01:21.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7fbf76fa6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf70155820 0x7fbf7015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7fbf76fa6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbf7015cf00 0x7fbf700cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7fbf76fa6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf70074160 con 0x7fbf700b3600 2024-05-11T01:01:21.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7fbf76fa6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fbf700cf010 con 0x7fbf7015cf00 2024-05-11T01:01:21.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7fbf76fa6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7015c3e0 con 0x7fbf70155820 2024-05-11T01:01:21.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7fbf757a3640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbf7015cf00 0x7fbf700cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7fbf757a3640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbf7015cf00 0x7fbf700cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50558/0 (socket says 172.21.15.16:50558) 2024-05-11T01:01:21.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7fbf757a3640 1 -- 172.21.15.16:0/322290672 learned_addr learned my addr 172.21.15.16:0/322290672 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.958+0000 7fbf75fa4640 1 --2- 172.21.15.16:0/322290672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf70155820 0x7fbf7015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.957+0000 7f050bfbe640 1 -- start start 2024-05-11T01:01:21.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.958+0000 7fbf757a3640 1 -- 172.21.15.16:0/322290672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf70155820 msgr2=0x7fbf7015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.958+0000 7fbf757a3640 1 --2- 172.21.15.16:0/322290672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf70155820 0x7fbf7015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.958+0000 7fbf757a3640 1 -- 172.21.15.16:0/322290672 >> v1:172.21.15.174:6789/0 conn(0x7fbf700b3600 legacy=0x7fbf7015b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.958+0000 7fbf757a3640 1 -- 172.21.15.16:0/322290672 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7015c6c0 con 0x7fbf7015cf00 2024-05-11T01:01:21.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050bfbe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 0x7f04fc052ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050bfbe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f04fc048c30 0x7f04fc049050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050bfbe640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f04fc0eb290 0x7f04fc0eb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050bfbe640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f04fc049590 con 0x7f04fc048c30 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050bfbe640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f04fc009560 con 0x7f04fc0eb290 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050bfbe640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc035960 con 0x7f04fc009180 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f0509d5a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 0x7f04fc052ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050a55b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f04fc0eb290 0x7f04fc0eb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f0509559640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f04fc048c30 0x7f04fc049050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050a55b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f04fc0eb290 0x7f04fc0eb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50572/0 (socket says 172.21.15.16:50572) 2024-05-11T01:01:21.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050a55b640 1 -- 172.21.15.16:0/1305082353 learned_addr learned my addr 172.21.15.16:0/1305082353 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f43ee94a640 1 Processor -- start 2024-05-11T01:01:21.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050a55b640 1 -- 172.21.15.16:0/1305082353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 msgr2=0x7f04fc052ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050a55b640 1 --2- 172.21.15.16:0/1305082353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 0x7f04fc052ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.959+0000 7f050a55b640 1 -- 172.21.15.16:0/1305082353 >> v2:172.21.15.16:3300/0 conn(0x7f04fc048c30 msgr2=0x7f04fc049050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7f050a55b640 1 --2- 172.21.15.16:0/1305082353 >> v2:172.21.15.16:3300/0 conn(0x7f04fc048c30 0x7f04fc049050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7f050a55b640 1 -- 172.21.15.16:0/1305082353 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc035c20 con 0x7f04fc0eb290 2024-05-11T01:01:21.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7fbf757a3640 1 --2- 172.21.15.16:0/322290672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 0x7fbf700cf4a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800d150 tx=0x7fbf6802c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad291a1d964163d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7f966b4da640 1 Processor -- start 2024-05-11T01:01:21.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7fbf74fa2640 1 -- 172.21.15.16:0/322290672 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68039070 con 0x7fbf7015cf00 2024-05-11T01:01:21.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7fbf74fa2640 1 -- 172.21.15.16:0/322290672 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68009600 con 0x7fbf7015cf00 2024-05-11T01:01:21.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7fbf74fa2640 1 -- 172.21.15.16:0/322290672 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680099d0 con 0x7fbf7015cf00 2024-05-11T01:01:21.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7f966b4da640 1 -- start start 2024-05-11T01:01:21.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7f0509559640 1 --2- 172.21.15.16:0/1305082353 >> v2:172.21.15.16:3300/0 conn(0x7f04fc048c30 0x7f04fc049050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:21.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.960+0000 7f43ee94a640 1 -- start start 2024-05-11T01:01:21.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f050a55b640 1 --2- 172.21.15.16:0/1305082353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc0eb290 0x7f04fc0eb6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f050406ac20 tx=0x7f05040a6860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cfda2fdabb976d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f0508d58640 1 -- 172.21.15.16:0/1305082353 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040ac620 con 0x7f04fc0eb290 2024-05-11T01:01:21.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f0508d58640 1 -- 172.21.15.16:0/1305082353 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05040ac800 con 0x7f04fc0eb290 2024-05-11T01:01:21.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f966b4da640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f966b4da640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96640b7530 0x7f96640d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f966b4da640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96641639f0 con 0x7f9664163210 2024-05-11T01:01:21.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f966b4da640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f96640d3700 con 0x7f96640b7530 2024-05-11T01:01:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f966b4da640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9664163cd0 con 0x7f9664162d30 2024-05-11T01:01:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 -- 172.21.15.16:0/1305082353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc0eb290 msgr2=0x7f04fc0eb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1305082353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc0eb290 0x7f04fc0eb6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f050406ac20 tx=0x7f05040a6860 comp rx=0 tx=0).stop 2024-05-11T01:01:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7fbf76fa6640 1 -- 172.21.15.16:0/322290672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 msgr2=0x7fbf700cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/322290672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 0x7fbf700cf4a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800d150 tx=0x7fbf6802c880 comp rx=0 tx=0).stop 2024-05-11T01:01:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f9669a77640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96640b7530 0x7f96640d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f9669a77640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96640b7530 0x7f96640d3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40304/0 (socket says 172.21.15.16:40304) 2024-05-11T01:01:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f9669a77640 1 -- 172.21.15.16:0/3710579723 learned_addr learned my addr 172.21.15.16:0/3710579723 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f9669276640 1 --2- 172.21.15.16:0/3710579723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f9669a77640 1 -- 172.21.15.16:0/3710579723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 msgr2=0x7f96640baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f9669a77640 1 --2- 172.21.15.16:0/3710579723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f9669a77640 1 -- 172.21.15.16:0/3710579723 >> v1:172.21.15.16:6789/0 conn(0x7f9664163210 legacy=0x7f96640b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 -- 172.21.15.16:0/1305082353 shutdown_connections 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f43ee94a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f43e000aa90 0x7f43e004fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f43ee94a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f43e004ffc0 0x7f43e0054260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f43ee94a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e0006ae0 con 0x7f43e00df380 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f43ee94a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f43e0006890 con 0x7f43e000aa90 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f43ee94a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f43e0006dc0 con 0x7f43e004ffc0 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f43ed147640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f43e00df380 0x7f43e00382b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:48880/0 (socket says 172.21.15.16:48880) 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.961+0000 7f43ed147640 1 -- 172.21.15.16:0/2797754510 learned_addr learned my addr 172.21.15.16:0/2797754510 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233619915 0 0) 0x7f43e0006ae0 con 0x7f43e00df380 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43d4003520 con 0x7f43e00df380 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1458617001 0 0) 0x7f43d4003520 con 0x7f43e00df380 2024-05-11T01:01:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 >> v2:172.21.15.174:3300/0 conn(0x7f43e004ffc0 msgr2=0x7f43e0054260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-11T01:01:21.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1305082353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc0eb290 0x7f04fc0eb6a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1305082353 >> v2:172.21.15.16:3300/0 conn(0x7f04fc048c30 0x7f04fc049050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1305082353 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 0x7f04fc052ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 -- 172.21.15.16:0/1305082353 >> 172.21.15.16:0/1305082353 conn(0x7f04fc01ef30 msgr2=0x7f04fc055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:21.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 --2- 172.21.15.16:0/2797754510 >> v2:172.21.15.174:3300/0 conn(0x7f43e004ffc0 0x7f43e0054260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 >> v2:172.21.15.16:3300/0 conn(0x7f43e000aa90 msgr2=0x7f43e004fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 --2- 172.21.15.16:0/2797754510 >> v2:172.21.15.16:3300/0 conn(0x7f43e000aa90 0x7f43e004fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00070a0 con 0x7f43e00df380 2024-05-11T01:01:21.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f43e8076a40 con 0x7f43e00df380 2024-05-11T01:01:21.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 -- 172.21.15.16:0/1305082353 shutdown_connections 2024-05-11T01:01:21.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 >> v1:172.21.15.16:6789/0 conn(0x7f43e00df380 legacy=0x7f43e00382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f43ec946640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40039b0 0x7f43d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ec946640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 0x7f43d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ec946640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43d40051c0 0x7f43d401c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0006890 con 0x7f43d40039b0 2024-05-11T01:01:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0006dc0 con 0x7f43d40051c0 2024-05-11T01:01:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f43d401d100 con 0x7f43d4004800 2024-05-11T01:01:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ed147640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 0x7f43d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ee149640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43d40051c0 0x7f43d401c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f050bfbe640 1 -- 172.21.15.16:0/1305082353 wait complete. 2024-05-11T01:01:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f865d53c640 1 Processor -- start 2024-05-11T01:01:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.962+0000 7f865d53c640 1 -- start start 2024-05-11T01:01:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865d53c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8650048040 0x7f865004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ed147640 1 -- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43d40051c0 msgr2=0x7f43d401c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f9669a77640 1 -- 172.21.15.16:0/3710579723 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9664163fb0 con 0x7f96640b7530 2024-05-11T01:01:21.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f9669a77640 1 --2- 172.21.15.16:0/3710579723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 0x7f96640d3e70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9654009ad0 tx=0x7f965402a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7e0d1db12840bb server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ed147640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43d40051c0 0x7f43d401c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ed147640 1 -- 172.21.15.16:0/2797754510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40039b0 msgr2=0x7f43d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ed147640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d40039b0 0x7f43d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.963+0000 7f43ed147640 1 -- 172.21.15.16:0/2797754510 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00070a0 con 0x7f43d4004800 2024-05-11T01:01:21.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f43ee149640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43d40051c0 0x7f43d401c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:21.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f43ee149640 1 -- 172.21.15.16:0/2797754510 reap_dead start 2024-05-11T01:01:21.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f43ed147640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 0x7f43d4004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f43e80520f0 tx=0x7f43d4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb4f8490d5d658d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f9669276640 1 --2- 172.21.15.16:0/3710579723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:21.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865d53c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8650038720 0x7f8650006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865d53c640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8650048420 con 0x7f8650037bb0 2024-05-11T01:01:21.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865d53c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f86500547a0 con 0x7f8650048040 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865d53c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8650053700 con 0x7f8650038720 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865cd3b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8650038720 0x7f8650006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865cd3b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8650038720 0x7f8650006ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50596/0 (socket says 172.21.15.16:50596) 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865cd3b640 1 -- 172.21.15.16:0/3133441846 learned_addr learned my addr 172.21.15.16:0/3133441846 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f8657fff640 1 --2- 172.21.15.16:0/3133441846 >> v2:172.21.15.16:3300/0 conn(0x7f8650048040 0x7f865004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865cd3b640 1 -- 172.21.15.16:0/3133441846 >> v2:172.21.15.16:3300/0 conn(0x7f8650048040 msgr2=0x7f865004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865cd3b640 1 --2- 172.21.15.16:0/3133441846 >> v2:172.21.15.16:3300/0 conn(0x7f8650048040 0x7f865004fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865cd3b640 1 -- 172.21.15.16:0/3133441846 >> v1:172.21.15.16:6789/0 conn(0x7f8650037bb0 legacy=0x7f8650038010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f865cd3b640 1 -- 172.21.15.16:0/3133441846 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86500539e0 con 0x7f8650038720 2024-05-11T01:01:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f965bfff640 1 -- 172.21.15.16:0/3710579723 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654036070 con 0x7f96640b7530 2024-05-11T01:01:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f965bfff640 1 -- 172.21.15.16:0/3710579723 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9654031600 con 0x7f96640b7530 2024-05-11T01:01:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f050bfbe640 1 Processor -- start 2024-05-11T01:01:21.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f865cd3b640 1 --2- 172.21.15.16:0/3133441846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 0x7f8650006ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f865806af20 tx=0x7f86580a6900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cdf70beaf48b37b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f050bfbe640 1 -- start start 2024-05-11T01:01:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.964+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80b4070 con 0x7f43d4004800 2024-05-11T01:01:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e80a7cb0 con 0x7f43d4004800 2024-05-11T01:01:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f43ec946640 1 -- 172.21.15.16:0/2797754510 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e8069510 con 0x7f43d4004800 2024-05-11T01:01:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f43ee94a640 1 -- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 msgr2=0x7f43d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7f43ee94a640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 0x7f43d4004c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f43e80520f0 tx=0x7f43d4005830 comp rx=0 tx=0).stop 2024-05-11T01:01:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f43ee94a640 1 -- 172.21.15.16:0/2797754510 shutdown_connections 2024-05-11T01:01:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f43ee94a640 1 --2- 172.21.15.16:0/2797754510 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 0x7f43d4004c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f43ee94a640 1 -- 172.21.15.16:0/2797754510 >> 172.21.15.16:0/2797754510 conn(0x7f43e0009fa0 msgr2=0x7f43e000a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f965bfff640 1 -- 172.21.15.16:0/3710579723 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540319b0 con 0x7f96640b7530 2024-05-11T01:01:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7fbf76fa6640 1 -- 172.21.15.16:0/322290672 shutdown_connections 2024-05-11T01:01:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/322290672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 0x7fbf700cf4a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/322290672 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf70155820 0x7fbf7015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.965+0000 7fbf76fa6640 1 -- 172.21.15.16:0/322290672 >> 172.21.15.16:0/322290672 conn(0x7fbf700b2b10 msgr2=0x7fbf700b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f8656ffd640 1 -- 172.21.15.16:0/3133441846 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580b0020 con 0x7f8650038720 2024-05-11T01:01:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f8656ffd640 1 -- 172.21.15.16:0/3133441846 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580ac900 con 0x7f8650038720 2024-05-11T01:01:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f8656ffd640 1 -- 172.21.15.16:0/3133441846 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580acdb0 con 0x7f8650038720 2024-05-11T01:01:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f966b4da640 1 -- 172.21.15.16:0/3710579723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 msgr2=0x7f96640d3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f966b4da640 1 --2- 172.21.15.16:0/3710579723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 0x7f96640d3e70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9654009ad0 tx=0x7f965402a3e0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7fbf76fa6640 1 -- 172.21.15.16:0/322290672 shutdown_connections 2024-05-11T01:01:21.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f43ee94a640 1 -- 172.21.15.16:0/2797754510 shutdown_connections 2024-05-11T01:01:21.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7fbf76fa6640 1 -- 172.21.15.16:0/322290672 wait complete. 2024-05-11T01:01:21.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.966+0000 7f43ee94a640 1 -- 172.21.15.16:0/2797754510 wait complete. 2024-05-11T01:01:21.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f050bfbe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 0x7f04fc04d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f966b4da640 1 -- 172.21.15.16:0/3710579723 shutdown_connections 2024-05-11T01:01:21.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f966b4da640 1 --2- 172.21.15.16:0/3710579723 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 0x7f96640d3e70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f966b4da640 1 --2- 172.21.15.16:0/3710579723 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f966b4da640 1 -- 172.21.15.16:0/3710579723 >> 172.21.15.16:0/3710579723 conn(0x7f96640d1e20 msgr2=0x7f96640d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:21.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f050bfbe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc048c30 0x7f04fc0ea390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f865d53c640 1 -- 172.21.15.16:0/3133441846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 msgr2=0x7f8650006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f865d53c640 1 --2- 172.21.15.16:0/3133441846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 0x7f8650006ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f865806af20 tx=0x7f86580a6900 comp rx=0 tx=0).stop 2024-05-11T01:01:21.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f966b4da640 1 -- 172.21.15.16:0/3710579723 shutdown_connections 2024-05-11T01:01:21.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f966b4da640 1 -- 172.21.15.16:0/3710579723 wait complete. 2024-05-11T01:01:21.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f865d53c640 1 -- 172.21.15.16:0/3133441846 shutdown_connections 2024-05-11T01:01:21.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f865d53c640 1 --2- 172.21.15.16:0/3133441846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 0x7f8650006ea0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f865d53c640 1 --2- 172.21.15.16:0/3133441846 >> v2:172.21.15.16:3300/0 conn(0x7f8650048040 0x7f865004fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f865d53c640 1 -- 172.21.15.16:0/3133441846 >> 172.21.15.16:0/3133441846 conn(0x7f8650009fb0 msgr2=0x7f865000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:21.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f865d53c640 1 -- 172.21.15.16:0/3133441846 shutdown_connections 2024-05-11T01:01:21.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.967+0000 7f865d53c640 1 -- 172.21.15.16:0/3133441846 wait complete. 2024-05-11T01:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.968+0000 7f43ee94a640 1 Processor -- start 2024-05-11T01:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.968+0000 7f43ee94a640 1 -- start start 2024-05-11T01:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.968+0000 7f82507f7640 1 Processor -- start 2024-05-11T01:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.968+0000 7fbf76fa6640 1 Processor -- start 2024-05-11T01:01:21.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.968+0000 7fbf76fa6640 1 -- start start 2024-05-11T01:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f966b4da640 1 Processor -- start 2024-05-11T01:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f43ee94a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 0x7f43e00cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f43ee94a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43e00cd5c0 0x7f43e00499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f43ee94a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43e0049f10 0x7f43e004bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f865d53c640 1 Processor -- start 2024-05-11T01:01:21.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f43ed147640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43e00cd5c0 0x7f43e00499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f43ed147640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43e00cd5c0 0x7f43e00499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50614/0 (socket says 172.21.15.16:50614) 2024-05-11T01:01:21.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f43ed147640 1 -- 172.21.15.16:0/4128461709 learned_addr learned my addr 172.21.15.16:0/4128461709 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f43ee94a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0052cb0 con 0x7f43e0049f10 2024-05-11T01:01:21.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f43ee94a640 1 -- 172.21.15.16:0/4128461709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0052b30 con 0x7f43e00cd5c0 2024-05-11T01:01:21.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f43ee94a640 1 -- 172.21.15.16:0/4128461709 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f43e004fa80 con 0x7f43d4004800 2024-05-11T01:01:21.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f43ee149640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43e0049f10 0x7f43e004bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f865d53c640 1 -- start start 2024-05-11T01:01:21.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.968+0000 7f82507f7640 1 -- start start 2024-05-11T01:01:21.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f82507f7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f824815aad0 0x7f824806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f82507f7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f82480b5130 0x7f82480b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f966b4da640 1 -- start start 2024-05-11T01:01:21.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f966b4da640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 0x7f96640cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f966b4da640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f966b4da640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664163210 0x7f966414c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f966b4da640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f96640d43b0 con 0x7f96640b7530 2024-05-11T01:01:21.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f966b4da640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9664163670 con 0x7f9664163210 2024-05-11T01:01:21.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f966b4da640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f96640d4530 con 0x7f9664162d30 2024-05-11T01:01:21.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f82507f7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82481681a0 con 0x7f82481673e0 2024-05-11T01:01:21.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7fbf76fa6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf700b3600 0x7fbf70153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7fbf76fa6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf70155820 0x7fbf700ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7fbf76fa6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 0x7fbf700aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7fbf76fa6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbf700ce8c0 con 0x7fbf70155820 2024-05-11T01:01:21.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7fbf76fa6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbf70155c00 con 0x7fbf7015cf00 2024-05-11T01:01:21.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7fbf76fa6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbf700cea40 con 0x7fbf700b3600 2024-05-11T01:01:21.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f82507f7640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f824806ebc0 con 0x7f824815aad0 2024-05-11T01:01:21.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f82507f7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f82480b5ca0 con 0x7f82480b5130 2024-05-11T01:01:21.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f824dd92640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f82480b5130 0x7f82480b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f9668a75640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f9668a75640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:57810/0 (socket says 172.21.15.16:57810) 2024-05-11T01:01:21.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f9668a75640 1 -- 172.21.15.16:0/3948223615 learned_addr learned my addr 172.21.15.16:0/3948223615 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f824dd92640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f82480b5130 0x7f82480b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50628/0 (socket says 172.21.15.16:50628) 2024-05-11T01:01:21.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f824dd92640 1 -- 172.21.15.16:0/2947985945 learned_addr learned my addr 172.21.15.16:0/2947985945 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f824e593640 1 --2- 172.21.15.16:0/2947985945 >> v2:172.21.15.16:3300/0 conn(0x7f824815aad0 0x7f824806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f9669a77640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664163210 0x7f966414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f824dd92640 1 -- 172.21.15.16:0/2947985945 >> v2:172.21.15.16:3300/0 conn(0x7f824815aad0 msgr2=0x7f824806c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:21.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f43ed147640 1 -- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 msgr2=0x7f43e00cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f43ed147640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 0x7f43e00cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f43ed147640 1 -- 172.21.15.16:0/4128461709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43e0049f10 msgr2=0x7f43e004bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f43ed147640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43e0049f10 0x7f43e004bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f43ed147640 1 -- 172.21.15.16:0/4128461709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00e0f50 con 0x7f43e00cd5c0 2024-05-11T01:01:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f050bfbe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04fc0eb290 0x7f04fc04f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f050bfbe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0364c0 con 0x7f04fc0eb290 2024-05-11T01:01:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f050bfbe640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0361e0 con 0x7f04fc048c30 2024-05-11T01:01:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f050bfbe640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f04fc0367a0 con 0x7f04fc009180 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f0509559640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc048c30 0x7f04fc0ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f0509559640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc048c30 0x7f04fc0ea390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50610/0 (socket says 172.21.15.16:50610) 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f0509559640 1 -- 172.21.15.16:0/1584089089 learned_addr learned my addr 172.21.15.16:0/1584089089 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f050a55b640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04fc0eb290 0x7f04fc04f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f0509559640 1 -- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 msgr2=0x7f04fc04d160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f0509559640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 0x7f04fc04d160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.969+0000 7f0509559640 1 -- 172.21.15.16:0/1584089089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04fc0eb290 msgr2=0x7f04fc04f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f0509559640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04fc0eb290 0x7f04fc04f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f0509559640 1 -- 172.21.15.16:0/1584089089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc050390 con 0x7f04fc048c30 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f050a55b640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04fc0eb290 0x7f04fc04f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.970+0000 7f0509559640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc048c30 0x7f04fc0ea390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04f400e9b0 tx=0x7f04f400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f04fa7fc640 1 -- 172.21.15.16:0/1584089089 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4017070 con 0x7f04fc048c30 2024-05-11T01:01:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f04fa7fc640 1 -- 172.21.15.16:0/1584089089 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f400ca00 con 0x7f04fc048c30 2024-05-11T01:01:21.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f04fa7fc640 1 -- 172.21.15.16:0/1584089089 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f400cdd0 con 0x7f04fc048c30 2024-05-11T01:01:21.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f824dd92640 1 --2- 172.21.15.16:0/2947985945 >> v2:172.21.15.16:3300/0 conn(0x7f824815aad0 0x7f824806c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f824dd92640 1 -- 172.21.15.16:0/2947985945 >> v1:172.21.15.174:6789/0 conn(0x7f82481673e0 legacy=0x7f824806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc050600 con 0x7f04fc048c30 2024-05-11T01:01:21.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc050bc0 con 0x7f04fc048c30 2024-05-11T01:01:21.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f824dd92640 1 -- 172.21.15.16:0/2947985945 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480b5f80 con 0x7f82480b5130 2024-05-11T01:01:21.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f9669276640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 0x7f96640cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.971+0000 7f865d53c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8650037bb0 0x7f86500c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f865d53c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 0x7f86500cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f865d53c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8650048040 0x7f86500cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:21.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf75fa4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf700b3600 0x7fbf70153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf757a3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf70155820 0x7fbf700ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf757a3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf70155820 0x7fbf700ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40380/0 (socket says 172.21.15.16:40380) 2024-05-11T01:01:21.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf757a3640 1 -- 172.21.15.16:0/3516459779 learned_addr learned my addr 172.21.15.16:0/3516459779 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf767a5640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 0x7fbf700aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f43ed147640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43e00cd5c0 0x7f43e00499d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f43e8064020 tx=0x7f43e8075050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:21.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f8657fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8650037bb0 0x7f86500c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f865d53c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8650054280 con 0x7f8650037bb0 2024-05-11T01:01:21.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f8657fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8650037bb0 0x7f86500c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40388/0 (socket says 172.21.15.16:40388) 2024-05-11T01:01:21.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f8657fff640 1 -- 172.21.15.16:0/1152220615 learned_addr learned my addr 172.21.15.16:0/1152220615 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8650053fa0 con 0x7f8650038720 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f865004ffd0 con 0x7f8650048040 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f86577fe640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 0x7f86500cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f865cd3b640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8650048040 0x7f86500cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f9668a75640 1 -- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664163210 msgr2=0x7f966414c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f9668a75640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664163210 0x7f966414c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f9668a75640 1 -- 172.21.15.16:0/3948223615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 msgr2=0x7f96640cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f9668a75640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 0x7f96640cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f9668a75640 1 -- 172.21.15.16:0/3948223615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966414ff00 con 0x7f9664162d30 2024-05-11T01:01:21.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f9668a75640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640cec10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f966000c3d0 tx=0x7f966000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f824dd92640 1 --2- 172.21.15.16:0/2947985945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82480b5130 0x7f82480b5590 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8248071710 tx=0x7f824002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e62335ee8d85f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f43de7fc640 1 -- 172.21.15.16:0/4128461709 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80b4050 con 0x7f43e00cd5c0 2024-05-11T01:01:22.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f43de7fc640 1 -- 172.21.15.16:0/4128461709 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e80c0070 con 0x7f43e00cd5c0 2024-05-11T01:01:22.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f43de7fc640 1 -- 172.21.15.16:0/4128461709 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e80a7e60 con 0x7f43e00cd5c0 2024-05-11T01:01:22.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f43ee94a640 1 -- 172.21.15.16:0/4128461709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e004a7e0 con 0x7f43e00cd5c0 2024-05-11T01:01:22.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f43ee94a640 1 -- 172.21.15.16:0/4128461709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e004ada0 con 0x7f43e00cd5c0 2024-05-11T01:01:22.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc0057d0 con 0x7f04fc048c30 2024-05-11T01:01:22.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf75fa4640 1 -- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 msgr2=0x7fbf700aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf75fa4640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 0x7fbf700aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf75fa4640 1 -- 172.21.15.16:0/3516459779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf70155820 msgr2=0x7fbf700ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf75fa4640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf70155820 0x7fbf700ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7fbf75fa4640 1 -- 172.21.15.16:0/3516459779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf701537b0 con 0x7fbf700b3600 2024-05-11T01:01:22.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f9659ffb640 1 -- 172.21.15.16:0/3948223615 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660017070 con 0x7f9664162d30 2024-05-11T01:01:22.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f865cd3b640 1 -- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 msgr2=0x7f86500cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f865cd3b640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 0x7f86500cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f865cd3b640 1 -- 172.21.15.16:0/1152220615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8650037bb0 msgr2=0x7f86500c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f865cd3b640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8650037bb0 0x7f86500c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f865cd3b640 1 -- 172.21.15.16:0/1152220615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86500c88e0 con 0x7f8650048040 2024-05-11T01:01:22.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7fbf75fa4640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf700b3600 0x7fbf70153270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00d620 tx=0x7fbf6c00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7fbf667fc640 1 -- 172.21.15.16:0/3516459779 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00b620 con 0x7fbf700b3600 2024-05-11T01:01:22.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7fbf667fc640 1 -- 172.21.15.16:0/3516459779 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6c019070 con 0x7fbf700b3600 2024-05-11T01:01:22.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7fbf667fc640 1 -- 172.21.15.16:0/3516459779 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00b9e0 con 0x7fbf700b3600 2024-05-11T01:01:22.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf701f10b0 con 0x7fbf700b3600 2024-05-11T01:01:22.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf701f1670 con 0x7fbf700b3600 2024-05-11T01:01:22.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f865cd3b640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8650048040 0x7f86500cc7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f865806b330 tx=0x7f8658076980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f824d591640 1 -- 172.21.15.16:0/2947985945 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240036070 con 0x7f82480b5130 2024-05-11T01:01:22.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f824d591640 1 -- 172.21.15.16:0/2947985945 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8240031600 con 0x7f82480b5130 2024-05-11T01:01:22.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f824d591640 1 -- 172.21.15.16:0/2947985945 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82400319d0 con 0x7f82480b5130 2024-05-11T01:01:22.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.972+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96641501e0 con 0x7f9664162d30 2024-05-11T01:01:22.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96641507a0 con 0x7f9664162d30 2024-05-11T01:01:22.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f9659ffb640 1 -- 172.21.15.16:0/3948223615 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96600052d0 con 0x7f9664162d30 2024-05-11T01:01:22.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.973+0000 7f9659ffb640 1 -- 172.21.15.16:0/3948223615 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660003810 con 0x7f9664162d30 2024-05-11T01:01:22.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.974+0000 7f43cbfff640 1 -- 172.21.15.16:0/4128461709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e00089c0 con 0x7f43e00cd5c0 2024-05-11T01:01:22.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.974+0000 7f82507f7640 1 -- 172.21.15.16:0/2947985945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82480b5130 msgr2=0x7f82480b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.974+0000 7f82507f7640 1 --2- 172.21.15.16:0/2947985945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82480b5130 0x7f82480b5590 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8248071710 tx=0x7f824002a730 comp rx=0 tx=0).stop 2024-05-11T01:01:22.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.974+0000 7f8654ff9640 1 -- 172.21.15.16:0/1152220615 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580bc070 con 0x7f8650048040 2024-05-11T01:01:22.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.974+0000 7f8654ff9640 1 -- 172.21.15.16:0/1152220615 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86580b6430 con 0x7f8650048040 2024-05-11T01:01:22.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.975+0000 7f8654ff9640 1 -- 172.21.15.16:0/1152220615 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86580b0040 con 0x7f8650048040 2024-05-11T01:01:22.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.975+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865004a290 con 0x7f8650048040 2024-05-11T01:01:22.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.976+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8650047030 con 0x7f8650048040 2024-05-11T01:01:22.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.976+0000 7f04fa7fc640 1 -- 172.21.15.16:0/1584089089 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f04f401a070 con 0x7f04fc048c30 2024-05-11T01:01:22.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.976+0000 7fbf667fc640 1 -- 172.21.15.16:0/3516459779 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbf6c00bb80 con 0x7fbf700b3600 2024-05-11T01:01:22.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.976+0000 7f9659ffb640 1 -- 172.21.15.16:0/3948223615 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f966001a070 con 0x7f9664162d30 2024-05-11T01:01:22.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.976+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7015b5f0 con 0x7fbf700b3600 2024-05-11T01:01:22.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7fbf667fc640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbf540762d0 0x7fbf54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9644005290 con 0x7f9664162d30 2024-05-11T01:01:22.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7f9659ffb640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f96480763a0 0x7f9648078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7f04fa7fc640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f04e80763a0 0x7f04e8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7f9659ffb640 1 -- 172.21.15.16:0/3948223615 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9660096890 con 0x7f9664162d30 2024-05-11T01:01:22.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7fbf757a3640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbf540762d0 0x7fbf54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7f04fa7fc640 1 -- 172.21.15.16:0/1584089089 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f04f4097bb0 con 0x7f04fc048c30 2024-05-11T01:01:22.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.976+0000 7f43de7fc640 1 -- 172.21.15.16:0/4128461709 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f43e80c5460 con 0x7f43e00cd5c0 2024-05-11T01:01:22.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7f43de7fc640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f43cc0763a0 0x7f43cc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7f43de7fc640 1 -- 172.21.15.16:0/4128461709 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f43e8135530 con 0x7f43e00cd5c0 2024-05-11T01:01:22.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7fbf667fc640 1 -- 172.21.15.16:0/3516459779 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbf6c0978c0 con 0x7fbf700b3600 2024-05-11T01:01:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.977+0000 7f9669276640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f96480763a0 0x7f9648078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86500089d0 con 0x7f8650048040 2024-05-11T01:01:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f82507f7640 1 -- 172.21.15.16:0/2947985945 shutdown_connections 2024-05-11T01:01:22.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f82507f7640 1 --2- 172.21.15.16:0/2947985945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82480b5130 0x7f82480b5590 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f43ed948640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f43cc0763a0 0x7f43cc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f82507f7640 1 --2- 172.21.15.16:0/2947985945 >> v2:172.21.15.16:3300/0 conn(0x7f824815aad0 0x7f824806c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f82507f7640 1 -- 172.21.15.16:0/2947985945 >> 172.21.15.16:0/2947985945 conn(0x7f82480d1a00 msgr2=0x7f82480d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f8654ff9640 1 -- 172.21.15.16:0/1152220615 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f86580c7060 con 0x7f8650048040 2024-05-11T01:01:22.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f0509d5a640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f04e80763a0 0x7f04e8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f82507f7640 1 -- 172.21.15.16:0/2947985945 shutdown_connections 2024-05-11T01:01:22.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7fbf757a3640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbf540762d0 0x7fbf54078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf700b2210 tx=0x7fbf6800b000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f82507f7640 1 -- 172.21.15.16:0/2947985945 wait complete. 2024-05-11T01:01:22.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f9669276640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f96480763a0 0x7f9648078860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f965c009bd0 tx=0x7f965c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f43ed948640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f43cc0763a0 0x7f43cc078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009770 tx=0x7f43d8006d70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f0509d5a640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f04e80763a0 0x7f04e8078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00d020 tx=0x7f0500009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.978+0000 7f8654ff9640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f863c076350 0x7f863c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.979+0000 7f8654ff9640 1 -- 172.21.15.16:0/1152220615 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8658133e90 con 0x7f8650048040 2024-05-11T01:01:22.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.979+0000 7f8657fff640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f863c076350 0x7f863c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.979+0000 7f82507f7640 1 Processor -- start 2024-05-11T01:01:22.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.979+0000 7f8657fff640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f863c076350 0x7f863c078810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f864c00ba70 tx=0x7f864c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.979+0000 7f82507f7640 1 -- start start 2024-05-11T01:01:22.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.980+0000 7f04fa7fc640 1 -- 172.21.15.16:0/1584089089 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f04f4060ea0 con 0x7f04fc048c30 2024-05-11T01:01:22.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.980+0000 7f82507f7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82480b5130 0x7f82481619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.980+0000 7f82507f7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824815aad0 0x7f82481480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.980+0000 7f82507f7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82481673e0 0x7f8248144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f82507f7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8248167870 con 0x7f82481673e0 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f82507f7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f824806ee10 con 0x7f824815aad0 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824dd92640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824815aad0 0x7f82481480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824dd92640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824815aad0 0x7f82481480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50668/0 (socket says 172.21.15.16:50668) 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824dd92640 1 -- 172.21.15.16:0/3144076425 learned_addr learned my addr 172.21.15.16:0/3144076425 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f82507f7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f82481679f0 con 0x7f82480b5130 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824ed94640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82481673e0 0x7f8248144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824e593640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82480b5130 0x7f82481619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824e593640 1 -- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824815aad0 msgr2=0x7f82481480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824e593640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824815aad0 0x7f82481480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824e593640 1 -- 172.21.15.16:0/3144076425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82481673e0 msgr2=0x7f8248144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824e593640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82481673e0 0x7f8248144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824e593640 1 -- 172.21.15.16:0/3144076425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824815f310 con 0x7f82480b5130 2024-05-11T01:01:22.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824dd92640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824815aad0 0x7f82481480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:22.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.981+0000 7f824e593640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82480b5130 0x7f82481619f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f823800d5f0 tx=0x7f823800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.982+0000 7fbf667fc640 1 -- 172.21.15.16:0/3516459779 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbf7015b5f0 con 0x7fbf700b3600 2024-05-11T01:01:22.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.984+0000 7f43de7fc640 1 -- 172.21.15.16:0/4128461709 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f43e80fea00 con 0x7f43e00cd5c0 2024-05-11T01:01:22.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.987+0000 7f9659ffb640 1 -- 172.21.15.16:0/3948223615 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f966005fb80 con 0x7f9664162d30 2024-05-11T01:01:22.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.991+0000 7f8246ffd640 1 -- 172.21.15.16:0/3144076425 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82380125f0 con 0x7f82480b5130 2024-05-11T01:01:22.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.991+0000 7f8654ff9640 1 -- 172.21.15.16:0/1152220615 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f86580fd7d0 con 0x7f8650048040 2024-05-11T01:01:22.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.991+0000 7f8246ffd640 1 -- 172.21.15.16:0/3144076425 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8238019070 con 0x7f82480b5130 2024-05-11T01:01:22.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.991+0000 7f82507f7640 1 -- 172.21.15.16:0/3144076425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8248162080 con 0x7f82480b5130 2024-05-11T01:01:22.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.991+0000 7f82507f7640 1 -- 172.21.15.16:0/3144076425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f824815f5b0 con 0x7f82480b5130 2024-05-11T01:01:22.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.993+0000 7f8246ffd640 1 -- 172.21.15.16:0/3144076425 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82380129d0 con 0x7f82480b5130 2024-05-11T01:01:22.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.993+0000 7f8244ff9640 1 -- 172.21.15.16:0/3144076425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480689d0 con 0x7f82480b5130 2024-05-11T01:01:22.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.995+0000 7f8246ffd640 1 -- 172.21.15.16:0/3144076425 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8238012b70 con 0x7f82480b5130 2024-05-11T01:01:22.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.996+0000 7f8246ffd640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8234076320 0x7f82340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.996+0000 7f8246ffd640 1 -- 172.21.15.16:0/3144076425 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f823805dce0 con 0x7f82480b5130 2024-05-11T01:01:22.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.997+0000 7f824dd92640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8234076320 0x7f82340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.997+0000 7f824dd92640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8234076320 0x7f82340787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f824815e110 tx=0x7f8240009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:21.998+0000 7f8246ffd640 1 -- 172.21.15.16:0/3144076425 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f82380616f0 con 0x7f82480b5130 2024-05-11T01:01:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.357+0000 7f55ef59e640 1 -- 172.21.15.16:0/3530148434 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f55e803cc40 con 0x7f55d8003a50 2024-05-11T01:01:22.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.357+0000 7f55deffd640 1 -- 172.21.15.16:0/3530148434 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f55e4081d30 con 0x7f55d8003a50 2024-05-11T01:01:22.357 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-11T01:01:22.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.360+0000 7f55dcff9640 1 -- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f55d00763d0 msgr2=0x7f55d0078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f55d00763d0 0x7f55d0078890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f55e804b140 tx=0x7f55e0008040 comp rx=0 tx=0).stop 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 -- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8003a50 msgr2=0x7f55e80e6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8003a50 0x7f55e80e6a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55e4001920 tx=0x7f55e4001890 comp rx=0 tx=0).stop 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 -- 172.21.15.16:0/3530148434 shutdown_connections 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f55d00763d0 0x7f55d0078890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55e80cc7d0 0x7f55e80ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55e80e2090 0x7f55e803bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 --2- 172.21.15.16:0/3530148434 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f55d8003a50 0x7f55e80e6a40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.361+0000 7f55dcff9640 1 -- 172.21.15.16:0/3530148434 >> 172.21.15.16:0/3530148434 conn(0x7f55e8053740 msgr2=0x7f55e80e9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.362+0000 7f55dcff9640 1 -- 172.21.15.16:0/3530148434 shutdown_connections 2024-05-11T01:01:22.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.362+0000 7f55dcff9640 1 -- 172.21.15.16:0/3530148434 wait complete. 2024-05-11T01:01:22.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.362+0000 7f6950acf640 1 -- 172.21.15.16:0/1417121929 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f694400cf60 con 0x7f694404a380 2024-05-11T01:01:22.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.363+0000 7f693affd640 1 -- 172.21.15.16:0/1417121929 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f693c064910 con 0x7f694404a380 2024-05-11T01:01:22.363 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:22.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.366+0000 7f6938ff9640 1 -- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f692c076320 msgr2=0x7f692c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f692c076320 0x7f692c0787e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6940035040 tx=0x7f694002e000 comp rx=0 tx=0).stop 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 -- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f694404a380 msgr2=0x7f6944033e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f694404a380 0x7f6944033e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f693c00e870 tx=0x7f693c00ed30 comp rx=0 tx=0).stop 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 -- 172.21.15.16:0/1417121929 shutdown_connections 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f692c076320 0x7f692c0787e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6944057470 0x7f694404c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f694404a380 0x7f6944033e00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 --2- 172.21.15.16:0/1417121929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6944049fa0 0x7f69440da0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.367+0000 7f6938ff9640 1 -- 172.21.15.16:0/1417121929 >> 172.21.15.16:0/1417121929 conn(0x7f6944020030 msgr2=0x7f6944054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.368+0000 7f6938ff9640 1 -- 172.21.15.16:0/1417121929 shutdown_connections 2024-05-11T01:01:22.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.368+0000 7f6938ff9640 1 -- 172.21.15.16:0/1417121929 wait complete. 2024-05-11T01:01:22.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-05-11T01:01:22.381 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:22.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-05-11T01:01:22.385 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.398+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbf70050860 con 0x7fbf700b3600 2024-05-11T01:01:22.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.398+0000 7fbf667fc640 1 -- 172.21.15.16:0/3516459779 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbf6c069030 con 0x7fbf700b3600 2024-05-11T01:01:22.399 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:22.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9644005580 con 0x7f9664162d30 2024-05-11T01:01:22.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbf540762d0 msgr2=0x7fbf54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbf540762d0 0x7fbf54078790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbf700b2210 tx=0x7fbf6800b000 comp rx=0 tx=0).stop 2024-05-11T01:01:22.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf700b3600 msgr2=0x7fbf70153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf700b3600 0x7fbf70153270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00d620 tx=0x7fbf6c00dae0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 shutdown_connections 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbf540762d0 0x7fbf54078790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf7015cf00 0x7fbf700aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf70155820 0x7fbf700ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 --2- 172.21.15.16:0/3516459779 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbf700b3600 0x7fbf70153270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 >> 172.21.15.16:0/3516459779 conn(0x7fbf700b2b10 msgr2=0x7fbf7015e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 shutdown_connections 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7fbf76fa6640 1 -- 172.21.15.16:0/3516459779 wait complete. 2024-05-11T01:01:22.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.401+0000 7f9659ffb640 1 -- 172.21.15.16:0/3948223615 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96600681c0 con 0x7f9664162d30 2024-05-11T01:01:22.403 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.403+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f96480763a0 msgr2=0x7f9648078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.403+0000 7f966b4da640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f96480763a0 0x7f9648078860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f965c009bd0 tx=0x7f965c00b040 comp rx=0 tx=0).stop 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.403+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 msgr2=0x7f96640cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.403+0000 7f966b4da640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640cec10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f966000c3d0 tx=0x7f966000c890 comp rx=0 tx=0).stop 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.404+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 shutdown_connections 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.404+0000 7f966b4da640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f96480763a0 0x7f9648078860 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.404+0000 7f966b4da640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9664163210 0x7f966414c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.404+0000 7f966b4da640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9664162d30 0x7f96640cec10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.404+0000 7f966b4da640 1 --2- 172.21.15.16:0/3948223615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96640b7530 0x7f96640cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.404+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 >> 172.21.15.16:0/3948223615 conn(0x7f96640d1e20 msgr2=0x7f96640b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.404+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 shutdown_connections 2024-05-11T01:01:22.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.404+0000 7f966b4da640 1 -- 172.21.15.16:0/3948223615 wait complete. 2024-05-11T01:01:22.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-05-11T01:01:22.413 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:22.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-05-11T01:01:22.415 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:22.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.429+0000 7f43cbfff640 1 -- 172.21.15.16:0/4128461709 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f43e0005380 con 0x7f43e00cd5c0 2024-05-11T01:01:22.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.429+0000 7f43de7fc640 1 -- 172.21.15.16:0/4128461709 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43e8133e20 con 0x7f43e00cd5c0 2024-05-11T01:01:22.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.429+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f04fc04fdf0 con 0x7f04fc048c30 2024-05-11T01:01:22.430 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:22.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.429+0000 7f04fa7fc640 1 -- 172.21.15.16:0/1584089089 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04f40651a0 con 0x7f04fc048c30 2024-05-11T01:01:22.430 INFO:teuthology.orchestra.run.smithi016.stdout:55834574853 2024-05-11T01:01:22.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 -- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f43cc0763a0 msgr2=0x7f43cc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f43cc0763a0 0x7f43cc078860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f43d8009770 tx=0x7f43d8006d70 comp rx=0 tx=0).stop 2024-05-11T01:01:22.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 -- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43e00cd5c0 msgr2=0x7f43e00499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43e00cd5c0 0x7f43e00499d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f43e8064020 tx=0x7f43e8075050 comp rx=0 tx=0).stop 2024-05-11T01:01:22.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 -- 172.21.15.16:0/4128461709 shutdown_connections 2024-05-11T01:01:22.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f43cc0763a0 0x7f43cc078860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43e0049f10 0x7f43e004bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43e00cd5c0 0x7f43e00499d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 --2- 172.21.15.16:0/4128461709 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f43d4004800 0x7f43e00cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 -- 172.21.15.16:0/4128461709 >> 172.21.15.16:0/4128461709 conn(0x7f43e0009fa0 msgr2=0x7f43e00dc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 -- 172.21.15.16:0/4128461709 shutdown_connections 2024-05-11T01:01:22.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.431+0000 7f43cbfff640 1 -- 172.21.15.16:0/4128461709 wait complete. 2024-05-11T01:01:22.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f04e80763a0 msgr2=0x7f04e8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f04e80763a0 0x7f04e8078860 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00d020 tx=0x7f0500009190 comp rx=0 tx=0).stop 2024-05-11T01:01:22.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc048c30 msgr2=0x7f04fc0ea390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc048c30 0x7f04fc0ea390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04f400e9b0 tx=0x7f04f400ee70 comp rx=0 tx=0).stop 2024-05-11T01:01:22.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 shutdown_connections 2024-05-11T01:01:22.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f04e80763a0 0x7f04e8078860 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04fc0eb290 0x7f04fc04f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04fc048c30 0x7f04fc0ea390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 --2- 172.21.15.16:0/1584089089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04fc009180 0x7f04fc04d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 >> 172.21.15.16:0/1584089089 conn(0x7f04fc01ef30 msgr2=0x7f04fc0e7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 shutdown_connections 2024-05-11T01:01:22.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.433+0000 7f050bfbe640 1 -- 172.21.15.16:0/1584089089 wait complete. 2024-05-11T01:01:22.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.439+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8650005390 con 0x7f8650048040 2024-05-11T01:01:22.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.440+0000 7f8244ff9640 1 -- 172.21.15.16:0/3144076425 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f824806a5b0 con 0x7f82480b5130 2024-05-11T01:01:22.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.440+0000 7f8654ff9640 1 -- 172.21.15.16:0/1152220615 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86580fd0d0 con 0x7f8650048040 2024-05-11T01:01:22.441 INFO:teuthology.orchestra.run.smithi016.stdout:55834574855 2024-05-11T01:01:22.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.440+0000 7f8246ffd640 1 -- 172.21.15.16:0/3144076425 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82380659f0 con 0x7f82480b5130 2024-05-11T01:01:22.442 INFO:teuthology.orchestra.run.smithi016.stdout:55834574854 2024-05-11T01:01:22.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f863c076350 msgr2=0x7f863c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f863c076350 0x7f863c078810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f864c00ba70 tx=0x7f864c008040 comp rx=0 tx=0).stop 2024-05-11T01:01:22.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8650048040 msgr2=0x7f86500cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8650048040 0x7f86500cc7b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f865806b330 tx=0x7f8658076980 comp rx=0 tx=0).stop 2024-05-11T01:01:22.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 -- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8234076320 msgr2=0x7f82340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8234076320 0x7f82340787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f824815e110 tx=0x7f8240009000 comp rx=0 tx=0).stop 2024-05-11T01:01:22.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 shutdown_connections 2024-05-11T01:01:22.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f863c076350 0x7f863c078810 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f864c00ba70 tx=0x7f864c008040 comp rx=0 tx=0).stop 2024-05-11T01:01:22.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8650048040 0x7f86500cc7b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8650038720 0x7f86500cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 --2- 172.21.15.16:0/1152220615 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8650037bb0 0x7f86500c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 >> 172.21.15.16:0/1152220615 conn(0x7f8650009fb0 msgr2=0x7f8650038f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 -- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82480b5130 msgr2=0x7f82481619f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82480b5130 0x7f82481619f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f823800d5f0 tx=0x7f823800dab0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 -- 172.21.15.16:0/3144076425 shutdown_connections 2024-05-11T01:01:22.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8234076320 0x7f82340787e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82481673e0 0x7f8248144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f824815aad0 0x7f82481480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 --2- 172.21.15.16:0/3144076425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82480b5130 0x7f82481619f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.442+0000 7f8244ff9640 1 -- 172.21.15.16:0/3144076425 >> 172.21.15.16:0/3144076425 conn(0x7f82480d1a00 msgr2=0x7f82480d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.443+0000 7f8244ff9640 1 -- 172.21.15.16:0/3144076425 shutdown_connections 2024-05-11T01:01:22.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.443+0000 7f8244ff9640 1 -- 172.21.15.16:0/3144076425 wait complete. 2024-05-11T01:01:22.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.443+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 shutdown_connections 2024-05-11T01:01:22.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.443+0000 7f865d53c640 1 -- 172.21.15.16:0/1152220615 wait complete. 2024-05-11T01:01:22.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-05-11T01:01:22.448 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:22.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-05-11T01:01:22.449 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:22.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-05-11T01:01:22.456 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:22.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-05-11T01:01:22.456 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:22.456 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-11T01:01:22.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.597+0000 7fef38c1c640 1 Processor -- start 2024-05-11T01:01:22.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.597+0000 7fef38c1c640 1 -- start start 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.597+0000 7fef38c1c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef340b6d70 0x7fef340b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.597+0000 7fef38c1c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fef340bac10 0x7fef3406d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef38c1c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef34163e90 con 0x7fef3406d950 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef38c1c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fef340cfad0 con 0x7fef340b6d70 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef38c1c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fef340b7690 con 0x7fef340bac10 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef3259c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef340b6d70 0x7fef340b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef3259c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef340b6d70 0x7fef340b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40404/0 (socket says 172.21.15.16:40404) 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef3259c640 1 -- 172.21.15.16:0/1696104270 learned_addr learned my addr 172.21.15.16:0/1696104270 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef29d9b640 1 --2- 172.21.15.16:0/1696104270 >> v2:172.21.15.174:3300/0 conn(0x7fef340bac10 0x7fef3406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef3259c640 1 -- 172.21.15.16:0/1696104270 >> v2:172.21.15.174:3300/0 conn(0x7fef340bac10 msgr2=0x7fef3406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:22.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef3259c640 1 --2- 172.21.15.16:0/1696104270 >> v2:172.21.15.174:3300/0 conn(0x7fef340bac10 0x7fef3406d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef3259c640 1 -- 172.21.15.16:0/1696104270 >> v1:172.21.15.174:6789/0 conn(0x7fef3406d950 legacy=0x7fef340d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.598+0000 7fef3259c640 1 -- 172.21.15.16:0/1696104270 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef34163310 con 0x7fef340b6d70 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef3259c640 1 --2- 172.21.15.16:0/1696104270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340b6d70 0x7fef340b7150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef24009870 tx=0x7fef2402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34c231569f93be2 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef31d9b640 1 -- 172.21.15.16:0/1696104270 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24037070 con 0x7fef340b6d70 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef31d9b640 1 -- 172.21.15.16:0/1696104270 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef24032440 con 0x7fef340b6d70 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef31d9b640 1 -- 172.21.15.16:0/1696104270 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24032810 con 0x7fef340b6d70 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef38c1c640 1 -- 172.21.15.16:0/1696104270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340b6d70 msgr2=0x7fef340b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1696104270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340b6d70 0x7fef340b7150 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef24009870 tx=0x7fef2402a180 comp rx=0 tx=0).stop 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef38c1c640 1 -- 172.21.15.16:0/1696104270 shutdown_connections 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1696104270 >> v2:172.21.15.174:3300/0 conn(0x7fef340bac10 0x7fef3406d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1696104270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340b6d70 0x7fef340b7150 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef38c1c640 1 -- 172.21.15.16:0/1696104270 >> 172.21.15.16:0/1696104270 conn(0x7fef34074140 msgr2=0x7fef340d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef38c1c640 1 -- 172.21.15.16:0/1696104270 shutdown_connections 2024-05-11T01:01:22.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.599+0000 7fef38c1c640 1 -- 172.21.15.16:0/1696104270 wait complete. 2024-05-11T01:01:22.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.601+0000 7fef38c1c640 1 Processor -- start 2024-05-11T01:01:22.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.601+0000 7fef38c1c640 1 -- start start 2024-05-11T01:01:22.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef38c1c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef3406d950 0x7fef340cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef38c1c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef340b6d70 0x7fef340ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef38c1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340bac10 0x7fef340cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef38c1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fef34163bb0 con 0x7fef340bac10 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef38c1c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fef341638d0 con 0x7fef3406d950 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef38c1c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fef3415f830 con 0x7fef340b6d70 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340bac10 0x7fef340cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340bac10 0x7fef340cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:40414/0 (socket says 172.21.15.16:40414) 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 -- 172.21.15.16:0/1929537653 learned_addr learned my addr 172.21.15.16:0/1929537653 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef29d9b640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef340b6d70 0x7fef340ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef3259c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef3406d950 0x7fef340cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 -- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef340b6d70 msgr2=0x7fef340ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef340b6d70 0x7fef340ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 -- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef3406d950 msgr2=0x7fef340cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef3406d950 0x7fef340cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 -- 172.21.15.16:0/1929537653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3414f360 con 0x7fef340bac10 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef29d9b640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef340b6d70 0x7fef340ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef32d9d640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340bac10 0x7fef340cea20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c780 tx=0x7fef2c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef2b7fe640 1 -- 172.21.15.16:0/1929537653 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c004b60 con 0x7fef340bac10 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef2b7fe640 1 -- 172.21.15.16:0/1929537653 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c004d00 con 0x7fef340bac10 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef2b7fe640 1 -- 172.21.15.16:0/1929537653 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00aa90 con 0x7fef340bac10 2024-05-11T01:01:22.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef340cf0c0 con 0x7fef340bac10 2024-05-11T01:01:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.602+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef341f9450 con 0x7fef340bac10 2024-05-11T01:01:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.603+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef3406a5b0 con 0x7fef340bac10 2024-05-11T01:01:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.604+0000 7fef2b7fe640 1 -- 172.21.15.16:0/1929537653 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fef2c00ac30 con 0x7fef340bac10 2024-05-11T01:01:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.605+0000 7fef2b7fe640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fef140762d0 0x7fef14078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.605+0000 7fef2b7fe640 1 -- 172.21.15.16:0/1929537653 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fef2c097780 con 0x7fef340bac10 2024-05-11T01:01:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.605+0000 7fef3259c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fef140762d0 0x7fef14078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.605+0000 7fef3259c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fef140762d0 0x7fef14078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef24034000 tx=0x7fef2402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.609+0000 7fef2b7fe640 1 -- 172.21.15.16:0/1929537653 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fef2c020070 con 0x7fef340bac10 2024-05-11T01:01:22.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.796+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef340b4a30 con 0x7fef140762d0 2024-05-11T01:01:22.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.802+0000 7fef2b7fe640 1 -- 172.21.15.16:0/1929537653 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fef340b4a30 con 0x7fef140762d0 2024-05-11T01:01:22.805 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:22.806 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fef140762d0 msgr2=0x7fef14078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fef140762d0 0x7fef14078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef24034000 tx=0x7fef2402e000 comp rx=0 tx=0).stop 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340bac10 msgr2=0x7fef340cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340bac10 0x7fef340cea20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef2c00c780 tx=0x7fef2c00cc40 comp rx=0 tx=0).stop 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 shutdown_connections 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fef140762d0 0x7fef14078790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef340bac10 0x7fef340cea20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fef340b6d70 0x7fef340ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 --2- 172.21.15.16:0/1929537653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fef3406d950 0x7fef340cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 >> 172.21.15.16:0/1929537653 conn(0x7fef34074140 msgr2=0x7fef340b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 shutdown_connections 2024-05-11T01:01:22.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.806+0000 7fef38c1c640 1 -- 172.21.15.16:0/1929537653 wait complete. 2024-05-11T01:01:22.817 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-11T01:01:21.758102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235648,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739072,"statfs":{"total":773094113280,"available":772852809728,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.119565"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640769+0000","last_change":"2024-05-11T01:01:09.660889+0000","last_active":"2024-05-11T01:01:10.640769+0000","last_peered":"2024-05-11T01:01:10.640769+0000","last_clean":"2024-05-11T01:01:10.640769+0000","last_became_active":"2024-05-11T01:01:09.660592+0000","last_became_peered":"2024-05-11T01:01:09.660592+0000","last_unstale":"2024-05-11T01:01:10.640769+0000","last_undegraded":"2024-05-11T01:01:10.640769+0000","last_fullsized":"2024-05-11T01:01:10.640769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:17.765368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639355+0000","last_change":"2024-05-11T01:01:09.662924+0000","last_active":"2024-05-11T01:01:10.639355+0000","last_peered":"2024-05-11T01:01:10.639355+0000","last_clean":"2024-05-11T01:01:10.639355+0000","last_became_active":"2024-05-11T01:01:09.662613+0000","last_became_peered":"2024-05-11T01:01:09.662613+0000","last_unstale":"2024-05-11T01:01:10.639355+0000","last_undegraded":"2024-05-11T01:01:10.639355+0000","last_fullsized":"2024-05-11T01:01:10.639355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779001+0000","last_change":"2024-05-11T01:01:09.650637+0000","last_active":"2024-05-11T01:01:10.779001+0000","last_peered":"2024-05-11T01:01:10.779001+0000","last_clean":"2024-05-11T01:01:10.779001+0000","last_became_active":"2024-05-11T01:01:09.650045+0000","last_became_peered":"2024-05-11T01:01:09.650045+0000","last_unstale":"2024-05-11T01:01:10.779001+0000","last_undegraded":"2024-05-11T01:01:10.779001+0000","last_fullsized":"2024-05-11T01:01:10.779001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846578+0000","last_change":"2024-05-11T01:01:09.659637+0000","last_active":"2024-05-11T01:01:10.846578+0000","last_peered":"2024-05-11T01:01:10.846578+0000","last_clean":"2024-05-11T01:01:10.846578+0000","last_became_active":"2024-05-11T01:01:09.659340+0000","last_became_peered":"2024-05-11T01:01:09.659340+0000","last_unstale":"2024-05-11T01:01:10.846578+0000","last_undegraded":"2024-05-11T01:01:10.846578+0000","last_fullsized":"2024-05-11T01:01:10.846578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:20:29.060496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641126+0000","last_change":"2024-05-11T01:01:09.659284+0000","last_active":"2024-05-11T01:01:10.641126+0000","last_peered":"2024-05-11T01:01:10.641126+0000","last_clean":"2024-05-11T01:01:10.641126+0000","last_became_active":"2024-05-11T01:01:09.658998+0000","last_became_peered":"2024-05-11T01:01:09.658998+0000","last_unstale":"2024-05-11T01:01:10.641126+0000","last_undegraded":"2024-05-11T01:01:10.641126+0000","last_fullsized":"2024-05-11T01:01:10.641126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:00:58.091438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845862+0000","last_change":"2024-05-11T01:01:09.664661+0000","last_active":"2024-05-11T01:01:10.845862+0000","last_peered":"2024-05-11T01:01:10.845862+0000","last_clean":"2024-05-11T01:01:10.845862+0000","last_became_active":"2024-05-11T01:01:09.664406+0000","last_became_peered":"2024-05-11T01:01:09.664406+0000","last_unstale":"2024-05-11T01:01:10.845862+0000","last_undegraded":"2024-05-11T01:01:10.845862+0000","last_fullsized":"2024-05-11T01:01:10.845862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:33:53.314387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640617+0000","last_change":"2024-05-11T01:01:09.659105+0000","last_active":"2024-05-11T01:01:10.640617+0000","last_peered":"2024-05-11T01:01:10.640617+0000","last_clean":"2024-05-11T01:01:10.640617+0000","last_became_active":"2024-05-11T01:01:09.658744+0000","last_became_peered":"2024-05-11T01:01:09.658744+0000","last_unstale":"2024-05-11T01:01:10.640617+0000","last_undegraded":"2024-05-11T01:01:10.640617+0000","last_fullsized":"2024-05-11T01:01:10.640617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:20:29.060496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845412+0000","last_change":"2024-05-11T01:01:09.659097+0000","last_active":"2024-05-11T01:01:10.845412+0000","last_peered":"2024-05-11T01:01:10.845412+0000","last_clean":"2024-05-11T01:01:10.845412+0000","last_became_active":"2024-05-11T01:01:09.658407+0000","last_became_peered":"2024-05-11T01:01:09.658407+0000","last_unstale":"2024-05-11T01:01:10.845412+0000","last_undegraded":"2024-05-11T01:01:10.845412+0000","last_fullsized":"2024-05-11T01:01:10.845412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:12:46.155019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641575+0000","last_change":"2024-05-11T01:01:09.654158+0000","last_active":"2024-05-11T01:01:10.641575+0000","last_peered":"2024-05-11T01:01:10.641575+0000","last_clean":"2024-05-11T01:01:10.641575+0000","last_became_active":"2024-05-11T01:01:09.653934+0000","last_became_peered":"2024-05-11T01:01:09.653934+0000","last_unstale":"2024-05-11T01:01:10.641575+0000","last_undegraded":"2024-05-11T01:01:10.641575+0000","last_fullsized":"2024-05-11T01:01:10.641575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:58:08.244849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846277+0000","last_change":"2024-05-11T01:01:09.651801+0000","last_active":"2024-05-11T01:01:10.846277+0000","last_peered":"2024-05-11T01:01:10.846277+0000","last_clean":"2024-05-11T01:01:10.846277+0000","last_became_active":"2024-05-11T01:01:09.651532+0000","last_became_peered":"2024-05-11T01:01:09.651532+0000","last_unstale":"2024-05-11T01:01:10.846277+0000","last_undegraded":"2024-05-11T01:01:10.846277+0000","last_fullsized":"2024-05-11T01:01:10.846277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846187+0000","last_change":"2024-05-11T01:01:09.651881+0000","last_active":"2024-05-11T01:01:10.846187+0000","last_peered":"2024-05-11T01:01:10.846187+0000","last_clean":"2024-05-11T01:01:10.846187+0000","last_became_active":"2024-05-11T01:01:09.651604+0000","last_became_peered":"2024-05-11T01:01:09.651604+0000","last_unstale":"2024-05-11T01:01:10.846187+0000","last_undegraded":"2024-05-11T01:01:10.846187+0000","last_fullsized":"2024-05-11T01:01:10.846187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640658+0000","last_change":"2024-05-11T01:01:09.654040+0000","last_active":"2024-05-11T01:01:10.640658+0000","last_peered":"2024-05-11T01:01:10.640658+0000","last_clean":"2024-05-11T01:01:10.640658+0000","last_became_active":"2024-05-11T01:01:09.653631+0000","last_became_peered":"2024-05-11T01:01:09.653631+0000","last_unstale":"2024-05-11T01:01:10.640658+0000","last_undegraded":"2024-05-11T01:01:10.640658+0000","last_fullsized":"2024-05-11T01:01:10.640658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:49.875866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845788+0000","last_change":"2024-05-11T01:01:09.663289+0000","last_active":"2024-05-11T01:01:10.845788+0000","last_peered":"2024-05-11T01:01:10.845788+0000","last_clean":"2024-05-11T01:01:10.845788+0000","last_became_active":"2024-05-11T01:01:09.662768+0000","last_became_peered":"2024-05-11T01:01:09.662768+0000","last_unstale":"2024-05-11T01:01:10.845788+0000","last_undegraded":"2024-05-11T01:01:10.845788+0000","last_fullsized":"2024-05-11T01:01:10.845788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:33:53.314387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778816+0000","last_change":"2024-05-11T01:01:09.658330+0000","last_active":"2024-05-11T01:01:10.778816+0000","last_peered":"2024-05-11T01:01:10.778816+0000","last_clean":"2024-05-11T01:01:10.778816+0000","last_became_active":"2024-05-11T01:01:09.658033+0000","last_became_peered":"2024-05-11T01:01:09.658033+0000","last_unstale":"2024-05-11T01:01:10.778816+0000","last_undegraded":"2024-05-11T01:01:10.778816+0000","last_fullsized":"2024-05-11T01:01:10.778816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:07:25.386437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639081+0000","last_change":"2024-05-11T01:01:09.653835+0000","last_active":"2024-05-11T01:01:10.639081+0000","last_peered":"2024-05-11T01:01:10.639081+0000","last_clean":"2024-05-11T01:01:10.639081+0000","last_became_active":"2024-05-11T01:01:09.653540+0000","last_became_peered":"2024-05-11T01:01:09.653540+0000","last_unstale":"2024-05-11T01:01:10.639081+0000","last_undegraded":"2024-05-11T01:01:10.639081+0000","last_fullsized":"2024-05-11T01:01:10.639081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845739+0000","last_change":"2024-05-11T01:01:09.666863+0000","last_active":"2024-05-11T01:01:10.845739+0000","last_peered":"2024-05-11T01:01:10.845739+0000","last_clean":"2024-05-11T01:01:10.845739+0000","last_became_active":"2024-05-11T01:01:09.666571+0000","last_became_peered":"2024-05-11T01:01:09.666571+0000","last_unstale":"2024-05-11T01:01:10.845739+0000","last_undegraded":"2024-05-11T01:01:10.845739+0000","last_fullsized":"2024-05-11T01:01:10.845739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.847013+0000","last_change":"2024-05-11T01:01:09.663210+0000","last_active":"2024-05-11T01:01:10.847013+0000","last_peered":"2024-05-11T01:01:10.847013+0000","last_clean":"2024-05-11T01:01:10.847013+0000","last_became_active":"2024-05-11T01:01:09.662958+0000","last_became_peered":"2024-05-11T01:01:09.662958+0000","last_unstale":"2024-05-11T01:01:10.847013+0000","last_undegraded":"2024-05-11T01:01:10.847013+0000","last_fullsized":"2024-05-11T01:01:10.847013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:06:53.835577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845545+0000","last_change":"2024-05-11T01:01:09.652062+0000","last_active":"2024-05-11T01:01:10.845545+0000","last_peered":"2024-05-11T01:01:10.845545+0000","last_clean":"2024-05-11T01:01:10.845545+0000","last_became_active":"2024-05-11T01:01:09.651794+0000","last_became_peered":"2024-05-11T01:01:09.651794+0000","last_unstale":"2024-05-11T01:01:10.845545+0000","last_undegraded":"2024-05-11T01:01:10.845545+0000","last_fullsized":"2024-05-11T01:01:10.845545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:54.570608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640929+0000","last_change":"2024-05-11T01:01:09.662186+0000","last_active":"2024-05-11T01:01:10.640929+0000","last_peered":"2024-05-11T01:01:10.640929+0000","last_clean":"2024-05-11T01:01:10.640929+0000","last_became_active":"2024-05-11T01:01:09.661941+0000","last_became_peered":"2024-05-11T01:01:09.661941+0000","last_unstale":"2024-05-11T01:01:10.640929+0000","last_undegraded":"2024-05-11T01:01:10.640929+0000","last_fullsized":"2024-05-11T01:01:10.640929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:22:02.787759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846174+0000","last_change":"2024-05-11T01:01:09.655262+0000","last_active":"2024-05-11T01:01:10.846174+0000","last_peered":"2024-05-11T01:01:10.846174+0000","last_clean":"2024-05-11T01:01:10.846174+0000","last_became_active":"2024-05-11T01:01:09.654951+0000","last_became_peered":"2024-05-11T01:01:09.654951+0000","last_unstale":"2024-05-11T01:01:10.846174+0000","last_undegraded":"2024-05-11T01:01:10.846174+0000","last_fullsized":"2024-05-11T01:01:10.846174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778938+0000","last_change":"2024-05-11T01:01:09.649231+0000","last_active":"2024-05-11T01:01:10.778938+0000","last_peered":"2024-05-11T01:01:10.778938+0000","last_clean":"2024-05-11T01:01:10.778938+0000","last_became_active":"2024-05-11T01:01:09.648920+0000","last_became_peered":"2024-05-11T01:01:09.648920+0000","last_unstale":"2024-05-11T01:01:10.778938+0000","last_undegraded":"2024-05-11T01:01:10.778938+0000","last_fullsized":"2024-05-11T01:01:10.778938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:12:46.155019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846056+0000","last_change":"2024-05-11T01:01:09.663855+0000","last_active":"2024-05-11T01:01:10.846056+0000","last_peered":"2024-05-11T01:01:10.846056+0000","last_clean":"2024-05-11T01:01:10.846056+0000","last_became_active":"2024-05-11T01:01:09.663614+0000","last_became_peered":"2024-05-11T01:01:09.663614+0000","last_unstale":"2024-05-11T01:01:10.846056+0000","last_undegraded":"2024-05-11T01:01:10.846056+0000","last_fullsized":"2024-05-11T01:01:10.846056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:30.522539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845782+0000","last_change":"2024-05-11T01:01:09.656048+0000","last_active":"2024-05-11T01:01:10.845782+0000","last_peered":"2024-05-11T01:01:10.845782+0000","last_clean":"2024-05-11T01:01:10.845782+0000","last_became_active":"2024-05-11T01:01:09.655764+0000","last_became_peered":"2024-05-11T01:01:09.655764+0000","last_unstale":"2024-05-11T01:01:10.845782+0000","last_undegraded":"2024-05-11T01:01:10.845782+0000","last_fullsized":"2024-05-11T01:01:10.845782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845810+0000","last_change":"2024-05-11T01:01:09.657669+0000","last_active":"2024-05-11T01:01:10.845810+0000","last_peered":"2024-05-11T01:01:10.845810+0000","last_clean":"2024-05-11T01:01:10.845810+0000","last_became_active":"2024-05-11T01:01:09.657391+0000","last_became_peered":"2024-05-11T01:01:09.657391+0000","last_unstale":"2024-05-11T01:01:10.845810+0000","last_undegraded":"2024-05-11T01:01:10.845810+0000","last_fullsized":"2024-05-11T01:01:10.845810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845432+0000","last_change":"2024-05-11T01:01:09.657628+0000","last_active":"2024-05-11T01:01:10.845432+0000","last_peered":"2024-05-11T01:01:10.845432+0000","last_clean":"2024-05-11T01:01:10.845432+0000","last_became_active":"2024-05-11T01:01:09.656250+0000","last_became_peered":"2024-05-11T01:01:09.656250+0000","last_unstale":"2024-05-11T01:01:10.845432+0000","last_undegraded":"2024-05-11T01:01:10.845432+0000","last_fullsized":"2024-05-11T01:01:10.845432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846487+0000","last_change":"2024-05-11T01:01:09.662365+0000","last_active":"2024-05-11T01:01:10.846487+0000","last_peered":"2024-05-11T01:01:10.846487+0000","last_clean":"2024-05-11T01:01:10.846487+0000","last_became_active":"2024-05-11T01:01:09.662090+0000","last_became_peered":"2024-05-11T01:01:09.662090+0000","last_unstale":"2024-05-11T01:01:10.846487+0000","last_undegraded":"2024-05-11T01:01:10.846487+0000","last_fullsized":"2024-05-11T01:01:10.846487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639359+0000","last_change":"2024-05-11T01:01:09.655565+0000","last_active":"2024-05-11T01:01:10.639359+0000","last_peered":"2024-05-11T01:01:10.639359+0000","last_clean":"2024-05-11T01:01:10.639359+0000","last_became_active":"2024-05-11T01:01:09.655268+0000","last_became_peered":"2024-05-11T01:01:09.655268+0000","last_unstale":"2024-05-11T01:01:10.639359+0000","last_undegraded":"2024-05-11T01:01:10.639359+0000","last_fullsized":"2024-05-11T01:01:10.639359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846062+0000","last_change":"2024-05-11T01:01:09.654719+0000","last_active":"2024-05-11T01:01:10.846062+0000","last_peered":"2024-05-11T01:01:10.846062+0000","last_clean":"2024-05-11T01:01:10.846062+0000","last_became_active":"2024-05-11T01:01:09.654428+0000","last_became_peered":"2024-05-11T01:01:09.654428+0000","last_unstale":"2024-05-11T01:01:10.846062+0000","last_undegraded":"2024-05-11T01:01:10.846062+0000","last_fullsized":"2024-05-11T01:01:10.846062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778974+0000","last_change":"2024-05-11T01:01:09.658293+0000","last_active":"2024-05-11T01:01:10.778974+0000","last_peered":"2024-05-11T01:01:10.778974+0000","last_clean":"2024-05-11T01:01:10.778974+0000","last_became_active":"2024-05-11T01:01:09.658017+0000","last_became_peered":"2024-05-11T01:01:09.658017+0000","last_unstale":"2024-05-11T01:01:10.778974+0000","last_undegraded":"2024-05-11T01:01:10.778974+0000","last_fullsized":"2024-05-11T01:01:10.778974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846261+0000","last_change":"2024-05-11T01:01:09.658403+0000","last_active":"2024-05-11T01:01:10.846261+0000","last_peered":"2024-05-11T01:01:10.846261+0000","last_clean":"2024-05-11T01:01:10.846261+0000","last_became_active":"2024-05-11T01:01:09.656683+0000","last_became_peered":"2024-05-11T01:01:09.656683+0000","last_unstale":"2024-05-11T01:01:10.846261+0000","last_undegraded":"2024-05-11T01:01:10.846261+0000","last_fullsized":"2024-05-11T01:01:10.846261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845249+0000","last_change":"2024-05-11T01:01:09.655041+0000","last_active":"2024-05-11T01:01:10.845249+0000","last_peered":"2024-05-11T01:01:10.845249+0000","last_clean":"2024-05-11T01:01:10.845249+0000","last_became_active":"2024-05-11T01:01:09.654512+0000","last_became_peered":"2024-05-11T01:01:09.654512+0000","last_unstale":"2024-05-11T01:01:10.845249+0000","last_undegraded":"2024-05-11T01:01:10.845249+0000","last_fullsized":"2024-05-11T01:01:10.845249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:14.595099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845846+0000","last_change":"2024-05-11T01:01:09.665750+0000","last_active":"2024-05-11T01:01:10.845846+0000","last_peered":"2024-05-11T01:01:10.845846+0000","last_clean":"2024-05-11T01:01:10.845846+0000","last_became_active":"2024-05-11T01:01:09.665461+0000","last_became_peered":"2024-05-11T01:01:09.665461+0000","last_unstale":"2024-05-11T01:01:10.845846+0000","last_undegraded":"2024-05-11T01:01:10.845846+0000","last_fullsized":"2024-05-11T01:01:10.845846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640244+0000","last_change":"2024-05-11T01:01:09.656560+0000","last_active":"2024-05-11T01:01:10.640244+0000","last_peered":"2024-05-11T01:01:10.640244+0000","last_clean":"2024-05-11T01:01:10.640244+0000","last_became_active":"2024-05-11T01:01:09.656292+0000","last_became_peered":"2024-05-11T01:01:09.656292+0000","last_unstale":"2024-05-11T01:01:10.640244+0000","last_undegraded":"2024-05-11T01:01:10.640244+0000","last_fullsized":"2024-05-11T01:01:10.640244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:13.731770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845885+0000","last_change":"2024-05-11T01:01:08.656899+0000","last_active":"2024-05-11T01:01:10.845885+0000","last_peered":"2024-05-11T01:01:10.845885+0000","last_clean":"2024-05-11T01:01:10.845885+0000","last_became_active":"2024-05-11T01:01:08.656569+0000","last_became_peered":"2024-05-11T01:01:08.656569+0000","last_unstale":"2024-05-11T01:01:10.845885+0000","last_undegraded":"2024-05-11T01:01:10.845885+0000","last_fullsized":"2024-05-11T01:01:10.845885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779096+0000","last_change":"2024-05-11T01:01:09.643951+0000","last_active":"2024-05-11T01:01:10.779096+0000","last_peered":"2024-05-11T01:01:10.779096+0000","last_clean":"2024-05-11T01:01:10.779096+0000","last_became_active":"2024-05-11T01:01:09.643326+0000","last_became_peered":"2024-05-11T01:01:09.643326+0000","last_unstale":"2024-05-11T01:01:10.779096+0000","last_undegraded":"2024-05-11T01:01:10.779096+0000","last_fullsized":"2024-05-11T01:01:10.779096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845917+0000","last_change":"2024-05-11T01:01:08.651945+0000","last_active":"2024-05-11T01:01:10.845917+0000","last_peered":"2024-05-11T01:01:10.845917+0000","last_clean":"2024-05-11T01:01:10.845917+0000","last_became_active":"2024-05-11T01:01:08.651681+0000","last_became_peered":"2024-05-11T01:01:08.651681+0000","last_unstale":"2024-05-11T01:01:10.845917+0000","last_undegraded":"2024-05-11T01:01:10.845917+0000","last_fullsized":"2024-05-11T01:01:10.845917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845858+0000","last_change":"2024-05-11T01:01:08.658922+0000","last_active":"2024-05-11T01:01:10.845858+0000","last_peered":"2024-05-11T01:01:10.845858+0000","last_clean":"2024-05-11T01:01:10.845858+0000","last_became_active":"2024-05-11T01:01:08.658620+0000","last_became_peered":"2024-05-11T01:01:08.658620+0000","last_unstale":"2024-05-11T01:01:10.845858+0000","last_undegraded":"2024-05-11T01:01:10.845858+0000","last_fullsized":"2024-05-11T01:01:10.845858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845920+0000","last_change":"2024-05-11T01:01:09.666049+0000","last_active":"2024-05-11T01:01:10.845920+0000","last_peered":"2024-05-11T01:01:10.845920+0000","last_clean":"2024-05-11T01:01:10.845920+0000","last_became_active":"2024-05-11T01:01:09.665733+0000","last_became_peered":"2024-05-11T01:01:09.665733+0000","last_unstale":"2024-05-11T01:01:10.845920+0000","last_undegraded":"2024-05-11T01:01:10.845920+0000","last_fullsized":"2024-05-11T01:01:10.845920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:30.522539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845870+0000","last_change":"2024-05-11T01:01:08.647703+0000","last_active":"2024-05-11T01:01:10.845870+0000","last_peered":"2024-05-11T01:01:10.845870+0000","last_clean":"2024-05-11T01:01:10.845870+0000","last_became_active":"2024-05-11T01:01:08.647434+0000","last_became_peered":"2024-05-11T01:01:08.647434+0000","last_unstale":"2024-05-11T01:01:10.845870+0000","last_undegraded":"2024-05-11T01:01:10.845870+0000","last_fullsized":"2024-05-11T01:01:10.845870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639149+0000","last_change":"2024-05-11T01:01:09.656131+0000","last_active":"2024-05-11T01:01:10.639149+0000","last_peered":"2024-05-11T01:01:10.639149+0000","last_clean":"2024-05-11T01:01:10.639149+0000","last_became_active":"2024-05-11T01:01:09.654812+0000","last_became_peered":"2024-05-11T01:01:09.654812+0000","last_unstale":"2024-05-11T01:01:10.639149+0000","last_undegraded":"2024-05-11T01:01:10.639149+0000","last_fullsized":"2024-05-11T01:01:10.639149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846088+0000","last_change":"2024-05-11T01:01:08.655160+0000","last_active":"2024-05-11T01:01:10.846088+0000","last_peered":"2024-05-11T01:01:10.846088+0000","last_clean":"2024-05-11T01:01:10.846088+0000","last_became_active":"2024-05-11T01:01:08.654886+0000","last_became_peered":"2024-05-11T01:01:08.654886+0000","last_unstale":"2024-05-11T01:01:10.846088+0000","last_undegraded":"2024-05-11T01:01:10.846088+0000","last_fullsized":"2024-05-11T01:01:10.846088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846657+0000","last_change":"2024-05-11T01:01:09.662654+0000","last_active":"2024-05-11T01:01:10.846657+0000","last_peered":"2024-05-11T01:01:10.846657+0000","last_clean":"2024-05-11T01:01:10.846657+0000","last_became_active":"2024-05-11T01:01:09.662404+0000","last_became_peered":"2024-05-11T01:01:09.662404+0000","last_unstale":"2024-05-11T01:01:10.846657+0000","last_undegraded":"2024-05-11T01:01:10.846657+0000","last_fullsized":"2024-05-11T01:01:10.846657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:22.764677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846814+0000","last_change":"2024-05-11T01:01:08.655815+0000","last_active":"2024-05-11T01:01:10.846814+0000","last_peered":"2024-05-11T01:01:10.846814+0000","last_clean":"2024-05-11T01:01:10.846814+0000","last_became_active":"2024-05-11T01:01:08.655307+0000","last_became_peered":"2024-05-11T01:01:08.655307+0000","last_unstale":"2024-05-11T01:01:10.846814+0000","last_undegraded":"2024-05-11T01:01:10.846814+0000","last_fullsized":"2024-05-11T01:01:10.846814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779197+0000","last_change":"2024-05-11T01:01:09.653742+0000","last_active":"2024-05-11T01:01:10.779197+0000","last_peered":"2024-05-11T01:01:10.779197+0000","last_clean":"2024-05-11T01:01:10.779197+0000","last_became_active":"2024-05-11T01:01:09.653427+0000","last_became_peered":"2024-05-11T01:01:09.653427+0000","last_unstale":"2024-05-11T01:01:10.779197+0000","last_undegraded":"2024-05-11T01:01:10.779197+0000","last_fullsized":"2024-05-11T01:01:10.779197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639415+0000","last_change":"2024-05-11T01:01:08.653490+0000","last_active":"2024-05-11T01:01:10.639415+0000","last_peered":"2024-05-11T01:01:10.639415+0000","last_clean":"2024-05-11T01:01:10.639415+0000","last_became_active":"2024-05-11T01:01:08.653133+0000","last_became_peered":"2024-05-11T01:01:08.653133+0000","last_unstale":"2024-05-11T01:01:10.639415+0000","last_undegraded":"2024-05-11T01:01:10.639415+0000","last_fullsized":"2024-05-11T01:01:10.639415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640807+0000","last_change":"2024-05-11T01:01:09.648279+0000","last_active":"2024-05-11T01:01:10.640807+0000","last_peered":"2024-05-11T01:01:10.640807+0000","last_clean":"2024-05-11T01:01:10.640807+0000","last_became_active":"2024-05-11T01:01:09.647495+0000","last_became_peered":"2024-05-11T01:01:09.647495+0000","last_unstale":"2024-05-11T01:01:10.640807+0000","last_undegraded":"2024-05-11T01:01:10.640807+0000","last_fullsized":"2024-05-11T01:01:10.640807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:14.595099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846299+0000","last_change":"2024-05-11T01:01:08.654417+0000","last_active":"2024-05-11T01:01:10.846299+0000","last_peered":"2024-05-11T01:01:10.846299+0000","last_clean":"2024-05-11T01:01:10.846299+0000","last_became_active":"2024-05-11T01:01:08.654147+0000","last_became_peered":"2024-05-11T01:01:08.654147+0000","last_unstale":"2024-05-11T01:01:10.846299+0000","last_undegraded":"2024-05-11T01:01:10.846299+0000","last_fullsized":"2024-05-11T01:01:10.846299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640575+0000","last_change":"2024-05-11T01:01:09.659281+0000","last_active":"2024-05-11T01:01:10.640575+0000","last_peered":"2024-05-11T01:01:10.640575+0000","last_clean":"2024-05-11T01:01:10.640575+0000","last_became_active":"2024-05-11T01:01:09.659047+0000","last_became_peered":"2024-05-11T01:01:09.659047+0000","last_unstale":"2024-05-11T01:01:10.640575+0000","last_undegraded":"2024-05-11T01:01:10.640575+0000","last_fullsized":"2024-05-11T01:01:10.640575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779066+0000","last_change":"2024-05-11T01:01:08.655493+0000","last_active":"2024-05-11T01:01:10.779066+0000","last_peered":"2024-05-11T01:01:10.779066+0000","last_clean":"2024-05-11T01:01:10.779066+0000","last_became_active":"2024-05-11T01:01:08.655147+0000","last_became_peered":"2024-05-11T01:01:08.655147+0000","last_unstale":"2024-05-11T01:01:10.779066+0000","last_undegraded":"2024-05-11T01:01:10.779066+0000","last_fullsized":"2024-05-11T01:01:10.779066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779183+0000","last_change":"2024-05-11T01:01:09.646387+0000","last_active":"2024-05-11T01:01:10.779183+0000","last_peered":"2024-05-11T01:01:10.779183+0000","last_clean":"2024-05-11T01:01:10.779183+0000","last_became_active":"2024-05-11T01:01:09.646114+0000","last_became_peered":"2024-05-11T01:01:09.646114+0000","last_unstale":"2024-05-11T01:01:10.779183+0000","last_undegraded":"2024-05-11T01:01:10.779183+0000","last_fullsized":"2024-05-11T01:01:10.779183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846342+0000","last_change":"2024-05-11T01:01:08.648494+0000","last_active":"2024-05-11T01:01:10.846342+0000","last_peered":"2024-05-11T01:01:10.846342+0000","last_clean":"2024-05-11T01:01:10.846342+0000","last_became_active":"2024-05-11T01:01:08.648206+0000","last_became_peered":"2024-05-11T01:01:08.648206+0000","last_unstale":"2024-05-11T01:01:10.846342+0000","last_undegraded":"2024-05-11T01:01:10.846342+0000","last_fullsized":"2024-05-11T01:01:10.846342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641026+0000","last_change":"2024-05-11T01:01:09.659174+0000","last_active":"2024-05-11T01:01:10.641026+0000","last_peered":"2024-05-11T01:01:10.641026+0000","last_clean":"2024-05-11T01:01:10.641026+0000","last_became_active":"2024-05-11T01:01:09.658863+0000","last_became_peered":"2024-05-11T01:01:09.658863+0000","last_unstale":"2024-05-11T01:01:10.641026+0000","last_undegraded":"2024-05-11T01:01:10.641026+0000","last_fullsized":"2024-05-11T01:01:10.641026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:54.872438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845810+0000","last_change":"2024-05-11T01:01:08.655771+0000","last_active":"2024-05-11T01:01:10.845810+0000","last_peered":"2024-05-11T01:01:10.845810+0000","last_clean":"2024-05-11T01:01:10.845810+0000","last_became_active":"2024-05-11T01:01:08.655462+0000","last_became_peered":"2024-05-11T01:01:08.655462+0000","last_unstale":"2024-05-11T01:01:10.845810+0000","last_undegraded":"2024-05-11T01:01:10.845810+0000","last_fullsized":"2024-05-11T01:01:10.845810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845935+0000","last_change":"2024-05-11T01:01:09.665678+0000","last_active":"2024-05-11T01:01:10.845935+0000","last_peered":"2024-05-11T01:01:10.845935+0000","last_clean":"2024-05-11T01:01:10.845935+0000","last_became_active":"2024-05-11T01:01:09.665406+0000","last_became_peered":"2024-05-11T01:01:09.665406+0000","last_unstale":"2024-05-11T01:01:10.845935+0000","last_undegraded":"2024-05-11T01:01:10.845935+0000","last_fullsized":"2024-05-11T01:01:10.845935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845152+0000","last_change":"2024-05-11T01:01:08.649715+0000","last_active":"2024-05-11T01:01:10.845152+0000","last_peered":"2024-05-11T01:01:10.845152+0000","last_clean":"2024-05-11T01:01:10.845152+0000","last_became_active":"2024-05-11T01:01:08.649344+0000","last_became_peered":"2024-05-11T01:01:08.649344+0000","last_unstale":"2024-05-11T01:01:10.845152+0000","last_undegraded":"2024-05-11T01:01:10.845152+0000","last_fullsized":"2024-05-11T01:01:10.845152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641228+0000","last_change":"2024-05-11T01:01:09.657070+0000","last_active":"2024-05-11T01:01:10.641228+0000","last_peered":"2024-05-11T01:01:10.641228+0000","last_clean":"2024-05-11T01:01:10.641228+0000","last_became_active":"2024-05-11T01:01:09.656800+0000","last_became_peered":"2024-05-11T01:01:09.656800+0000","last_unstale":"2024-05-11T01:01:10.641228+0000","last_undegraded":"2024-05-11T01:01:10.641228+0000","last_fullsized":"2024-05-11T01:01:10.641228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:06:53.835577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641100+0000","last_change":"2024-05-11T01:01:08.656669+0000","last_active":"2024-05-11T01:01:10.641100+0000","last_peered":"2024-05-11T01:01:10.641100+0000","last_clean":"2024-05-11T01:01:10.641100+0000","last_became_active":"2024-05-11T01:01:08.656381+0000","last_became_peered":"2024-05-11T01:01:08.656381+0000","last_unstale":"2024-05-11T01:01:10.641100+0000","last_undegraded":"2024-05-11T01:01:10.641100+0000","last_fullsized":"2024-05-11T01:01:10.641100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640537+0000","last_change":"2024-05-11T01:01:09.654699+0000","last_active":"2024-05-11T01:01:10.640537+0000","last_peered":"2024-05-11T01:01:10.640537+0000","last_clean":"2024-05-11T01:01:10.640537+0000","last_became_active":"2024-05-11T01:01:09.654453+0000","last_became_peered":"2024-05-11T01:01:09.654453+0000","last_unstale":"2024-05-11T01:01:10.640537+0000","last_undegraded":"2024-05-11T01:01:10.640537+0000","last_fullsized":"2024-05-11T01:01:10.640537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:30:25.516354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845632+0000","last_change":"2024-05-11T01:01:08.651433+0000","last_active":"2024-05-11T01:01:10.845632+0000","last_peered":"2024-05-11T01:01:10.845632+0000","last_clean":"2024-05-11T01:01:10.845632+0000","last_became_active":"2024-05-11T01:01:08.650413+0000","last_became_peered":"2024-05-11T01:01:08.650413+0000","last_unstale":"2024-05-11T01:01:10.845632+0000","last_undegraded":"2024-05-11T01:01:10.845632+0000","last_fullsized":"2024-05-11T01:01:10.845632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641446+0000","last_change":"2024-05-11T01:01:09.656493+0000","last_active":"2024-05-11T01:01:10.641446+0000","last_peered":"2024-05-11T01:01:10.641446+0000","last_clean":"2024-05-11T01:01:10.641446+0000","last_became_active":"2024-05-11T01:01:09.656244+0000","last_became_peered":"2024-05-11T01:01:09.656244+0000","last_unstale":"2024-05-11T01:01:10.641446+0000","last_undegraded":"2024-05-11T01:01:10.641446+0000","last_fullsized":"2024-05-11T01:01:10.641446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:07:55.577276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639446+0000","last_change":"2024-05-11T01:01:08.648337+0000","last_active":"2024-05-11T01:01:10.639446+0000","last_peered":"2024-05-11T01:01:10.639446+0000","last_clean":"2024-05-11T01:01:10.639446+0000","last_became_active":"2024-05-11T01:01:08.648027+0000","last_became_peered":"2024-05-11T01:01:08.648027+0000","last_unstale":"2024-05-11T01:01:10.639446+0000","last_undegraded":"2024-05-11T01:01:10.639446+0000","last_fullsized":"2024-05-11T01:01:10.639446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846751+0000","last_change":"2024-05-11T01:01:09.657860+0000","last_active":"2024-05-11T01:01:10.846751+0000","last_peered":"2024-05-11T01:01:10.846751+0000","last_clean":"2024-05-11T01:01:10.846751+0000","last_became_active":"2024-05-11T01:01:09.657169+0000","last_became_peered":"2024-05-11T01:01:09.657169+0000","last_unstale":"2024-05-11T01:01:10.846751+0000","last_undegraded":"2024-05-11T01:01:10.846751+0000","last_fullsized":"2024-05-11T01:01:10.846751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:22:02.787759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845376+0000","last_change":"2024-05-11T01:01:08.648806+0000","last_active":"2024-05-11T01:01:10.845376+0000","last_peered":"2024-05-11T01:01:10.845376+0000","last_clean":"2024-05-11T01:01:10.845376+0000","last_became_active":"2024-05-11T01:01:08.648140+0000","last_became_peered":"2024-05-11T01:01:08.648140+0000","last_unstale":"2024-05-11T01:01:10.845376+0000","last_undegraded":"2024-05-11T01:01:10.845376+0000","last_fullsized":"2024-05-11T01:01:10.845376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640743+0000","last_change":"2024-05-11T01:01:09.655326+0000","last_active":"2024-05-11T01:01:10.640743+0000","last_peered":"2024-05-11T01:01:10.640743+0000","last_clean":"2024-05-11T01:01:10.640743+0000","last_became_active":"2024-05-11T01:01:09.655056+0000","last_became_peered":"2024-05-11T01:01:09.655056+0000","last_unstale":"2024-05-11T01:01:10.640743+0000","last_undegraded":"2024-05-11T01:01:10.640743+0000","last_fullsized":"2024-05-11T01:01:10.640743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:22.764677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641362+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:10.641362+0000","last_peered":"2024-05-11T01:01:10.641362+0000","last_clean":"2024-05-11T01:01:10.641362+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:10.641362+0000","last_undegraded":"2024-05-11T01:01:10.641362+0000","last_fullsized":"2024-05-11T01:01:10.641362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846455+0000","last_change":"2024-05-11T01:01:08.649868+0000","last_active":"2024-05-11T01:01:10.846455+0000","last_peered":"2024-05-11T01:01:10.846455+0000","last_clean":"2024-05-11T01:01:10.846455+0000","last_became_active":"2024-05-11T01:01:08.649580+0000","last_became_peered":"2024-05-11T01:01:08.649580+0000","last_unstale":"2024-05-11T01:01:10.846455+0000","last_undegraded":"2024-05-11T01:01:10.846455+0000","last_fullsized":"2024-05-11T01:01:10.846455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845507+0000","last_change":"2024-05-11T01:01:09.653271+0000","last_active":"2024-05-11T01:01:10.845507+0000","last_peered":"2024-05-11T01:01:10.845507+0000","last_clean":"2024-05-11T01:01:10.845507+0000","last_became_active":"2024-05-11T01:01:09.652956+0000","last_became_peered":"2024-05-11T01:01:09.652956+0000","last_unstale":"2024-05-11T01:01:10.845507+0000","last_undegraded":"2024-05-11T01:01:10.845507+0000","last_fullsized":"2024-05-11T01:01:10.845507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640973+0000","last_change":"2024-05-11T01:01:08.659302+0000","last_active":"2024-05-11T01:01:10.640973+0000","last_peered":"2024-05-11T01:01:10.640973+0000","last_clean":"2024-05-11T01:01:10.640973+0000","last_became_active":"2024-05-11T01:01:08.658788+0000","last_became_peered":"2024-05-11T01:01:08.658788+0000","last_unstale":"2024-05-11T01:01:10.640973+0000","last_undegraded":"2024-05-11T01:01:10.640973+0000","last_fullsized":"2024-05-11T01:01:10.640973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778819+0000","last_change":"2024-05-11T01:01:09.645180+0000","last_active":"2024-05-11T01:01:10.778819+0000","last_peered":"2024-05-11T01:01:10.778819+0000","last_clean":"2024-05-11T01:01:10.778819+0000","last_became_active":"2024-05-11T01:01:09.644738+0000","last_became_peered":"2024-05-11T01:01:09.644738+0000","last_unstale":"2024-05-11T01:01:10.778819+0000","last_undegraded":"2024-05-11T01:01:10.778819+0000","last_fullsized":"2024-05-11T01:01:10.778819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:29:27.395704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845237+0000","last_change":"2024-05-11T01:01:08.648835+0000","last_active":"2024-05-11T01:01:10.845237+0000","last_peered":"2024-05-11T01:01:10.845237+0000","last_clean":"2024-05-11T01:01:10.845237+0000","last_became_active":"2024-05-11T01:01:08.648420+0000","last_became_peered":"2024-05-11T01:01:08.648420+0000","last_unstale":"2024-05-11T01:01:10.845237+0000","last_undegraded":"2024-05-11T01:01:10.845237+0000","last_fullsized":"2024-05-11T01:01:10.845237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639280+0000","last_change":"2024-05-11T01:01:09.653951+0000","last_active":"2024-05-11T01:01:10.639280+0000","last_peered":"2024-05-11T01:01:10.639280+0000","last_clean":"2024-05-11T01:01:10.639280+0000","last_became_active":"2024-05-11T01:01:09.653685+0000","last_became_peered":"2024-05-11T01:01:09.653685+0000","last_unstale":"2024-05-11T01:01:10.639280+0000","last_undegraded":"2024-05-11T01:01:10.639280+0000","last_fullsized":"2024-05-11T01:01:10.639280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846373+0000","last_change":"2024-05-11T01:01:08.655055+0000","last_active":"2024-05-11T01:01:10.846373+0000","last_peered":"2024-05-11T01:01:10.846373+0000","last_clean":"2024-05-11T01:01:10.846373+0000","last_became_active":"2024-05-11T01:01:08.654780+0000","last_became_peered":"2024-05-11T01:01:08.654780+0000","last_unstale":"2024-05-11T01:01:10.846373+0000","last_undegraded":"2024-05-11T01:01:10.846373+0000","last_fullsized":"2024-05-11T01:01:10.846373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641446+0000","last_change":"2024-05-11T01:01:09.648560+0000","last_active":"2024-05-11T01:01:10.641446+0000","last_peered":"2024-05-11T01:01:10.641446+0000","last_clean":"2024-05-11T01:01:10.641446+0000","last_became_active":"2024-05-11T01:01:09.647285+0000","last_became_peered":"2024-05-11T01:01:09.647285+0000","last_unstale":"2024-05-11T01:01:10.641446+0000","last_undegraded":"2024-05-11T01:01:10.641446+0000","last_fullsized":"2024-05-11T01:01:10.641446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:54.570608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639066+0000","last_change":"2024-05-11T01:01:08.656434+0000","last_active":"2024-05-11T01:01:10.639066+0000","last_peered":"2024-05-11T01:01:10.639066+0000","last_clean":"2024-05-11T01:01:10.639066+0000","last_became_active":"2024-05-11T01:01:08.656111+0000","last_became_peered":"2024-05-11T01:01:08.656111+0000","last_unstale":"2024-05-11T01:01:10.639066+0000","last_undegraded":"2024-05-11T01:01:10.639066+0000","last_fullsized":"2024-05-11T01:01:10.639066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846789+0000","last_change":"2024-05-11T01:01:09.658868+0000","last_active":"2024-05-11T01:01:10.846789+0000","last_peered":"2024-05-11T01:01:10.846789+0000","last_clean":"2024-05-11T01:01:10.846789+0000","last_became_active":"2024-05-11T01:01:09.658511+0000","last_became_peered":"2024-05-11T01:01:09.658511+0000","last_unstale":"2024-05-11T01:01:10.846789+0000","last_undegraded":"2024-05-11T01:01:10.846789+0000","last_fullsized":"2024-05-11T01:01:10.846789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:54.872438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641036+0000","last_change":"2024-05-11T01:01:08.656666+0000","last_active":"2024-05-11T01:01:10.641036+0000","last_peered":"2024-05-11T01:01:10.641036+0000","last_clean":"2024-05-11T01:01:10.641036+0000","last_became_active":"2024-05-11T01:01:08.656387+0000","last_became_peered":"2024-05-11T01:01:08.656387+0000","last_unstale":"2024-05-11T01:01:10.641036+0000","last_undegraded":"2024-05-11T01:01:10.641036+0000","last_fullsized":"2024-05-11T01:01:10.641036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:23:24.406370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639094+0000","last_change":"2024-05-11T01:01:09.652521+0000","last_active":"2024-05-11T01:01:10.639094+0000","last_peered":"2024-05-11T01:01:10.639094+0000","last_clean":"2024-05-11T01:01:10.639094+0000","last_became_active":"2024-05-11T01:01:09.652239+0000","last_became_peered":"2024-05-11T01:01:09.652239+0000","last_unstale":"2024-05-11T01:01:10.639094+0000","last_undegraded":"2024-05-11T01:01:10.639094+0000","last_fullsized":"2024-05-11T01:01:10.639094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639337+0000","last_change":"2024-05-11T01:01:08.658432+0000","last_active":"2024-05-11T01:01:10.639337+0000","last_peered":"2024-05-11T01:01:10.639337+0000","last_clean":"2024-05-11T01:01:10.639337+0000","last_became_active":"2024-05-11T01:01:08.658089+0000","last_became_peered":"2024-05-11T01:01:08.658089+0000","last_unstale":"2024-05-11T01:01:10.639337+0000","last_undegraded":"2024-05-11T01:01:10.639337+0000","last_fullsized":"2024-05-11T01:01:10.639337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845574+0000","last_change":"2024-05-11T01:01:09.661121+0000","last_active":"2024-05-11T01:01:10.845574+0000","last_peered":"2024-05-11T01:01:10.845574+0000","last_clean":"2024-05-11T01:01:10.845574+0000","last_became_active":"2024-05-11T01:01:09.660835+0000","last_became_peered":"2024-05-11T01:01:09.660835+0000","last_unstale":"2024-05-11T01:01:10.845574+0000","last_undegraded":"2024-05-11T01:01:10.845574+0000","last_fullsized":"2024-05-11T01:01:10.845574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846134+0000","last_change":"2024-05-11T01:01:08.658073+0000","last_active":"2024-05-11T01:01:10.846134+0000","last_peered":"2024-05-11T01:01:10.846134+0000","last_clean":"2024-05-11T01:01:10.846134+0000","last_became_active":"2024-05-11T01:01:08.657786+0000","last_became_peered":"2024-05-11T01:01:08.657786+0000","last_unstale":"2024-05-11T01:01:10.846134+0000","last_undegraded":"2024-05-11T01:01:10.846134+0000","last_fullsized":"2024-05-11T01:01:10.846134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779153+0000","last_change":"2024-05-11T01:01:09.658616+0000","last_active":"2024-05-11T01:01:10.779153+0000","last_peered":"2024-05-11T01:01:10.779153+0000","last_clean":"2024-05-11T01:01:10.779153+0000","last_became_active":"2024-05-11T01:01:09.657620+0000","last_became_peered":"2024-05-11T01:01:09.657620+0000","last_unstale":"2024-05-11T01:01:10.779153+0000","last_undegraded":"2024-05-11T01:01:10.779153+0000","last_fullsized":"2024-05-11T01:01:10.779153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640026+0000","last_change":"2024-05-11T01:01:08.658520+0000","last_active":"2024-05-11T01:01:10.640026+0000","last_peered":"2024-05-11T01:01:10.640026+0000","last_clean":"2024-05-11T01:01:10.640026+0000","last_became_active":"2024-05-11T01:01:08.657670+0000","last_became_peered":"2024-05-11T01:01:08.657670+0000","last_unstale":"2024-05-11T01:01:10.640026+0000","last_undegraded":"2024-05-11T01:01:10.640026+0000","last_fullsized":"2024-05-11T01:01:10.640026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640373+0000","last_change":"2024-05-11T01:01:09.653422+0000","last_active":"2024-05-11T01:01:10.640373+0000","last_peered":"2024-05-11T01:01:10.640373+0000","last_clean":"2024-05-11T01:01:10.640373+0000","last_became_active":"2024-05-11T01:01:09.652720+0000","last_became_peered":"2024-05-11T01:01:09.652720+0000","last_unstale":"2024-05-11T01:01:10.640373+0000","last_undegraded":"2024-05-11T01:01:10.640373+0000","last_fullsized":"2024-05-11T01:01:10.640373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:57.610871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639184+0000","last_change":"2024-05-11T01:01:08.653589+0000","last_active":"2024-05-11T01:01:10.639184+0000","last_peered":"2024-05-11T01:01:10.639184+0000","last_clean":"2024-05-11T01:01:10.639184+0000","last_became_active":"2024-05-11T01:01:08.653254+0000","last_became_peered":"2024-05-11T01:01:08.653254+0000","last_unstale":"2024-05-11T01:01:10.639184+0000","last_undegraded":"2024-05-11T01:01:10.639184+0000","last_fullsized":"2024-05-11T01:01:10.639184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:13.592931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845596+0000","last_change":"2024-05-11T01:01:09.659317+0000","last_active":"2024-05-11T01:01:10.845596+0000","last_peered":"2024-05-11T01:01:10.845596+0000","last_clean":"2024-05-11T01:01:10.845596+0000","last_became_active":"2024-05-11T01:01:09.658793+0000","last_became_peered":"2024-05-11T01:01:09.658793+0000","last_unstale":"2024-05-11T01:01:10.845596+0000","last_undegraded":"2024-05-11T01:01:10.845596+0000","last_fullsized":"2024-05-11T01:01:10.845596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639298+0000","last_change":"2024-05-11T01:01:08.653913+0000","last_active":"2024-05-11T01:01:10.639298+0000","last_peered":"2024-05-11T01:01:10.639298+0000","last_clean":"2024-05-11T01:01:10.639298+0000","last_became_active":"2024-05-11T01:01:08.653485+0000","last_became_peered":"2024-05-11T01:01:08.653485+0000","last_unstale":"2024-05-11T01:01:10.639298+0000","last_undegraded":"2024-05-11T01:01:10.639298+0000","last_fullsized":"2024-05-11T01:01:10.639298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845721+0000","last_change":"2024-05-11T01:01:09.663043+0000","last_active":"2024-05-11T01:01:10.845721+0000","last_peered":"2024-05-11T01:01:10.845721+0000","last_clean":"2024-05-11T01:01:10.845721+0000","last_became_active":"2024-05-11T01:01:09.662331+0000","last_became_peered":"2024-05-11T01:01:09.662331+0000","last_unstale":"2024-05-11T01:01:10.845721+0000","last_undegraded":"2024-05-11T01:01:10.845721+0000","last_fullsized":"2024-05-11T01:01:10.845721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641204+0000","last_change":"2024-05-11T01:01:08.658594+0000","last_active":"2024-05-11T01:01:10.641204+0000","last_peered":"2024-05-11T01:01:10.641204+0000","last_clean":"2024-05-11T01:01:10.641204+0000","last_became_active":"2024-05-11T01:01:08.658310+0000","last_became_peered":"2024-05-11T01:01:08.658310+0000","last_unstale":"2024-05-11T01:01:10.641204+0000","last_undegraded":"2024-05-11T01:01:10.641204+0000","last_fullsized":"2024-05-11T01:01:10.641204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:44:19.535130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845797+0000","last_change":"2024-05-11T01:01:09.653439+0000","last_active":"2024-05-11T01:01:10.845797+0000","last_peered":"2024-05-11T01:01:10.845797+0000","last_clean":"2024-05-11T01:01:10.845797+0000","last_became_active":"2024-05-11T01:01:09.653150+0000","last_became_peered":"2024-05-11T01:01:09.653150+0000","last_unstale":"2024-05-11T01:01:10.845797+0000","last_undegraded":"2024-05-11T01:01:10.845797+0000","last_fullsized":"2024-05-11T01:01:10.845797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846741+0000","last_change":"2024-05-11T01:01:09.652866+0000","last_active":"2024-05-11T01:01:10.846741+0000","last_peered":"2024-05-11T01:01:10.846741+0000","last_clean":"2024-05-11T01:01:10.846741+0000","last_became_active":"2024-05-11T01:01:09.652016+0000","last_became_peered":"2024-05-11T01:01:09.652016+0000","last_unstale":"2024-05-11T01:01:10.846741+0000","last_undegraded":"2024-05-11T01:01:10.846741+0000","last_fullsized":"2024-05-11T01:01:10.846741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:17.765368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640394+0000","last_change":"2024-05-11T01:01:08.656072+0000","last_active":"2024-05-11T01:01:10.640394+0000","last_peered":"2024-05-11T01:01:10.640394+0000","last_clean":"2024-05-11T01:01:10.640394+0000","last_became_active":"2024-05-11T01:01:08.655793+0000","last_became_peered":"2024-05-11T01:01:08.655793+0000","last_unstale":"2024-05-11T01:01:10.640394+0000","last_undegraded":"2024-05-11T01:01:10.640394+0000","last_fullsized":"2024-05-11T01:01:10.640394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:13.592931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846596+0000","last_change":"2024-05-11T01:01:09.655397+0000","last_active":"2024-05-11T01:01:10.846596+0000","last_peered":"2024-05-11T01:01:10.846596+0000","last_clean":"2024-05-11T01:01:10.846596+0000","last_became_active":"2024-05-11T01:01:09.654703+0000","last_became_peered":"2024-05-11T01:01:09.654703+0000","last_unstale":"2024-05-11T01:01:10.846596+0000","last_undegraded":"2024-05-11T01:01:10.846596+0000","last_fullsized":"2024-05-11T01:01:10.846596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:30:25.516354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640775+0000","last_change":"2024-05-11T01:01:08.659252+0000","last_active":"2024-05-11T01:01:10.640775+0000","last_peered":"2024-05-11T01:01:10.640775+0000","last_clean":"2024-05-11T01:01:10.640775+0000","last_became_active":"2024-05-11T01:01:08.658942+0000","last_became_peered":"2024-05-11T01:01:08.658942+0000","last_unstale":"2024-05-11T01:01:10.640775+0000","last_undegraded":"2024-05-11T01:01:10.640775+0000","last_fullsized":"2024-05-11T01:01:10.640775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:53.568441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779182+0000","last_change":"2024-05-11T01:01:09.653451+0000","last_active":"2024-05-11T01:01:10.779182+0000","last_peered":"2024-05-11T01:01:10.779182+0000","last_clean":"2024-05-11T01:01:10.779182+0000","last_became_active":"2024-05-11T01:01:09.653028+0000","last_became_peered":"2024-05-11T01:01:09.653028+0000","last_unstale":"2024-05-11T01:01:10.779182+0000","last_undegraded":"2024-05-11T01:01:10.779182+0000","last_fullsized":"2024-05-11T01:01:10.779182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845867+0000","last_change":"2024-05-11T01:01:08.655897+0000","last_active":"2024-05-11T01:01:10.845867+0000","last_peered":"2024-05-11T01:01:10.845867+0000","last_clean":"2024-05-11T01:01:10.845867+0000","last_became_active":"2024-05-11T01:01:08.655602+0000","last_became_peered":"2024-05-11T01:01:08.655602+0000","last_unstale":"2024-05-11T01:01:10.845867+0000","last_undegraded":"2024-05-11T01:01:10.845867+0000","last_fullsized":"2024-05-11T01:01:10.845867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845779+0000","last_change":"2024-05-11T01:01:09.663811+0000","last_active":"2024-05-11T01:01:10.845779+0000","last_peered":"2024-05-11T01:01:10.845779+0000","last_clean":"2024-05-11T01:01:10.845779+0000","last_became_active":"2024-05-11T01:01:09.663489+0000","last_became_peered":"2024-05-11T01:01:09.663489+0000","last_unstale":"2024-05-11T01:01:10.845779+0000","last_undegraded":"2024-05-11T01:01:10.845779+0000","last_fullsized":"2024-05-11T01:01:10.845779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779259+0000","last_change":"2024-05-11T01:01:08.657362+0000","last_active":"2024-05-11T01:01:10.779259+0000","last_peered":"2024-05-11T01:01:10.779259+0000","last_clean":"2024-05-11T01:01:10.779259+0000","last_became_active":"2024-05-11T01:01:08.657072+0000","last_became_peered":"2024-05-11T01:01:08.657072+0000","last_unstale":"2024-05-11T01:01:10.779259+0000","last_undegraded":"2024-05-11T01:01:10.779259+0000","last_fullsized":"2024-05-11T01:01:10.779259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:22.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:22.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.961+0000 7fe926546640 1 Processor -- start 2024-05-11T01:01:22.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.961+0000 7fe926546640 1 -- start start 2024-05-11T01:01:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe926546640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe92015f670 0x7fe9200d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe926546640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9200d3ce0 con 0x7fe9200d3370 2024-05-11T01:01:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe926546640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9200d3fc0 con 0x7fe9200b7480 2024-05-11T01:01:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe926546640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe9200d48f0 con 0x7fe92015f670 2024-05-11T01:01:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe91ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe92015f670 0x7fe9200d4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe91f7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe9200d3370 0x7fe9200b6d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42878/0 (socket says 172.21.15.16:42878) 2024-05-11T01:01:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe91f7fe640 1 -- 172.21.15.16:0/3807882224 learned_addr learned my addr 172.21.15.16:0/3807882224 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe91ffff640 1 -- 172.21.15.16:0/3807882224 >> v1:172.21.15.174:6789/0 conn(0x7fe9200b7480 legacy=0x7fe9200b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe91ffff640 1 -- 172.21.15.16:0/3807882224 >> v1:172.21.15.16:6789/0 conn(0x7fe9200d3370 legacy=0x7fe9200b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.962+0000 7fe91ffff640 1 -- 172.21.15.16:0/3807882224 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9200d42a0 con 0x7fe92015f670 2024-05-11T01:01:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.963+0000 7fe91ffff640 1 --2- 172.21.15.16:0/3807882224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92015f670 0x7fe9200d4d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9100097a0 tx=0x7fe91002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11a4a72e5b5c538 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.963+0000 7fe91effd640 1 -- 172.21.15.16:0/3807882224 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910037070 con 0x7fe92015f670 2024-05-11T01:01:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.963+0000 7fe91effd640 1 -- 172.21.15.16:0/3807882224 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe910032440 con 0x7fe92015f670 2024-05-11T01:01:22.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.963+0000 7fe91effd640 1 -- 172.21.15.16:0/3807882224 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910032810 con 0x7fe92015f670 2024-05-11T01:01:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.964+0000 7fe926546640 1 -- 172.21.15.16:0/3807882224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92015f670 msgr2=0x7fe9200d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.964+0000 7fe926546640 1 --2- 172.21.15.16:0/3807882224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92015f670 0x7fe9200d4d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe9100097a0 tx=0x7fe91002a230 comp rx=0 tx=0).stop 2024-05-11T01:01:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.964+0000 7fe926546640 1 -- 172.21.15.16:0/3807882224 shutdown_connections 2024-05-11T01:01:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.964+0000 7fe926546640 1 --2- 172.21.15.16:0/3807882224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe92015f670 0x7fe9200d4d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.964+0000 7fe926546640 1 -- 172.21.15.16:0/3807882224 >> 172.21.15.16:0/3807882224 conn(0x7fe920074140 msgr2=0x7fe9200d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.964+0000 7fe926546640 1 -- 172.21.15.16:0/3807882224 shutdown_connections 2024-05-11T01:01:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.964+0000 7fe926546640 1 -- 172.21.15.16:0/3807882224 wait complete. 2024-05-11T01:01:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.965+0000 7fe926546640 1 Processor -- start 2024-05-11T01:01:22.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.965+0000 7fe926546640 1 -- start start 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe926546640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9200b7480 0x7fe92015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe926546640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9200d3370 0x7fe92014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe926546640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92015f670 0x7fe9201623c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe926546640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe9200bb1c0 con 0x7fe9200b7480 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe926546640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe9200bb040 con 0x7fe9200d3370 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe926546640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe9200d3800 con 0x7fe92015f670 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9200b7480 0x7fe92015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9200b7480 0x7fe92015fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46632/0 (socket says 172.21.15.16:46632) 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91ffff640 1 -- 172.21.15.16:0/2604098282 learned_addr learned my addr 172.21.15.16:0/2604098282 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:22.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91f7fe640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9200d3370 0x7fe92014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe924ae3640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92015f670 0x7fe9201623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91ffff640 1 -- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92015f670 msgr2=0x7fe9201623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91ffff640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92015f670 0x7fe9201623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91ffff640 1 -- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9200d3370 msgr2=0x7fe92014e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91ffff640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9200d3370 0x7fe92014e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.966+0000 7fe91ffff640 1 -- 172.21.15.16:0/2604098282 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92014eea0 con 0x7fe9200b7480 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.967+0000 7fe91ffff640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9200b7480 0x7fe92015fac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe910035040 tx=0x7fe9100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.967+0000 7fe91cff9640 1 -- 172.21.15.16:0/2604098282 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910037040 con 0x7fe9200b7480 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.967+0000 7fe91cff9640 1 -- 172.21.15.16:0/2604098282 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe910030770 con 0x7fe9200b7480 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.967+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe920160110 con 0x7fe9200b7480 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.967+0000 7fe91cff9640 1 -- 172.21.15.16:0/2604098282 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910030b80 con 0x7fe9200b7480 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.967+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9201606d0 con 0x7fe9200b7480 2024-05-11T01:01:22.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.968+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe92006a5b0 con 0x7fe9200b7480 2024-05-11T01:01:22.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.968+0000 7fe91cff9640 1 -- 172.21.15.16:0/2604098282 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe910044020 con 0x7fe9200b7480 2024-05-11T01:01:22.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.969+0000 7fe91cff9640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe90c0762d0 0x7fe90c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:22.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.969+0000 7fe91cff9640 1 -- 172.21.15.16:0/2604098282 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe9100b7bf0 con 0x7fe9200b7480 2024-05-11T01:01:22.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.969+0000 7fe91f7fe640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe90c0762d0 0x7fe90c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:22.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.970+0000 7fe91f7fe640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe90c0762d0 0x7fe90c078790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe92015c280 tx=0x7fe914009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:22.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:22.973+0000 7fe91cff9640 1 -- 172.21.15.16:0/2604098282 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe910032e20 con 0x7fe9200b7480 2024-05-11T01:01:23.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.162+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe920162db0 con 0x7fe90c0762d0 2024-05-11T01:01:23.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.168+0000 7fe91cff9640 1 -- 172.21.15.16:0/2604098282 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7fe920162db0 con 0x7fe90c0762d0 2024-05-11T01:01:23.171 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:23.172 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:23.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe90c0762d0 msgr2=0x7fe90c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe90c0762d0 0x7fe90c078790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe92015c280 tx=0x7fe914009040 comp rx=0 tx=0).stop 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9200b7480 msgr2=0x7fe92015fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9200b7480 0x7fe92015fac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe910035040 tx=0x7fe9100046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 shutdown_connections 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe90c0762d0 0x7fe90c078790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe92015f670 0x7fe9201623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9200d3370 0x7fe92014e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 --2- 172.21.15.16:0/2604098282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9200b7480 0x7fe92015fac0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 >> 172.21.15.16:0/2604098282 conn(0x7fe920074140 msgr2=0x7fe9200b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 shutdown_connections 2024-05-11T01:01:23.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.171+0000 7fe926546640 1 -- 172.21.15.16:0/2604098282 wait complete. 2024-05-11T01:01:23.182 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-05-11T01:01:21.758102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235648,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739072,"statfs":{"total":773094113280,"available":772852809728,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.119565"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640769+0000","last_change":"2024-05-11T01:01:09.660889+0000","last_active":"2024-05-11T01:01:10.640769+0000","last_peered":"2024-05-11T01:01:10.640769+0000","last_clean":"2024-05-11T01:01:10.640769+0000","last_became_active":"2024-05-11T01:01:09.660592+0000","last_became_peered":"2024-05-11T01:01:09.660592+0000","last_unstale":"2024-05-11T01:01:10.640769+0000","last_undegraded":"2024-05-11T01:01:10.640769+0000","last_fullsized":"2024-05-11T01:01:10.640769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:17.765368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639355+0000","last_change":"2024-05-11T01:01:09.662924+0000","last_active":"2024-05-11T01:01:10.639355+0000","last_peered":"2024-05-11T01:01:10.639355+0000","last_clean":"2024-05-11T01:01:10.639355+0000","last_became_active":"2024-05-11T01:01:09.662613+0000","last_became_peered":"2024-05-11T01:01:09.662613+0000","last_unstale":"2024-05-11T01:01:10.639355+0000","last_undegraded":"2024-05-11T01:01:10.639355+0000","last_fullsized":"2024-05-11T01:01:10.639355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779001+0000","last_change":"2024-05-11T01:01:09.650637+0000","last_active":"2024-05-11T01:01:10.779001+0000","last_peered":"2024-05-11T01:01:10.779001+0000","last_clean":"2024-05-11T01:01:10.779001+0000","last_became_active":"2024-05-11T01:01:09.650045+0000","last_became_peered":"2024-05-11T01:01:09.650045+0000","last_unstale":"2024-05-11T01:01:10.779001+0000","last_undegraded":"2024-05-11T01:01:10.779001+0000","last_fullsized":"2024-05-11T01:01:10.779001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846578+0000","last_change":"2024-05-11T01:01:09.659637+0000","last_active":"2024-05-11T01:01:10.846578+0000","last_peered":"2024-05-11T01:01:10.846578+0000","last_clean":"2024-05-11T01:01:10.846578+0000","last_became_active":"2024-05-11T01:01:09.659340+0000","last_became_peered":"2024-05-11T01:01:09.659340+0000","last_unstale":"2024-05-11T01:01:10.846578+0000","last_undegraded":"2024-05-11T01:01:10.846578+0000","last_fullsized":"2024-05-11T01:01:10.846578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:20:29.060496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641126+0000","last_change":"2024-05-11T01:01:09.659284+0000","last_active":"2024-05-11T01:01:10.641126+0000","last_peered":"2024-05-11T01:01:10.641126+0000","last_clean":"2024-05-11T01:01:10.641126+0000","last_became_active":"2024-05-11T01:01:09.658998+0000","last_became_peered":"2024-05-11T01:01:09.658998+0000","last_unstale":"2024-05-11T01:01:10.641126+0000","last_undegraded":"2024-05-11T01:01:10.641126+0000","last_fullsized":"2024-05-11T01:01:10.641126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:00:58.091438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845862+0000","last_change":"2024-05-11T01:01:09.664661+0000","last_active":"2024-05-11T01:01:10.845862+0000","last_peered":"2024-05-11T01:01:10.845862+0000","last_clean":"2024-05-11T01:01:10.845862+0000","last_became_active":"2024-05-11T01:01:09.664406+0000","last_became_peered":"2024-05-11T01:01:09.664406+0000","last_unstale":"2024-05-11T01:01:10.845862+0000","last_undegraded":"2024-05-11T01:01:10.845862+0000","last_fullsized":"2024-05-11T01:01:10.845862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:33:53.314387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640617+0000","last_change":"2024-05-11T01:01:09.659105+0000","last_active":"2024-05-11T01:01:10.640617+0000","last_peered":"2024-05-11T01:01:10.640617+0000","last_clean":"2024-05-11T01:01:10.640617+0000","last_became_active":"2024-05-11T01:01:09.658744+0000","last_became_peered":"2024-05-11T01:01:09.658744+0000","last_unstale":"2024-05-11T01:01:10.640617+0000","last_undegraded":"2024-05-11T01:01:10.640617+0000","last_fullsized":"2024-05-11T01:01:10.640617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:20:29.060496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845412+0000","last_change":"2024-05-11T01:01:09.659097+0000","last_active":"2024-05-11T01:01:10.845412+0000","last_peered":"2024-05-11T01:01:10.845412+0000","last_clean":"2024-05-11T01:01:10.845412+0000","last_became_active":"2024-05-11T01:01:09.658407+0000","last_became_peered":"2024-05-11T01:01:09.658407+0000","last_unstale":"2024-05-11T01:01:10.845412+0000","last_undegraded":"2024-05-11T01:01:10.845412+0000","last_fullsized":"2024-05-11T01:01:10.845412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:12:46.155019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641575+0000","last_change":"2024-05-11T01:01:09.654158+0000","last_active":"2024-05-11T01:01:10.641575+0000","last_peered":"2024-05-11T01:01:10.641575+0000","last_clean":"2024-05-11T01:01:10.641575+0000","last_became_active":"2024-05-11T01:01:09.653934+0000","last_became_peered":"2024-05-11T01:01:09.653934+0000","last_unstale":"2024-05-11T01:01:10.641575+0000","last_undegraded":"2024-05-11T01:01:10.641575+0000","last_fullsized":"2024-05-11T01:01:10.641575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:58:08.244849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846277+0000","last_change":"2024-05-11T01:01:09.651801+0000","last_active":"2024-05-11T01:01:10.846277+0000","last_peered":"2024-05-11T01:01:10.846277+0000","last_clean":"2024-05-11T01:01:10.846277+0000","last_became_active":"2024-05-11T01:01:09.651532+0000","last_became_peered":"2024-05-11T01:01:09.651532+0000","last_unstale":"2024-05-11T01:01:10.846277+0000","last_undegraded":"2024-05-11T01:01:10.846277+0000","last_fullsized":"2024-05-11T01:01:10.846277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846187+0000","last_change":"2024-05-11T01:01:09.651881+0000","last_active":"2024-05-11T01:01:10.846187+0000","last_peered":"2024-05-11T01:01:10.846187+0000","last_clean":"2024-05-11T01:01:10.846187+0000","last_became_active":"2024-05-11T01:01:09.651604+0000","last_became_peered":"2024-05-11T01:01:09.651604+0000","last_unstale":"2024-05-11T01:01:10.846187+0000","last_undegraded":"2024-05-11T01:01:10.846187+0000","last_fullsized":"2024-05-11T01:01:10.846187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640658+0000","last_change":"2024-05-11T01:01:09.654040+0000","last_active":"2024-05-11T01:01:10.640658+0000","last_peered":"2024-05-11T01:01:10.640658+0000","last_clean":"2024-05-11T01:01:10.640658+0000","last_became_active":"2024-05-11T01:01:09.653631+0000","last_became_peered":"2024-05-11T01:01:09.653631+0000","last_unstale":"2024-05-11T01:01:10.640658+0000","last_undegraded":"2024-05-11T01:01:10.640658+0000","last_fullsized":"2024-05-11T01:01:10.640658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:49.875866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845788+0000","last_change":"2024-05-11T01:01:09.663289+0000","last_active":"2024-05-11T01:01:10.845788+0000","last_peered":"2024-05-11T01:01:10.845788+0000","last_clean":"2024-05-11T01:01:10.845788+0000","last_became_active":"2024-05-11T01:01:09.662768+0000","last_became_peered":"2024-05-11T01:01:09.662768+0000","last_unstale":"2024-05-11T01:01:10.845788+0000","last_undegraded":"2024-05-11T01:01:10.845788+0000","last_fullsized":"2024-05-11T01:01:10.845788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:33:53.314387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778816+0000","last_change":"2024-05-11T01:01:09.658330+0000","last_active":"2024-05-11T01:01:10.778816+0000","last_peered":"2024-05-11T01:01:10.778816+0000","last_clean":"2024-05-11T01:01:10.778816+0000","last_became_active":"2024-05-11T01:01:09.658033+0000","last_became_peered":"2024-05-11T01:01:09.658033+0000","last_unstale":"2024-05-11T01:01:10.778816+0000","last_undegraded":"2024-05-11T01:01:10.778816+0000","last_fullsized":"2024-05-11T01:01:10.778816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:07:25.386437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639081+0000","last_change":"2024-05-11T01:01:09.653835+0000","last_active":"2024-05-11T01:01:10.639081+0000","last_peered":"2024-05-11T01:01:10.639081+0000","last_clean":"2024-05-11T01:01:10.639081+0000","last_became_active":"2024-05-11T01:01:09.653540+0000","last_became_peered":"2024-05-11T01:01:09.653540+0000","last_unstale":"2024-05-11T01:01:10.639081+0000","last_undegraded":"2024-05-11T01:01:10.639081+0000","last_fullsized":"2024-05-11T01:01:10.639081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845739+0000","last_change":"2024-05-11T01:01:09.666863+0000","last_active":"2024-05-11T01:01:10.845739+0000","last_peered":"2024-05-11T01:01:10.845739+0000","last_clean":"2024-05-11T01:01:10.845739+0000","last_became_active":"2024-05-11T01:01:09.666571+0000","last_became_peered":"2024-05-11T01:01:09.666571+0000","last_unstale":"2024-05-11T01:01:10.845739+0000","last_undegraded":"2024-05-11T01:01:10.845739+0000","last_fullsized":"2024-05-11T01:01:10.845739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.847013+0000","last_change":"2024-05-11T01:01:09.663210+0000","last_active":"2024-05-11T01:01:10.847013+0000","last_peered":"2024-05-11T01:01:10.847013+0000","last_clean":"2024-05-11T01:01:10.847013+0000","last_became_active":"2024-05-11T01:01:09.662958+0000","last_became_peered":"2024-05-11T01:01:09.662958+0000","last_unstale":"2024-05-11T01:01:10.847013+0000","last_undegraded":"2024-05-11T01:01:10.847013+0000","last_fullsized":"2024-05-11T01:01:10.847013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:06:53.835577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845545+0000","last_change":"2024-05-11T01:01:09.652062+0000","last_active":"2024-05-11T01:01:10.845545+0000","last_peered":"2024-05-11T01:01:10.845545+0000","last_clean":"2024-05-11T01:01:10.845545+0000","last_became_active":"2024-05-11T01:01:09.651794+0000","last_became_peered":"2024-05-11T01:01:09.651794+0000","last_unstale":"2024-05-11T01:01:10.845545+0000","last_undegraded":"2024-05-11T01:01:10.845545+0000","last_fullsized":"2024-05-11T01:01:10.845545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:54.570608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640929+0000","last_change":"2024-05-11T01:01:09.662186+0000","last_active":"2024-05-11T01:01:10.640929+0000","last_peered":"2024-05-11T01:01:10.640929+0000","last_clean":"2024-05-11T01:01:10.640929+0000","last_became_active":"2024-05-11T01:01:09.661941+0000","last_became_peered":"2024-05-11T01:01:09.661941+0000","last_unstale":"2024-05-11T01:01:10.640929+0000","last_undegraded":"2024-05-11T01:01:10.640929+0000","last_fullsized":"2024-05-11T01:01:10.640929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:22:02.787759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846174+0000","last_change":"2024-05-11T01:01:09.655262+0000","last_active":"2024-05-11T01:01:10.846174+0000","last_peered":"2024-05-11T01:01:10.846174+0000","last_clean":"2024-05-11T01:01:10.846174+0000","last_became_active":"2024-05-11T01:01:09.654951+0000","last_became_peered":"2024-05-11T01:01:09.654951+0000","last_unstale":"2024-05-11T01:01:10.846174+0000","last_undegraded":"2024-05-11T01:01:10.846174+0000","last_fullsized":"2024-05-11T01:01:10.846174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778938+0000","last_change":"2024-05-11T01:01:09.649231+0000","last_active":"2024-05-11T01:01:10.778938+0000","last_peered":"2024-05-11T01:01:10.778938+0000","last_clean":"2024-05-11T01:01:10.778938+0000","last_became_active":"2024-05-11T01:01:09.648920+0000","last_became_peered":"2024-05-11T01:01:09.648920+0000","last_unstale":"2024-05-11T01:01:10.778938+0000","last_undegraded":"2024-05-11T01:01:10.778938+0000","last_fullsized":"2024-05-11T01:01:10.778938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:12:46.155019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846056+0000","last_change":"2024-05-11T01:01:09.663855+0000","last_active":"2024-05-11T01:01:10.846056+0000","last_peered":"2024-05-11T01:01:10.846056+0000","last_clean":"2024-05-11T01:01:10.846056+0000","last_became_active":"2024-05-11T01:01:09.663614+0000","last_became_peered":"2024-05-11T01:01:09.663614+0000","last_unstale":"2024-05-11T01:01:10.846056+0000","last_undegraded":"2024-05-11T01:01:10.846056+0000","last_fullsized":"2024-05-11T01:01:10.846056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:30.522539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845782+0000","last_change":"2024-05-11T01:01:09.656048+0000","last_active":"2024-05-11T01:01:10.845782+0000","last_peered":"2024-05-11T01:01:10.845782+0000","last_clean":"2024-05-11T01:01:10.845782+0000","last_became_active":"2024-05-11T01:01:09.655764+0000","last_became_peered":"2024-05-11T01:01:09.655764+0000","last_unstale":"2024-05-11T01:01:10.845782+0000","last_undegraded":"2024-05-11T01:01:10.845782+0000","last_fullsized":"2024-05-11T01:01:10.845782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845810+0000","last_change":"2024-05-11T01:01:09.657669+0000","last_active":"2024-05-11T01:01:10.845810+0000","last_peered":"2024-05-11T01:01:10.845810+0000","last_clean":"2024-05-11T01:01:10.845810+0000","last_became_active":"2024-05-11T01:01:09.657391+0000","last_became_peered":"2024-05-11T01:01:09.657391+0000","last_unstale":"2024-05-11T01:01:10.845810+0000","last_undegraded":"2024-05-11T01:01:10.845810+0000","last_fullsized":"2024-05-11T01:01:10.845810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845432+0000","last_change":"2024-05-11T01:01:09.657628+0000","last_active":"2024-05-11T01:01:10.845432+0000","last_peered":"2024-05-11T01:01:10.845432+0000","last_clean":"2024-05-11T01:01:10.845432+0000","last_became_active":"2024-05-11T01:01:09.656250+0000","last_became_peered":"2024-05-11T01:01:09.656250+0000","last_unstale":"2024-05-11T01:01:10.845432+0000","last_undegraded":"2024-05-11T01:01:10.845432+0000","last_fullsized":"2024-05-11T01:01:10.845432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846487+0000","last_change":"2024-05-11T01:01:09.662365+0000","last_active":"2024-05-11T01:01:10.846487+0000","last_peered":"2024-05-11T01:01:10.846487+0000","last_clean":"2024-05-11T01:01:10.846487+0000","last_became_active":"2024-05-11T01:01:09.662090+0000","last_became_peered":"2024-05-11T01:01:09.662090+0000","last_unstale":"2024-05-11T01:01:10.846487+0000","last_undegraded":"2024-05-11T01:01:10.846487+0000","last_fullsized":"2024-05-11T01:01:10.846487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639359+0000","last_change":"2024-05-11T01:01:09.655565+0000","last_active":"2024-05-11T01:01:10.639359+0000","last_peered":"2024-05-11T01:01:10.639359+0000","last_clean":"2024-05-11T01:01:10.639359+0000","last_became_active":"2024-05-11T01:01:09.655268+0000","last_became_peered":"2024-05-11T01:01:09.655268+0000","last_unstale":"2024-05-11T01:01:10.639359+0000","last_undegraded":"2024-05-11T01:01:10.639359+0000","last_fullsized":"2024-05-11T01:01:10.639359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846062+0000","last_change":"2024-05-11T01:01:09.654719+0000","last_active":"2024-05-11T01:01:10.846062+0000","last_peered":"2024-05-11T01:01:10.846062+0000","last_clean":"2024-05-11T01:01:10.846062+0000","last_became_active":"2024-05-11T01:01:09.654428+0000","last_became_peered":"2024-05-11T01:01:09.654428+0000","last_unstale":"2024-05-11T01:01:10.846062+0000","last_undegraded":"2024-05-11T01:01:10.846062+0000","last_fullsized":"2024-05-11T01:01:10.846062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778974+0000","last_change":"2024-05-11T01:01:09.658293+0000","last_active":"2024-05-11T01:01:10.778974+0000","last_peered":"2024-05-11T01:01:10.778974+0000","last_clean":"2024-05-11T01:01:10.778974+0000","last_became_active":"2024-05-11T01:01:09.658017+0000","last_became_peered":"2024-05-11T01:01:09.658017+0000","last_unstale":"2024-05-11T01:01:10.778974+0000","last_undegraded":"2024-05-11T01:01:10.778974+0000","last_fullsized":"2024-05-11T01:01:10.778974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846261+0000","last_change":"2024-05-11T01:01:09.658403+0000","last_active":"2024-05-11T01:01:10.846261+0000","last_peered":"2024-05-11T01:01:10.846261+0000","last_clean":"2024-05-11T01:01:10.846261+0000","last_became_active":"2024-05-11T01:01:09.656683+0000","last_became_peered":"2024-05-11T01:01:09.656683+0000","last_unstale":"2024-05-11T01:01:10.846261+0000","last_undegraded":"2024-05-11T01:01:10.846261+0000","last_fullsized":"2024-05-11T01:01:10.846261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845249+0000","last_change":"2024-05-11T01:01:09.655041+0000","last_active":"2024-05-11T01:01:10.845249+0000","last_peered":"2024-05-11T01:01:10.845249+0000","last_clean":"2024-05-11T01:01:10.845249+0000","last_became_active":"2024-05-11T01:01:09.654512+0000","last_became_peered":"2024-05-11T01:01:09.654512+0000","last_unstale":"2024-05-11T01:01:10.845249+0000","last_undegraded":"2024-05-11T01:01:10.845249+0000","last_fullsized":"2024-05-11T01:01:10.845249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:14.595099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845846+0000","last_change":"2024-05-11T01:01:09.665750+0000","last_active":"2024-05-11T01:01:10.845846+0000","last_peered":"2024-05-11T01:01:10.845846+0000","last_clean":"2024-05-11T01:01:10.845846+0000","last_became_active":"2024-05-11T01:01:09.665461+0000","last_became_peered":"2024-05-11T01:01:09.665461+0000","last_unstale":"2024-05-11T01:01:10.845846+0000","last_undegraded":"2024-05-11T01:01:10.845846+0000","last_fullsized":"2024-05-11T01:01:10.845846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640244+0000","last_change":"2024-05-11T01:01:09.656560+0000","last_active":"2024-05-11T01:01:10.640244+0000","last_peered":"2024-05-11T01:01:10.640244+0000","last_clean":"2024-05-11T01:01:10.640244+0000","last_became_active":"2024-05-11T01:01:09.656292+0000","last_became_peered":"2024-05-11T01:01:09.656292+0000","last_unstale":"2024-05-11T01:01:10.640244+0000","last_undegraded":"2024-05-11T01:01:10.640244+0000","last_fullsized":"2024-05-11T01:01:10.640244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:13.731770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845885+0000","last_change":"2024-05-11T01:01:08.656899+0000","last_active":"2024-05-11T01:01:10.845885+0000","last_peered":"2024-05-11T01:01:10.845885+0000","last_clean":"2024-05-11T01:01:10.845885+0000","last_became_active":"2024-05-11T01:01:08.656569+0000","last_became_peered":"2024-05-11T01:01:08.656569+0000","last_unstale":"2024-05-11T01:01:10.845885+0000","last_undegraded":"2024-05-11T01:01:10.845885+0000","last_fullsized":"2024-05-11T01:01:10.845885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779096+0000","last_change":"2024-05-11T01:01:09.643951+0000","last_active":"2024-05-11T01:01:10.779096+0000","last_peered":"2024-05-11T01:01:10.779096+0000","last_clean":"2024-05-11T01:01:10.779096+0000","last_became_active":"2024-05-11T01:01:09.643326+0000","last_became_peered":"2024-05-11T01:01:09.643326+0000","last_unstale":"2024-05-11T01:01:10.779096+0000","last_undegraded":"2024-05-11T01:01:10.779096+0000","last_fullsized":"2024-05-11T01:01:10.779096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845917+0000","last_change":"2024-05-11T01:01:08.651945+0000","last_active":"2024-05-11T01:01:10.845917+0000","last_peered":"2024-05-11T01:01:10.845917+0000","last_clean":"2024-05-11T01:01:10.845917+0000","last_became_active":"2024-05-11T01:01:08.651681+0000","last_became_peered":"2024-05-11T01:01:08.651681+0000","last_unstale":"2024-05-11T01:01:10.845917+0000","last_undegraded":"2024-05-11T01:01:10.845917+0000","last_fullsized":"2024-05-11T01:01:10.845917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845858+0000","last_change":"2024-05-11T01:01:08.658922+0000","last_active":"2024-05-11T01:01:10.845858+0000","last_peered":"2024-05-11T01:01:10.845858+0000","last_clean":"2024-05-11T01:01:10.845858+0000","last_became_active":"2024-05-11T01:01:08.658620+0000","last_became_peered":"2024-05-11T01:01:08.658620+0000","last_unstale":"2024-05-11T01:01:10.845858+0000","last_undegraded":"2024-05-11T01:01:10.845858+0000","last_fullsized":"2024-05-11T01:01:10.845858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:02.931208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845920+0000","last_change":"2024-05-11T01:01:09.666049+0000","last_active":"2024-05-11T01:01:10.845920+0000","last_peered":"2024-05-11T01:01:10.845920+0000","last_clean":"2024-05-11T01:01:10.845920+0000","last_became_active":"2024-05-11T01:01:09.665733+0000","last_became_peered":"2024-05-11T01:01:09.665733+0000","last_unstale":"2024-05-11T01:01:10.845920+0000","last_undegraded":"2024-05-11T01:01:10.845920+0000","last_fullsized":"2024-05-11T01:01:10.845920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:30.522539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845870+0000","last_change":"2024-05-11T01:01:08.647703+0000","last_active":"2024-05-11T01:01:10.845870+0000","last_peered":"2024-05-11T01:01:10.845870+0000","last_clean":"2024-05-11T01:01:10.845870+0000","last_became_active":"2024-05-11T01:01:08.647434+0000","last_became_peered":"2024-05-11T01:01:08.647434+0000","last_unstale":"2024-05-11T01:01:10.845870+0000","last_undegraded":"2024-05-11T01:01:10.845870+0000","last_fullsized":"2024-05-11T01:01:10.845870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639149+0000","last_change":"2024-05-11T01:01:09.656131+0000","last_active":"2024-05-11T01:01:10.639149+0000","last_peered":"2024-05-11T01:01:10.639149+0000","last_clean":"2024-05-11T01:01:10.639149+0000","last_became_active":"2024-05-11T01:01:09.654812+0000","last_became_peered":"2024-05-11T01:01:09.654812+0000","last_unstale":"2024-05-11T01:01:10.639149+0000","last_undegraded":"2024-05-11T01:01:10.639149+0000","last_fullsized":"2024-05-11T01:01:10.639149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846088+0000","last_change":"2024-05-11T01:01:08.655160+0000","last_active":"2024-05-11T01:01:10.846088+0000","last_peered":"2024-05-11T01:01:10.846088+0000","last_clean":"2024-05-11T01:01:10.846088+0000","last_became_active":"2024-05-11T01:01:08.654886+0000","last_became_peered":"2024-05-11T01:01:08.654886+0000","last_unstale":"2024-05-11T01:01:10.846088+0000","last_undegraded":"2024-05-11T01:01:10.846088+0000","last_fullsized":"2024-05-11T01:01:10.846088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846657+0000","last_change":"2024-05-11T01:01:09.662654+0000","last_active":"2024-05-11T01:01:10.846657+0000","last_peered":"2024-05-11T01:01:10.846657+0000","last_clean":"2024-05-11T01:01:10.846657+0000","last_became_active":"2024-05-11T01:01:09.662404+0000","last_became_peered":"2024-05-11T01:01:09.662404+0000","last_unstale":"2024-05-11T01:01:10.846657+0000","last_undegraded":"2024-05-11T01:01:10.846657+0000","last_fullsized":"2024-05-11T01:01:10.846657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:22.764677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846814+0000","last_change":"2024-05-11T01:01:08.655815+0000","last_active":"2024-05-11T01:01:10.846814+0000","last_peered":"2024-05-11T01:01:10.846814+0000","last_clean":"2024-05-11T01:01:10.846814+0000","last_became_active":"2024-05-11T01:01:08.655307+0000","last_became_peered":"2024-05-11T01:01:08.655307+0000","last_unstale":"2024-05-11T01:01:10.846814+0000","last_undegraded":"2024-05-11T01:01:10.846814+0000","last_fullsized":"2024-05-11T01:01:10.846814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779197+0000","last_change":"2024-05-11T01:01:09.653742+0000","last_active":"2024-05-11T01:01:10.779197+0000","last_peered":"2024-05-11T01:01:10.779197+0000","last_clean":"2024-05-11T01:01:10.779197+0000","last_became_active":"2024-05-11T01:01:09.653427+0000","last_became_peered":"2024-05-11T01:01:09.653427+0000","last_unstale":"2024-05-11T01:01:10.779197+0000","last_undegraded":"2024-05-11T01:01:10.779197+0000","last_fullsized":"2024-05-11T01:01:10.779197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:57:44.836320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639415+0000","last_change":"2024-05-11T01:01:08.653490+0000","last_active":"2024-05-11T01:01:10.639415+0000","last_peered":"2024-05-11T01:01:10.639415+0000","last_clean":"2024-05-11T01:01:10.639415+0000","last_became_active":"2024-05-11T01:01:08.653133+0000","last_became_peered":"2024-05-11T01:01:08.653133+0000","last_unstale":"2024-05-11T01:01:10.639415+0000","last_undegraded":"2024-05-11T01:01:10.639415+0000","last_fullsized":"2024-05-11T01:01:10.639415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640807+0000","last_change":"2024-05-11T01:01:09.648279+0000","last_active":"2024-05-11T01:01:10.640807+0000","last_peered":"2024-05-11T01:01:10.640807+0000","last_clean":"2024-05-11T01:01:10.640807+0000","last_became_active":"2024-05-11T01:01:09.647495+0000","last_became_peered":"2024-05-11T01:01:09.647495+0000","last_unstale":"2024-05-11T01:01:10.640807+0000","last_undegraded":"2024-05-11T01:01:10.640807+0000","last_fullsized":"2024-05-11T01:01:10.640807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:14.595099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846299+0000","last_change":"2024-05-11T01:01:08.654417+0000","last_active":"2024-05-11T01:01:10.846299+0000","last_peered":"2024-05-11T01:01:10.846299+0000","last_clean":"2024-05-11T01:01:10.846299+0000","last_became_active":"2024-05-11T01:01:08.654147+0000","last_became_peered":"2024-05-11T01:01:08.654147+0000","last_unstale":"2024-05-11T01:01:10.846299+0000","last_undegraded":"2024-05-11T01:01:10.846299+0000","last_fullsized":"2024-05-11T01:01:10.846299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640575+0000","last_change":"2024-05-11T01:01:09.659281+0000","last_active":"2024-05-11T01:01:10.640575+0000","last_peered":"2024-05-11T01:01:10.640575+0000","last_clean":"2024-05-11T01:01:10.640575+0000","last_became_active":"2024-05-11T01:01:09.659047+0000","last_became_peered":"2024-05-11T01:01:09.659047+0000","last_unstale":"2024-05-11T01:01:10.640575+0000","last_undegraded":"2024-05-11T01:01:10.640575+0000","last_fullsized":"2024-05-11T01:01:10.640575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:44:43.735584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779066+0000","last_change":"2024-05-11T01:01:08.655493+0000","last_active":"2024-05-11T01:01:10.779066+0000","last_peered":"2024-05-11T01:01:10.779066+0000","last_clean":"2024-05-11T01:01:10.779066+0000","last_became_active":"2024-05-11T01:01:08.655147+0000","last_became_peered":"2024-05-11T01:01:08.655147+0000","last_unstale":"2024-05-11T01:01:10.779066+0000","last_undegraded":"2024-05-11T01:01:10.779066+0000","last_fullsized":"2024-05-11T01:01:10.779066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:00:39.735289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779183+0000","last_change":"2024-05-11T01:01:09.646387+0000","last_active":"2024-05-11T01:01:10.779183+0000","last_peered":"2024-05-11T01:01:10.779183+0000","last_clean":"2024-05-11T01:01:10.779183+0000","last_became_active":"2024-05-11T01:01:09.646114+0000","last_became_peered":"2024-05-11T01:01:09.646114+0000","last_unstale":"2024-05-11T01:01:10.779183+0000","last_undegraded":"2024-05-11T01:01:10.779183+0000","last_fullsized":"2024-05-11T01:01:10.779183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846342+0000","last_change":"2024-05-11T01:01:08.648494+0000","last_active":"2024-05-11T01:01:10.846342+0000","last_peered":"2024-05-11T01:01:10.846342+0000","last_clean":"2024-05-11T01:01:10.846342+0000","last_became_active":"2024-05-11T01:01:08.648206+0000","last_became_peered":"2024-05-11T01:01:08.648206+0000","last_unstale":"2024-05-11T01:01:10.846342+0000","last_undegraded":"2024-05-11T01:01:10.846342+0000","last_fullsized":"2024-05-11T01:01:10.846342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641026+0000","last_change":"2024-05-11T01:01:09.659174+0000","last_active":"2024-05-11T01:01:10.641026+0000","last_peered":"2024-05-11T01:01:10.641026+0000","last_clean":"2024-05-11T01:01:10.641026+0000","last_became_active":"2024-05-11T01:01:09.658863+0000","last_became_peered":"2024-05-11T01:01:09.658863+0000","last_unstale":"2024-05-11T01:01:10.641026+0000","last_undegraded":"2024-05-11T01:01:10.641026+0000","last_fullsized":"2024-05-11T01:01:10.641026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:54.872438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845810+0000","last_change":"2024-05-11T01:01:08.655771+0000","last_active":"2024-05-11T01:01:10.845810+0000","last_peered":"2024-05-11T01:01:10.845810+0000","last_clean":"2024-05-11T01:01:10.845810+0000","last_became_active":"2024-05-11T01:01:08.655462+0000","last_became_peered":"2024-05-11T01:01:08.655462+0000","last_unstale":"2024-05-11T01:01:10.845810+0000","last_undegraded":"2024-05-11T01:01:10.845810+0000","last_fullsized":"2024-05-11T01:01:10.845810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845935+0000","last_change":"2024-05-11T01:01:09.665678+0000","last_active":"2024-05-11T01:01:10.845935+0000","last_peered":"2024-05-11T01:01:10.845935+0000","last_clean":"2024-05-11T01:01:10.845935+0000","last_became_active":"2024-05-11T01:01:09.665406+0000","last_became_peered":"2024-05-11T01:01:09.665406+0000","last_unstale":"2024-05-11T01:01:10.845935+0000","last_undegraded":"2024-05-11T01:01:10.845935+0000","last_fullsized":"2024-05-11T01:01:10.845935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845152+0000","last_change":"2024-05-11T01:01:08.649715+0000","last_active":"2024-05-11T01:01:10.845152+0000","last_peered":"2024-05-11T01:01:10.845152+0000","last_clean":"2024-05-11T01:01:10.845152+0000","last_became_active":"2024-05-11T01:01:08.649344+0000","last_became_peered":"2024-05-11T01:01:08.649344+0000","last_unstale":"2024-05-11T01:01:10.845152+0000","last_undegraded":"2024-05-11T01:01:10.845152+0000","last_fullsized":"2024-05-11T01:01:10.845152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641228+0000","last_change":"2024-05-11T01:01:09.657070+0000","last_active":"2024-05-11T01:01:10.641228+0000","last_peered":"2024-05-11T01:01:10.641228+0000","last_clean":"2024-05-11T01:01:10.641228+0000","last_became_active":"2024-05-11T01:01:09.656800+0000","last_became_peered":"2024-05-11T01:01:09.656800+0000","last_unstale":"2024-05-11T01:01:10.641228+0000","last_undegraded":"2024-05-11T01:01:10.641228+0000","last_fullsized":"2024-05-11T01:01:10.641228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:06:53.835577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641100+0000","last_change":"2024-05-11T01:01:08.656669+0000","last_active":"2024-05-11T01:01:10.641100+0000","last_peered":"2024-05-11T01:01:10.641100+0000","last_clean":"2024-05-11T01:01:10.641100+0000","last_became_active":"2024-05-11T01:01:08.656381+0000","last_became_peered":"2024-05-11T01:01:08.656381+0000","last_unstale":"2024-05-11T01:01:10.641100+0000","last_undegraded":"2024-05-11T01:01:10.641100+0000","last_fullsized":"2024-05-11T01:01:10.641100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:44.898974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640537+0000","last_change":"2024-05-11T01:01:09.654699+0000","last_active":"2024-05-11T01:01:10.640537+0000","last_peered":"2024-05-11T01:01:10.640537+0000","last_clean":"2024-05-11T01:01:10.640537+0000","last_became_active":"2024-05-11T01:01:09.654453+0000","last_became_peered":"2024-05-11T01:01:09.654453+0000","last_unstale":"2024-05-11T01:01:10.640537+0000","last_undegraded":"2024-05-11T01:01:10.640537+0000","last_fullsized":"2024-05-11T01:01:10.640537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:30:25.516354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845632+0000","last_change":"2024-05-11T01:01:08.651433+0000","last_active":"2024-05-11T01:01:10.845632+0000","last_peered":"2024-05-11T01:01:10.845632+0000","last_clean":"2024-05-11T01:01:10.845632+0000","last_became_active":"2024-05-11T01:01:08.650413+0000","last_became_peered":"2024-05-11T01:01:08.650413+0000","last_unstale":"2024-05-11T01:01:10.845632+0000","last_undegraded":"2024-05-11T01:01:10.845632+0000","last_fullsized":"2024-05-11T01:01:10.845632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641446+0000","last_change":"2024-05-11T01:01:09.656493+0000","last_active":"2024-05-11T01:01:10.641446+0000","last_peered":"2024-05-11T01:01:10.641446+0000","last_clean":"2024-05-11T01:01:10.641446+0000","last_became_active":"2024-05-11T01:01:09.656244+0000","last_became_peered":"2024-05-11T01:01:09.656244+0000","last_unstale":"2024-05-11T01:01:10.641446+0000","last_undegraded":"2024-05-11T01:01:10.641446+0000","last_fullsized":"2024-05-11T01:01:10.641446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:07:55.577276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639446+0000","last_change":"2024-05-11T01:01:08.648337+0000","last_active":"2024-05-11T01:01:10.639446+0000","last_peered":"2024-05-11T01:01:10.639446+0000","last_clean":"2024-05-11T01:01:10.639446+0000","last_became_active":"2024-05-11T01:01:08.648027+0000","last_became_peered":"2024-05-11T01:01:08.648027+0000","last_unstale":"2024-05-11T01:01:10.639446+0000","last_undegraded":"2024-05-11T01:01:10.639446+0000","last_fullsized":"2024-05-11T01:01:10.639446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846751+0000","last_change":"2024-05-11T01:01:09.657860+0000","last_active":"2024-05-11T01:01:10.846751+0000","last_peered":"2024-05-11T01:01:10.846751+0000","last_clean":"2024-05-11T01:01:10.846751+0000","last_became_active":"2024-05-11T01:01:09.657169+0000","last_became_peered":"2024-05-11T01:01:09.657169+0000","last_unstale":"2024-05-11T01:01:10.846751+0000","last_undegraded":"2024-05-11T01:01:10.846751+0000","last_fullsized":"2024-05-11T01:01:10.846751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:22:02.787759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845376+0000","last_change":"2024-05-11T01:01:08.648806+0000","last_active":"2024-05-11T01:01:10.845376+0000","last_peered":"2024-05-11T01:01:10.845376+0000","last_clean":"2024-05-11T01:01:10.845376+0000","last_became_active":"2024-05-11T01:01:08.648140+0000","last_became_peered":"2024-05-11T01:01:08.648140+0000","last_unstale":"2024-05-11T01:01:10.845376+0000","last_undegraded":"2024-05-11T01:01:10.845376+0000","last_fullsized":"2024-05-11T01:01:10.845376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640743+0000","last_change":"2024-05-11T01:01:09.655326+0000","last_active":"2024-05-11T01:01:10.640743+0000","last_peered":"2024-05-11T01:01:10.640743+0000","last_clean":"2024-05-11T01:01:10.640743+0000","last_became_active":"2024-05-11T01:01:09.655056+0000","last_became_peered":"2024-05-11T01:01:09.655056+0000","last_unstale":"2024-05-11T01:01:10.640743+0000","last_undegraded":"2024-05-11T01:01:10.640743+0000","last_fullsized":"2024-05-11T01:01:10.640743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:48:22.764677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641362+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:10.641362+0000","last_peered":"2024-05-11T01:01:10.641362+0000","last_clean":"2024-05-11T01:01:10.641362+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:10.641362+0000","last_undegraded":"2024-05-11T01:01:10.641362+0000","last_fullsized":"2024-05-11T01:01:10.641362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846455+0000","last_change":"2024-05-11T01:01:08.649868+0000","last_active":"2024-05-11T01:01:10.846455+0000","last_peered":"2024-05-11T01:01:10.846455+0000","last_clean":"2024-05-11T01:01:10.846455+0000","last_became_active":"2024-05-11T01:01:08.649580+0000","last_became_peered":"2024-05-11T01:01:08.649580+0000","last_unstale":"2024-05-11T01:01:10.846455+0000","last_undegraded":"2024-05-11T01:01:10.846455+0000","last_fullsized":"2024-05-11T01:01:10.846455+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845507+0000","last_change":"2024-05-11T01:01:09.653271+0000","last_active":"2024-05-11T01:01:10.845507+0000","last_peered":"2024-05-11T01:01:10.845507+0000","last_clean":"2024-05-11T01:01:10.845507+0000","last_became_active":"2024-05-11T01:01:09.652956+0000","last_became_peered":"2024-05-11T01:01:09.652956+0000","last_unstale":"2024-05-11T01:01:10.845507+0000","last_undegraded":"2024-05-11T01:01:10.845507+0000","last_fullsized":"2024-05-11T01:01:10.845507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640973+0000","last_change":"2024-05-11T01:01:08.659302+0000","last_active":"2024-05-11T01:01:10.640973+0000","last_peered":"2024-05-11T01:01:10.640973+0000","last_clean":"2024-05-11T01:01:10.640973+0000","last_became_active":"2024-05-11T01:01:08.658788+0000","last_became_peered":"2024-05-11T01:01:08.658788+0000","last_unstale":"2024-05-11T01:01:10.640973+0000","last_undegraded":"2024-05-11T01:01:10.640973+0000","last_fullsized":"2024-05-11T01:01:10.640973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.778819+0000","last_change":"2024-05-11T01:01:09.645180+0000","last_active":"2024-05-11T01:01:10.778819+0000","last_peered":"2024-05-11T01:01:10.778819+0000","last_clean":"2024-05-11T01:01:10.778819+0000","last_became_active":"2024-05-11T01:01:09.644738+0000","last_became_peered":"2024-05-11T01:01:09.644738+0000","last_unstale":"2024-05-11T01:01:10.778819+0000","last_undegraded":"2024-05-11T01:01:10.778819+0000","last_fullsized":"2024-05-11T01:01:10.778819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:29:27.395704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845237+0000","last_change":"2024-05-11T01:01:08.648835+0000","last_active":"2024-05-11T01:01:10.845237+0000","last_peered":"2024-05-11T01:01:10.845237+0000","last_clean":"2024-05-11T01:01:10.845237+0000","last_became_active":"2024-05-11T01:01:08.648420+0000","last_became_peered":"2024-05-11T01:01:08.648420+0000","last_unstale":"2024-05-11T01:01:10.845237+0000","last_undegraded":"2024-05-11T01:01:10.845237+0000","last_fullsized":"2024-05-11T01:01:10.845237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639280+0000","last_change":"2024-05-11T01:01:09.653951+0000","last_active":"2024-05-11T01:01:10.639280+0000","last_peered":"2024-05-11T01:01:10.639280+0000","last_clean":"2024-05-11T01:01:10.639280+0000","last_became_active":"2024-05-11T01:01:09.653685+0000","last_became_peered":"2024-05-11T01:01:09.653685+0000","last_unstale":"2024-05-11T01:01:10.639280+0000","last_undegraded":"2024-05-11T01:01:10.639280+0000","last_fullsized":"2024-05-11T01:01:10.639280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846373+0000","last_change":"2024-05-11T01:01:08.655055+0000","last_active":"2024-05-11T01:01:10.846373+0000","last_peered":"2024-05-11T01:01:10.846373+0000","last_clean":"2024-05-11T01:01:10.846373+0000","last_became_active":"2024-05-11T01:01:08.654780+0000","last_became_peered":"2024-05-11T01:01:08.654780+0000","last_unstale":"2024-05-11T01:01:10.846373+0000","last_undegraded":"2024-05-11T01:01:10.846373+0000","last_fullsized":"2024-05-11T01:01:10.846373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641446+0000","last_change":"2024-05-11T01:01:09.648560+0000","last_active":"2024-05-11T01:01:10.641446+0000","last_peered":"2024-05-11T01:01:10.641446+0000","last_clean":"2024-05-11T01:01:10.641446+0000","last_became_active":"2024-05-11T01:01:09.647285+0000","last_became_peered":"2024-05-11T01:01:09.647285+0000","last_unstale":"2024-05-11T01:01:10.641446+0000","last_undegraded":"2024-05-11T01:01:10.641446+0000","last_fullsized":"2024-05-11T01:01:10.641446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:54.570608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639066+0000","last_change":"2024-05-11T01:01:08.656434+0000","last_active":"2024-05-11T01:01:10.639066+0000","last_peered":"2024-05-11T01:01:10.639066+0000","last_clean":"2024-05-11T01:01:10.639066+0000","last_became_active":"2024-05-11T01:01:08.656111+0000","last_became_peered":"2024-05-11T01:01:08.656111+0000","last_unstale":"2024-05-11T01:01:10.639066+0000","last_undegraded":"2024-05-11T01:01:10.639066+0000","last_fullsized":"2024-05-11T01:01:10.639066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:52:22.036820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846789+0000","last_change":"2024-05-11T01:01:09.658868+0000","last_active":"2024-05-11T01:01:10.846789+0000","last_peered":"2024-05-11T01:01:10.846789+0000","last_clean":"2024-05-11T01:01:10.846789+0000","last_became_active":"2024-05-11T01:01:09.658511+0000","last_became_peered":"2024-05-11T01:01:09.658511+0000","last_unstale":"2024-05-11T01:01:10.846789+0000","last_undegraded":"2024-05-11T01:01:10.846789+0000","last_fullsized":"2024-05-11T01:01:10.846789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:47:54.872438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641036+0000","last_change":"2024-05-11T01:01:08.656666+0000","last_active":"2024-05-11T01:01:10.641036+0000","last_peered":"2024-05-11T01:01:10.641036+0000","last_clean":"2024-05-11T01:01:10.641036+0000","last_became_active":"2024-05-11T01:01:08.656387+0000","last_became_peered":"2024-05-11T01:01:08.656387+0000","last_unstale":"2024-05-11T01:01:10.641036+0000","last_undegraded":"2024-05-11T01:01:10.641036+0000","last_fullsized":"2024-05-11T01:01:10.641036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:23:24.406370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639094+0000","last_change":"2024-05-11T01:01:09.652521+0000","last_active":"2024-05-11T01:01:10.639094+0000","last_peered":"2024-05-11T01:01:10.639094+0000","last_clean":"2024-05-11T01:01:10.639094+0000","last_became_active":"2024-05-11T01:01:09.652239+0000","last_became_peered":"2024-05-11T01:01:09.652239+0000","last_unstale":"2024-05-11T01:01:10.639094+0000","last_undegraded":"2024-05-11T01:01:10.639094+0000","last_fullsized":"2024-05-11T01:01:10.639094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:58:24.306816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639337+0000","last_change":"2024-05-11T01:01:08.658432+0000","last_active":"2024-05-11T01:01:10.639337+0000","last_peered":"2024-05-11T01:01:10.639337+0000","last_clean":"2024-05-11T01:01:10.639337+0000","last_became_active":"2024-05-11T01:01:08.658089+0000","last_became_peered":"2024-05-11T01:01:08.658089+0000","last_unstale":"2024-05-11T01:01:10.639337+0000","last_undegraded":"2024-05-11T01:01:10.639337+0000","last_fullsized":"2024-05-11T01:01:10.639337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:16:12.729602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845574+0000","last_change":"2024-05-11T01:01:09.661121+0000","last_active":"2024-05-11T01:01:10.845574+0000","last_peered":"2024-05-11T01:01:10.845574+0000","last_clean":"2024-05-11T01:01:10.845574+0000","last_became_active":"2024-05-11T01:01:09.660835+0000","last_became_peered":"2024-05-11T01:01:09.660835+0000","last_unstale":"2024-05-11T01:01:10.845574+0000","last_undegraded":"2024-05-11T01:01:10.845574+0000","last_fullsized":"2024-05-11T01:01:10.845574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:24:41.934800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846134+0000","last_change":"2024-05-11T01:01:08.658073+0000","last_active":"2024-05-11T01:01:10.846134+0000","last_peered":"2024-05-11T01:01:10.846134+0000","last_clean":"2024-05-11T01:01:10.846134+0000","last_became_active":"2024-05-11T01:01:08.657786+0000","last_became_peered":"2024-05-11T01:01:08.657786+0000","last_unstale":"2024-05-11T01:01:10.846134+0000","last_undegraded":"2024-05-11T01:01:10.846134+0000","last_fullsized":"2024-05-11T01:01:10.846134+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:57:48.873698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779153+0000","last_change":"2024-05-11T01:01:09.658616+0000","last_active":"2024-05-11T01:01:10.779153+0000","last_peered":"2024-05-11T01:01:10.779153+0000","last_clean":"2024-05-11T01:01:10.779153+0000","last_became_active":"2024-05-11T01:01:09.657620+0000","last_became_peered":"2024-05-11T01:01:09.657620+0000","last_unstale":"2024-05-11T01:01:10.779153+0000","last_undegraded":"2024-05-11T01:01:10.779153+0000","last_fullsized":"2024-05-11T01:01:10.779153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640026+0000","last_change":"2024-05-11T01:01:08.658520+0000","last_active":"2024-05-11T01:01:10.640026+0000","last_peered":"2024-05-11T01:01:10.640026+0000","last_clean":"2024-05-11T01:01:10.640026+0000","last_became_active":"2024-05-11T01:01:08.657670+0000","last_became_peered":"2024-05-11T01:01:08.657670+0000","last_unstale":"2024-05-11T01:01:10.640026+0000","last_undegraded":"2024-05-11T01:01:10.640026+0000","last_fullsized":"2024-05-11T01:01:10.640026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:56.608704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640373+0000","last_change":"2024-05-11T01:01:09.653422+0000","last_active":"2024-05-11T01:01:10.640373+0000","last_peered":"2024-05-11T01:01:10.640373+0000","last_clean":"2024-05-11T01:01:10.640373+0000","last_became_active":"2024-05-11T01:01:09.652720+0000","last_became_peered":"2024-05-11T01:01:09.652720+0000","last_unstale":"2024-05-11T01:01:10.640373+0000","last_undegraded":"2024-05-11T01:01:10.640373+0000","last_fullsized":"2024-05-11T01:01:10.640373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:57.610871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639184+0000","last_change":"2024-05-11T01:01:08.653589+0000","last_active":"2024-05-11T01:01:10.639184+0000","last_peered":"2024-05-11T01:01:10.639184+0000","last_clean":"2024-05-11T01:01:10.639184+0000","last_became_active":"2024-05-11T01:01:08.653254+0000","last_became_peered":"2024-05-11T01:01:08.653254+0000","last_unstale":"2024-05-11T01:01:10.639184+0000","last_undegraded":"2024-05-11T01:01:10.639184+0000","last_fullsized":"2024-05-11T01:01:10.639184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:13.592931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845596+0000","last_change":"2024-05-11T01:01:09.659317+0000","last_active":"2024-05-11T01:01:10.845596+0000","last_peered":"2024-05-11T01:01:10.845596+0000","last_clean":"2024-05-11T01:01:10.845596+0000","last_became_active":"2024-05-11T01:01:09.658793+0000","last_became_peered":"2024-05-11T01:01:09.658793+0000","last_unstale":"2024-05-11T01:01:10.845596+0000","last_undegraded":"2024-05-11T01:01:10.845596+0000","last_fullsized":"2024-05-11T01:01:10.845596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:11:08.336604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.639298+0000","last_change":"2024-05-11T01:01:08.653913+0000","last_active":"2024-05-11T01:01:10.639298+0000","last_peered":"2024-05-11T01:01:10.639298+0000","last_clean":"2024-05-11T01:01:10.639298+0000","last_became_active":"2024-05-11T01:01:08.653485+0000","last_became_peered":"2024-05-11T01:01:08.653485+0000","last_unstale":"2024-05-11T01:01:10.639298+0000","last_undegraded":"2024-05-11T01:01:10.639298+0000","last_fullsized":"2024-05-11T01:01:10.639298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:55:37.088661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845721+0000","last_change":"2024-05-11T01:01:09.663043+0000","last_active":"2024-05-11T01:01:10.845721+0000","last_peered":"2024-05-11T01:01:10.845721+0000","last_clean":"2024-05-11T01:01:10.845721+0000","last_became_active":"2024-05-11T01:01:09.662331+0000","last_became_peered":"2024-05-11T01:01:09.662331+0000","last_unstale":"2024-05-11T01:01:10.845721+0000","last_undegraded":"2024-05-11T01:01:10.845721+0000","last_fullsized":"2024-05-11T01:01:10.845721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:59:36.243352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.641204+0000","last_change":"2024-05-11T01:01:08.658594+0000","last_active":"2024-05-11T01:01:10.641204+0000","last_peered":"2024-05-11T01:01:10.641204+0000","last_clean":"2024-05-11T01:01:10.641204+0000","last_became_active":"2024-05-11T01:01:08.658310+0000","last_became_peered":"2024-05-11T01:01:08.658310+0000","last_unstale":"2024-05-11T01:01:10.641204+0000","last_undegraded":"2024-05-11T01:01:10.641204+0000","last_fullsized":"2024-05-11T01:01:10.641204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:44:19.535130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845797+0000","last_change":"2024-05-11T01:01:09.653439+0000","last_active":"2024-05-11T01:01:10.845797+0000","last_peered":"2024-05-11T01:01:10.845797+0000","last_clean":"2024-05-11T01:01:10.845797+0000","last_became_active":"2024-05-11T01:01:09.653150+0000","last_became_peered":"2024-05-11T01:01:09.653150+0000","last_unstale":"2024-05-11T01:01:10.845797+0000","last_undegraded":"2024-05-11T01:01:10.845797+0000","last_fullsized":"2024-05-11T01:01:10.845797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:10:46.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846741+0000","last_change":"2024-05-11T01:01:09.652866+0000","last_active":"2024-05-11T01:01:10.846741+0000","last_peered":"2024-05-11T01:01:10.846741+0000","last_clean":"2024-05-11T01:01:10.846741+0000","last_became_active":"2024-05-11T01:01:09.652016+0000","last_became_peered":"2024-05-11T01:01:09.652016+0000","last_unstale":"2024-05-11T01:01:10.846741+0000","last_undegraded":"2024-05-11T01:01:10.846741+0000","last_fullsized":"2024-05-11T01:01:10.846741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:17.765368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640394+0000","last_change":"2024-05-11T01:01:08.656072+0000","last_active":"2024-05-11T01:01:10.640394+0000","last_peered":"2024-05-11T01:01:10.640394+0000","last_clean":"2024-05-11T01:01:10.640394+0000","last_became_active":"2024-05-11T01:01:08.655793+0000","last_became_peered":"2024-05-11T01:01:08.655793+0000","last_unstale":"2024-05-11T01:01:10.640394+0000","last_undegraded":"2024-05-11T01:01:10.640394+0000","last_fullsized":"2024-05-11T01:01:10.640394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:42:13.592931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.846596+0000","last_change":"2024-05-11T01:01:09.655397+0000","last_active":"2024-05-11T01:01:10.846596+0000","last_peered":"2024-05-11T01:01:10.846596+0000","last_clean":"2024-05-11T01:01:10.846596+0000","last_became_active":"2024-05-11T01:01:09.654703+0000","last_became_peered":"2024-05-11T01:01:09.654703+0000","last_unstale":"2024-05-11T01:01:10.846596+0000","last_undegraded":"2024-05-11T01:01:10.846596+0000","last_fullsized":"2024-05-11T01:01:10.846596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:30:25.516354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.640775+0000","last_change":"2024-05-11T01:01:08.659252+0000","last_active":"2024-05-11T01:01:10.640775+0000","last_peered":"2024-05-11T01:01:10.640775+0000","last_clean":"2024-05-11T01:01:10.640775+0000","last_became_active":"2024-05-11T01:01:08.658942+0000","last_became_peered":"2024-05-11T01:01:08.658942+0000","last_unstale":"2024-05-11T01:01:10.640775+0000","last_undegraded":"2024-05-11T01:01:10.640775+0000","last_fullsized":"2024-05-11T01:01:10.640775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:25:53.568441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779182+0000","last_change":"2024-05-11T01:01:09.653451+0000","last_active":"2024-05-11T01:01:10.779182+0000","last_peered":"2024-05-11T01:01:10.779182+0000","last_clean":"2024-05-11T01:01:10.779182+0000","last_became_active":"2024-05-11T01:01:09.653028+0000","last_became_peered":"2024-05-11T01:01:09.653028+0000","last_unstale":"2024-05-11T01:01:10.779182+0000","last_undegraded":"2024-05-11T01:01:10.779182+0000","last_fullsized":"2024-05-11T01:01:10.779182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845867+0000","last_change":"2024-05-11T01:01:08.655897+0000","last_active":"2024-05-11T01:01:10.845867+0000","last_peered":"2024-05-11T01:01:10.845867+0000","last_clean":"2024-05-11T01:01:10.845867+0000","last_became_active":"2024-05-11T01:01:08.655602+0000","last_became_peered":"2024-05-11T01:01:08.655602+0000","last_unstale":"2024-05-11T01:01:10.845867+0000","last_undegraded":"2024-05-11T01:01:10.845867+0000","last_fullsized":"2024-05-11T01:01:10.845867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:08.332388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.845779+0000","last_change":"2024-05-11T01:01:09.663811+0000","last_active":"2024-05-11T01:01:10.845779+0000","last_peered":"2024-05-11T01:01:10.845779+0000","last_clean":"2024-05-11T01:01:10.845779+0000","last_became_active":"2024-05-11T01:01:09.663489+0000","last_became_peered":"2024-05-11T01:01:09.663489+0000","last_unstale":"2024-05-11T01:01:10.845779+0000","last_undegraded":"2024-05-11T01:01:10.845779+0000","last_fullsized":"2024-05-11T01:01:10.845779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:08.629716+0000","last_clean_scrub_stamp":"2024-05-11T01:01:08.629716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:34:03.741044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-11T01:01:10.779259+0000","last_change":"2024-05-11T01:01:08.657362+0000","last_active":"2024-05-11T01:01:10.779259+0000","last_peered":"2024-05-11T01:01:10.779259+0000","last_clean":"2024-05-11T01:01:10.779259+0000","last_became_active":"2024-05-11T01:01:08.657072+0000","last_became_peered":"2024-05-11T01:01:08.657072+0000","last_unstale":"2024-05-11T01:01:10.779259+0000","last_undegraded":"2024-05-11T01:01:10.779259+0000","last_fullsized":"2024-05-11T01:01:10.779259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:07.627549+0000","last_clean_scrub_stamp":"2024-05-11T01:01:07.627549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:46:43.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:23.186 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-11T01:01:23.187 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-11T01:01:23.187 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-11T01:01:23.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-11T01:01:23.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.325+0000 7fc0e0e83640 1 Processor -- start 2024-05-11T01:01:23.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.325+0000 7fc0e0e83640 1 -- start start 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0e0e83640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc0dc0d37a0 0x7fc0dc0d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0e0e83640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0dc162fb0 con 0x7fc0dc15f530 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0e0e83640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0dc163290 con 0x7fc0dc06f140 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0e0e83640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc0dc163ea0 con 0x7fc0dc0d37a0 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0da59c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc0dc15f530 0x7fc0dc0cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42894/0 (socket says 172.21.15.16:42894) 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0da59c640 1 -- 172.21.15.16:0/3449317296 learned_addr learned my addr 172.21.15.16:0/3449317296 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183067632 0 0) 0x7fc0dc162fb0 con 0x7fc0dc15f530 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0c4003520 con 0x7fc0dc15f530 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.326+0000 7fc0dad9d640 1 --2- 172.21.15.16:0/3449317296 >> v2:172.21.15.174:3300/0 conn(0x7fc0dc0d37a0 0x7fc0dc0d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 222418775 0 0) 0x7fc0c4003520 con 0x7fc0dc15f530 2024-05-11T01:01:23.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 >> v2:172.21.15.174:3300/0 conn(0x7fc0dc0d37a0 msgr2=0x7fc0dc0d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 --2- 172.21.15.16:0/3449317296 >> v2:172.21.15.174:3300/0 conn(0x7fc0dc0d37a0 0x7fc0dc0d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 >> v1:172.21.15.174:6789/0 conn(0x7fc0dc06f140 legacy=0x7fc0dc0d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc163570 con 0x7fc0dc15f530 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fc0cc0016f0 con 0x7fc0dc15f530 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 >> v1:172.21.15.16:6789/0 conn(0x7fc0dc15f530 legacy=0x7fc0dc0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4003a50 0x7fc0c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0c40051c0 0x7fc0c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc163ea0 con 0x7fc0c4004800 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c400c160 con 0x7fc0c4003a50 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c400c360 con 0x7fc0c40051c0 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d9d9b640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0da59c640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4003a50 0x7fc0c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0dad9d640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0c40051c0 0x7fc0c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d9d9b640 1 -- 172.21.15.16:0/3449317296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0c40051c0 msgr2=0x7fc0c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d9d9b640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0c40051c0 0x7fc0c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d9d9b640 1 -- 172.21.15.16:0/3449317296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4003a50 msgr2=0x7fc0c4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d9d9b640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4003a50 0x7fc0c4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0d9d9b640 1 -- 172.21.15.16:0/3449317296 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c4003520 con 0x7fc0c4004800 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.327+0000 7fc0dad9d640 1 -- 172.21.15.16:0/3449317296 reap_dead start 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.328+0000 7fc0d9d9b640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0001790 tx=0x7fc0c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d16d342f6ccc47 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.328+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00013b0 con 0x7fc0c4004800 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.328+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d00052d0 con 0x7fc0c4004800 2024-05-11T01:01:23.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.328+0000 7fc0d959a640 1 -- 172.21.15.16:0/3449317296 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d002aa90 con 0x7fc0c4004800 2024-05-11T01:01:23.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.328+0000 7fc0e0e83640 1 -- 172.21.15.16:0/3449317296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c4004800 msgr2=0x7fc0c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.328+0000 7fc0e0e83640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0001790 tx=0x7fc0c4005830 comp rx=0 tx=0).stop 2024-05-11T01:01:23.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.329+0000 7fc0e0e83640 1 -- 172.21.15.16:0/3449317296 shutdown_connections 2024-05-11T01:01:23.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.329+0000 7fc0e0e83640 1 --2- 172.21.15.16:0/3449317296 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c4004800 0x7fc0c4004c80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.329+0000 7fc0e0e83640 1 -- 172.21.15.16:0/3449317296 >> 172.21.15.16:0/3449317296 conn(0x7fc0dc0681c0 msgr2=0x7fc0dc0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:23.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.329+0000 7fc0e0e83640 1 -- 172.21.15.16:0/3449317296 shutdown_connections 2024-05-11T01:01:23.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.329+0000 7fc0e0e83640 1 -- 172.21.15.16:0/3449317296 wait complete. 2024-05-11T01:01:23.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.330+0000 7fc0e0e83640 1 Processor -- start 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.330+0000 7fc0e0e83640 1 -- start start 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0e0e83640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4004800 0x7fc0dc0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0e0e83640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0dc15acc0 0x7fc0dc15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0e0e83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0c8d70 0x7fc0dc0c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0e0e83640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0d2a20 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0e0e83640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc163b30 con 0x7fc0c4004800 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0e0e83640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc0dc0d2ba0 con 0x7fc0dc15acc0 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0c8d70 0x7fc0dc0c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0c8d70 0x7fc0dc0c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46652/0 (socket says 172.21.15.16:46652) 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 -- 172.21.15.16:0/565537387 learned_addr learned my addr 172.21.15.16:0/565537387 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0da59c640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4004800 0x7fc0dc0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0d9d9b640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0dc15acc0 0x7fc0dc15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 -- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0dc15acc0 msgr2=0x7fc0dc15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0dc15acc0 0x7fc0dc15a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 -- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4004800 msgr2=0x7fc0dc0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4004800 0x7fc0dc0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 -- 172.21.15.16:0/565537387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc0b5e60 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0d9d9b640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0dc15acc0 0x7fc0dc15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0da59c640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4004800 0x7fc0dc0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.331+0000 7fc0dad9d640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0c8d70 0x7fc0dc0c9200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0cd6e0 tx=0x7fc0d40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.332+0000 7fc0caffd640 1 -- 172.21.15.16:0/565537387 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4011db0 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.332+0000 7fc0caffd640 1 -- 172.21.15.16:0/565537387 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d401b070 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.332+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc0b6140 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.332+0000 7fc0caffd640 1 -- 172.21.15.16:0/565537387 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4003990 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.332+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc0b6700 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.333+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0dc15e950 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.333+0000 7fc0caffd640 1 -- 172.21.15.16:0/565537387 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0d4003b30 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.334+0000 7fc0caffd640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc0bc0762d0 0x7fc0bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.334+0000 7fc0caffd640 1 -- 172.21.15.16:0/565537387 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc0d4097e80 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.334+0000 7fc0da59c640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc0bc0762d0 0x7fc0bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.335+0000 7fc0da59c640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc0bc0762d0 0x7fc0bc078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc000fb0 tx=0x7fc0cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:23.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.339+0000 7fc0caffd640 1 -- 172.21.15.16:0/565537387 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc0dc15e950 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.575+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc0dc06a5b0 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.575+0000 7fc0caffd640 1 -- 172.21.15.16:0/565537387 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc0d4003e20 con 0x7fc0dc0c8d70 2024-05-11T01:01:23.575 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:23.575 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-11T01:01:23.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc0bc0762d0 msgr2=0x7fc0bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc0bc0762d0 0x7fc0bc078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc000fb0 tx=0x7fc0cc009040 comp rx=0 tx=0).stop 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0c8d70 msgr2=0x7fc0dc0c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0c8d70 0x7fc0dc0c9200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc0cd6e0 tx=0x7fc0d40115a0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 shutdown_connections 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc0bc0762d0 0x7fc0bc078790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0dc0c8d70 0x7fc0dc0c9200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0dc15acc0 0x7fc0dc15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 --2- 172.21.15.16:0/565537387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0c4004800 0x7fc0dc0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 >> 172.21.15.16:0/565537387 conn(0x7fc0dc0681c0 msgr2=0x7fc0dc0d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 shutdown_connections 2024-05-11T01:01:23.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.577+0000 7fc0e0e83640 1 -- 172.21.15.16:0/565537387 wait complete. 2024-05-11T01:01:23.588 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-11T01:01:23.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:23.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.692+0000 7f365b008640 1 Processor -- start 2024-05-11T01:01:23.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.692+0000 7f365b008640 1 -- start start 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.693+0000 7f365b008640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3654162d30 0x7f36540baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.693+0000 7f365b008640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 0x7f36540b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.693+0000 7f365b008640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36541639f0 con 0x7f36540b7360 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.693+0000 7f365b008640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f36540d3700 con 0x7f3654162d30 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.693+0000 7f365b008640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3654163cd0 con 0x7f3654163210 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.693+0000 7f36595a5640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f36540b7360 0x7f365406d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42896/0 (socket says 172.21.15.16:42896) 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.693+0000 7f36595a5640 1 -- 172.21.15.16:0/3055824972 learned_addr learned my addr 172.21.15.16:0/3055824972 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3658da4640 1 --2- 172.21.15.16:0/3055824972 >> v2:172.21.15.174:3300/0 conn(0x7f3654162d30 0x7f36540baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3653fff640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 0x7f36540b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777076415 0 0) 0x7f36541639f0 con 0x7f36540b7360 2024-05-11T01:01:23.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f363c003520 con 0x7f36540b7360 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3092849832 0 0) 0x7f363c003520 con 0x7f36540b7360 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 msgr2=0x7f36540b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 0x7f36540b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 >> v2:172.21.15.174:3300/0 conn(0x7f3654162d30 msgr2=0x7f36540baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 --2- 172.21.15.16:0/3055824972 >> v2:172.21.15.174:3300/0 conn(0x7f3654162d30 0x7f36540baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3654163fb0 con 0x7f36540b7360 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f36440016f0 con 0x7f36540b7360 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 >> v1:172.21.15.16:6789/0 conn(0x7f36540b7360 legacy=0x7f365406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f363c003a00 0x7f363c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c004800 0x7f363c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 0x7f363c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f36540d3700 con 0x7f363c003a00 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3654163cd0 con 0x7f363c004800 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f363c00baf0 con 0x7f3654163210 2024-05-11T01:01:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3658da4640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f363c003a00 0x7f363c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3653fff640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c004800 0x7f363c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36595a5640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 0x7f363c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3658da4640 1 -- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 msgr2=0x7f363c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3658da4640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 0x7f363c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3658da4640 1 -- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c004800 msgr2=0x7f363c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3658da4640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c004800 0x7f363c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f3658da4640 1 -- 172.21.15.16:0/3055824972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c003520 con 0x7f363c003a00 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.694+0000 7f36595a5640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3654163210 0x7f363c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.695+0000 7f3658da4640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f363c003a00 0x7f363c003e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f364c009f90 tx=0x7f363c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982d39b9a19f4568 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.695+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c009c10 con 0x7f363c003a00 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.695+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c036070 con 0x7f363c003a00 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.695+0000 7f36537fe640 1 -- 172.21.15.16:0/3055824972 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c031850 con 0x7f363c003a00 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.696+0000 7f365b008640 1 -- 172.21.15.16:0/3055824972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f363c003a00 msgr2=0x7f363c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.696+0000 7f365b008640 1 --2- 172.21.15.16:0/3055824972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f363c003a00 0x7f363c003e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f364c009f90 tx=0x7f363c005830 comp rx=0 tx=0).stop 2024-05-11T01:01:23.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.696+0000 7f36595a5640 1 -- 172.21.15.16:0/3055824972 reap_dead start 2024-05-11T01:01:23.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.696+0000 7f365b008640 1 -- 172.21.15.16:0/3055824972 shutdown_connections 2024-05-11T01:01:23.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.696+0000 7f365b008640 1 -- 172.21.15.16:0/3055824972 >> 172.21.15.16:0/3055824972 conn(0x7f36540d1e20 msgr2=0x7f36540d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:23.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.696+0000 7f365b008640 1 -- 172.21.15.16:0/3055824972 shutdown_connections 2024-05-11T01:01:23.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.696+0000 7f365b008640 1 -- 172.21.15.16:0/3055824972 wait complete. 2024-05-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.697+0000 7f365b008640 1 Processor -- start 2024-05-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.697+0000 7f365b008640 1 -- start start 2024-05-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f365b008640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c003a00 0x7f36540cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f365b008640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36541589f0 0x7f36540ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f365b008640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36540ce6c0 0x7f36540b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f365b008640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f36540d4e80 con 0x7f36540ce6c0 2024-05-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f365b008640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3654163670 con 0x7f363c003a00 2024-05-11T01:01:23.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f365b008640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f36540d5000 con 0x7f36541589f0 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f36595a5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36540ce6c0 0x7f36540b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f36595a5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36540ce6c0 0x7f36540b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46672/0 (socket says 172.21.15.16:46672) 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f36595a5640 1 -- 172.21.15.16:0/489690366 learned_addr learned my addr 172.21.15.16:0/489690366 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f3653fff640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36541589f0 0x7f36540ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f3658da4640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c003a00 0x7f36540cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f36595a5640 1 -- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36541589f0 msgr2=0x7f36540ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f36595a5640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36541589f0 0x7f36540ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f36595a5640 1 -- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c003a00 msgr2=0x7f36540cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f36595a5640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c003a00 0x7f36540cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.698+0000 7f36595a5640 1 -- 172.21.15.16:0/489690366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36540cec00 con 0x7f36540ce6c0 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.699+0000 7f36595a5640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36540ce6c0 0x7f36540b5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36540b4dd0 tx=0x7f364400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.699+0000 7f36517fa640 1 -- 172.21.15.16:0/489690366 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644010510 con 0x7f36540ce6c0 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.699+0000 7f36517fa640 1 -- 172.21.15.16:0/489690366 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36440106b0 con 0x7f36540ce6c0 2024-05-11T01:01:23.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.699+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36540ceee0 con 0x7f36540ce6c0 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.699+0000 7f36517fa640 1 -- 172.21.15.16:0/489690366 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644010aa0 con 0x7f36540ce6c0 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.699+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36540cc610 con 0x7f36540ce6c0 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.700+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36540cf400 con 0x7f36540ce6c0 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.701+0000 7f36517fa640 1 -- 172.21.15.16:0/489690366 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3644010c40 con 0x7f36540ce6c0 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.701+0000 7f36517fa640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3640076300 0x7f36400787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.701+0000 7f36517fa640 1 -- 172.21.15.16:0/489690366 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3644096ba0 con 0x7f36540ce6c0 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.701+0000 7f3658da4640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3640076300 0x7f36400787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.702+0000 7f3658da4640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3640076300 0x7f36400787c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f364c035000 tx=0x7f364c02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:23.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.705+0000 7f36517fa640 1 -- 172.21.15.16:0/489690366 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f36540cf400 con 0x7f36540ce6c0 2024-05-11T01:01:23.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.936+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3654069e30 con 0x7f36540ce6c0 2024-05-11T01:01:23.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.936+0000 7f36517fa640 1 -- 172.21.15.16:0/489690366 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5178 (secure 0 0 0) 0x7f3654069e30 con 0x7f36540ce6c0 2024-05-11T01:01:23.937 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:23.937 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:09.046368+0000","modified":"2024-05-11T01:01:12.033345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-11T01:01:23.937 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-05-11T01:01:23.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3640076300 msgr2=0x7f36400787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3640076300 0x7f36400787c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f364c035000 tx=0x7f364c02f000 comp rx=0 tx=0).stop 2024-05-11T01:01:23.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36540ce6c0 msgr2=0x7f36540b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:23.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36540ce6c0 0x7f36540b5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f36540b4dd0 tx=0x7f364400ead0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 shutdown_connections 2024-05-11T01:01:23.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3640076300 0x7f36400787c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36540ce6c0 0x7f36540b5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f36541589f0 0x7f36540ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 --2- 172.21.15.16:0/489690366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c003a00 0x7f36540cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:23.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 >> 172.21.15.16:0/489690366 conn(0x7f36540d1e20 msgr2=0x7f36540d5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:23.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 shutdown_connections 2024-05-11T01:01:23.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:23.938+0000 7f365b008640 1 -- 172.21.15.16:0/489690366 wait complete. 2024-05-11T01:01:23.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:24.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.054+0000 7f7e6a245640 1 Processor -- start 2024-05-11T01:01:24.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.054+0000 7f7e6a245640 1 -- start start 2024-05-11T01:01:24.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.054+0000 7f7e6a245640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e640bac10 0x7f7e640d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.054+0000 7f7e6a245640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e64163e90 con 0x7f7e640d3ec0 2024-05-11T01:01:24.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.054+0000 7f7e6a245640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e64163310 con 0x7f7e640b6d70 2024-05-11T01:01:24.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.054+0000 7f7e6a245640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7e640cfad0 con 0x7f7e640bac10 2024-05-11T01:01:24.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.055+0000 7f7e62ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e640bac10 0x7f7e640d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.055+0000 7f7e63fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7e640d3ec0 0x7f7e640d4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42910/0 (socket says 172.21.15.16:42910) 2024-05-11T01:01:24.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.055+0000 7f7e63fff640 1 -- 172.21.15.16:0/3821059711 learned_addr learned my addr 172.21.15.16:0/3821059711 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:24.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.055+0000 7f7e62ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7e640bac10 0x7f7e640d3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46680/0 (socket says 172.21.15.16:46680) 2024-05-11T01:01:24.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.055+0000 7f7e62ffd640 1 -- 172.21.15.16:0/3821059711 >> v1:172.21.15.174:6789/0 conn(0x7f7e640b6d70 legacy=0x7f7e640b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:24.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.055+0000 7f7e62ffd640 1 -- 172.21.15.16:0/3821059711 >> v1:172.21.15.16:6789/0 conn(0x7f7e640d3ec0 legacy=0x7f7e640d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.055+0000 7f7e62ffd640 1 -- 172.21.15.16:0/3821059711 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e641635f0 con 0x7f7e640bac10 2024-05-11T01:01:24.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.055+0000 7f7e627fc640 1 -- 172.21.15.16:0/3821059711 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57636027 0 0) 0x7f7e64163e90 con 0x7f7e640d3ec0 2024-05-11T01:01:24.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e62ffd640 1 --2- 172.21.15.16:0/3821059711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640bac10 0x7f7e640d3980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7e580097d0 tx=0x7f7e5802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c3b7dde9aa2475 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e627fc640 1 -- 172.21.15.16:0/3821059711 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e58037070 con 0x7f7e640bac10 2024-05-11T01:01:24.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e627fc640 1 -- 172.21.15.16:0/3821059711 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5802ae40 con 0x7f7e640bac10 2024-05-11T01:01:24.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e627fc640 1 -- 172.21.15.16:0/3821059711 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e58032660 con 0x7f7e640bac10 2024-05-11T01:01:24.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e6a245640 1 -- 172.21.15.16:0/3821059711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640bac10 msgr2=0x7f7e640d3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e6a245640 1 --2- 172.21.15.16:0/3821059711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640bac10 0x7f7e640d3980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7e580097d0 tx=0x7f7e5802a130 comp rx=0 tx=0).stop 2024-05-11T01:01:24.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e6a245640 1 -- 172.21.15.16:0/3821059711 shutdown_connections 2024-05-11T01:01:24.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e6a245640 1 --2- 172.21.15.16:0/3821059711 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640bac10 0x7f7e640d3980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e6a245640 1 -- 172.21.15.16:0/3821059711 >> 172.21.15.16:0/3821059711 conn(0x7f7e64074140 msgr2=0x7f7e640d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:24.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e6a245640 1 -- 172.21.15.16:0/3821059711 shutdown_connections 2024-05-11T01:01:24.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.056+0000 7f7e6a245640 1 -- 172.21.15.16:0/3821059711 wait complete. 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.058+0000 7f7e6a245640 1 Processor -- start 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.058+0000 7f7e6a245640 1 -- start start 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.058+0000 7f7e6a245640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e640b6d70 0x7f7e640cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.058+0000 7f7e6a245640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e640bac10 0x7f7e6415fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e6a245640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640d3ec0 0x7f7e64156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e6a245640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6415f830 con 0x7f7e640d3ec0 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e6a245640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7e64163bb0 con 0x7f7e640bac10 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e6a245640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7e64162fc0 con 0x7f7e640b6d70 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640d3ec0 0x7f7e64156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640d3ec0 0x7f7e64156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46696/0 (socket says 172.21.15.16:46696) 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 -- 172.21.15.16:0/3843565345 learned_addr learned my addr 172.21.15.16:0/3843565345 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:24.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e62ffd640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e640bac10 0x7f7e6415fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e637fe640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e640b6d70 0x7f7e640cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 -- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e640b6d70 msgr2=0x7f7e640cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e640b6d70 0x7f7e640cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 -- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e640bac10 msgr2=0x7f7e6415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e640bac10 0x7f7e6415fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 -- 172.21.15.16:0/3843565345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e64160680 con 0x7f7e640d3ec0 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e62ffd640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e640bac10 0x7f7e6415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e637fe640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e640b6d70 0x7f7e640cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e63fff640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640d3ec0 0x7f7e64156a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c6b0 tx=0x7f7e5c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e4bfff640 1 -- 172.21.15.16:0/3843565345 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c018070 con 0x7f7e640d3ec0 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e4bfff640 1 -- 172.21.15.16:0/3843565345 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c004da0 con 0x7f7e640d3ec0 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e4bfff640 1 -- 172.21.15.16:0/3843565345 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00a880 con 0x7f7e640d3ec0 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e64160960 con 0x7f7e640d3ec0 2024-05-11T01:01:24.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.059+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e640cce70 con 0x7f7e640d3ec0 2024-05-11T01:01:24.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.060+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e6406a5b0 con 0x7f7e640d3ec0 2024-05-11T01:01:24.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.061+0000 7f7e4bfff640 1 -- 172.21.15.16:0/3843565345 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e5c00aa20 con 0x7f7e640d3ec0 2024-05-11T01:01:24.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.061+0000 7f7e4bfff640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e500762d0 0x7f7e50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.062+0000 7f7e4bfff640 1 -- 172.21.15.16:0/3843565345 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7e5c096b30 con 0x7f7e640d3ec0 2024-05-11T01:01:24.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.062+0000 7f7e637fe640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e500762d0 0x7f7e50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.062+0000 7f7e637fe640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e500762d0 0x7f7e50078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7e54003eb0 tx=0x7f7e54009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.066+0000 7f7e4bfff640 1 -- 172.21.15.16:0/3843565345 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7e5c05fe30 con 0x7f7e640d3ec0 2024-05-11T01:01:24.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.294+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e640cd310 con 0x7f7e640d3ec0 2024-05-11T01:01:24.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.295+0000 7f7e4bfff640 1 -- 172.21.15.16:0/3843565345 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5178 (secure 0 0 0) 0x7f7e5c064130 con 0x7f7e640d3ec0 2024-05-11T01:01:24.295 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:24.296 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:09.046368+0000","modified":"2024-05-11T01:01:12.033345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-11T01:01:24.296 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-05-11T01:01:24.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e500762d0 msgr2=0x7f7e50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e500762d0 0x7f7e50078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7e54003eb0 tx=0x7f7e54009040 comp rx=0 tx=0).stop 2024-05-11T01:01:24.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640d3ec0 msgr2=0x7f7e64156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640d3ec0 0x7f7e64156a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c6b0 tx=0x7f7e5c00cb70 comp rx=0 tx=0).stop 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 shutdown_connections 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e500762d0 0x7f7e50078790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e640d3ec0 0x7f7e64156a10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e640bac10 0x7f7e6415fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 --2- 172.21.15.16:0/3843565345 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e640b6d70 0x7f7e640cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 >> 172.21.15.16:0/3843565345 conn(0x7f7e64074140 msgr2=0x7f7e640d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 shutdown_connections 2024-05-11T01:01:24.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.297+0000 7f7e6a245640 1 -- 172.21.15.16:0/3843565345 wait complete. 2024-05-11T01:01:24.308 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:24.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.411+0000 7f6328015640 1 Processor -- start 2024-05-11T01:01:24.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.412+0000 7f6328015640 1 -- start start 2024-05-11T01:01:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.412+0000 7f6328015640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63200d0000 0x7f63200d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.412+0000 7f6328015640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d3bf0 0x7f63200d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.412+0000 7f6328015640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63200d0920 con 0x7f63200baed0 2024-05-11T01:01:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.412+0000 7f6328015640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6320163820 con 0x7f63200d0000 2024-05-11T01:01:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.412+0000 7f6328015640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6320163b00 con 0x7f63200d3bf0 2024-05-11T01:01:24.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f6325db1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63200d0000 0x7f63200d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f63255b0640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f63200baed0 0x7f6320162fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42916/0 (socket says 172.21.15.16:42916) 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f63255b0640 1 -- 172.21.15.16:0/3068609953 learned_addr learned my addr 172.21.15.16:0/3068609953 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f63265b2640 1 --2- 172.21.15.16:0/3068609953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d3bf0 0x7f63200d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f6325db1640 1 -- 172.21.15.16:0/3068609953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d3bf0 msgr2=0x7f63200d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f6325db1640 1 --2- 172.21.15.16:0/3068609953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d3bf0 0x7f63200d4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f6325db1640 1 -- 172.21.15.16:0/3068609953 >> v1:172.21.15.16:6789/0 conn(0x7f63200baed0 legacy=0x7f6320162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f6325db1640 1 -- 172.21.15.16:0/3068609953 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63200d33f0 con 0x7f63200d0000 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f6324daf640 1 -- 172.21.15.16:0/3068609953 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986949995 0 0) 0x7f63200d0920 con 0x7f63200baed0 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.413+0000 7f63265b2640 1 --2- 172.21.15.16:0/3068609953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d3bf0 0x7f63200d4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:24.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6325db1640 1 --2- 172.21.15.16:0/3068609953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d0000 0x7f63200d03e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f631c0097a0 tx=0x7f631c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e02c0fa158c5859 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6324daf640 1 -- 172.21.15.16:0/3068609953 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c037070 con 0x7f63200d0000 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6324daf640 1 -- 172.21.15.16:0/3068609953 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631c032440 con 0x7f63200d0000 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6324daf640 1 -- 172.21.15.16:0/3068609953 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c032810 con 0x7f63200d0000 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6328015640 1 -- 172.21.15.16:0/3068609953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d0000 msgr2=0x7f63200d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6328015640 1 --2- 172.21.15.16:0/3068609953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d0000 0x7f63200d03e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f631c0097a0 tx=0x7f631c02a180 comp rx=0 tx=0).stop 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6328015640 1 -- 172.21.15.16:0/3068609953 shutdown_connections 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6328015640 1 --2- 172.21.15.16:0/3068609953 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d3bf0 0x7f63200d4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6328015640 1 --2- 172.21.15.16:0/3068609953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d0000 0x7f63200d03e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6328015640 1 -- 172.21.15.16:0/3068609953 >> 172.21.15.16:0/3068609953 conn(0x7f6320074140 msgr2=0x7f63200b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6328015640 1 -- 172.21.15.16:0/3068609953 shutdown_connections 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.414+0000 7f6328015640 1 -- 172.21.15.16:0/3068609953 wait complete. 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f6328015640 1 Processor -- start 2024-05-11T01:01:24.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f6328015640 1 -- start start 2024-05-11T01:01:24.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f6328015640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63200baed0 0x7f632014a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f6328015640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d0000 0x7f6320160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f6328015640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d3bf0 0x7f6320161430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f6328015640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f632015f750 con 0x7f63200d3bf0 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f6328015640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6320163de0 con 0x7f63200baed0 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f6328015640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f632015f8d0 con 0x7f63200d0000 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f63265b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d3bf0 0x7f6320161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f63265b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d3bf0 0x7f6320161430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46708/0 (socket says 172.21.15.16:46708) 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.416+0000 7f63265b2640 1 -- 172.21.15.16:0/1393665914 learned_addr learned my addr 172.21.15.16:0/1393665914 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f6325db1640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63200baed0 0x7f632014a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63255b0640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d0000 0x7f6320160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63265b2640 1 -- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d0000 msgr2=0x7f6320160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63265b2640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d0000 0x7f6320160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63265b2640 1 -- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63200baed0 msgr2=0x7f632014a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63265b2640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63200baed0 0x7f632014a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63265b2640 1 -- 172.21.15.16:0/1393665914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6320160c90 con 0x7f63200d3bf0 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63255b0640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d0000 0x7f6320160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:24.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63265b2640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d3bf0 0x7f6320161430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6318009fa0 tx=0x7f631800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63167fc640 1 -- 172.21.15.16:0/1393665914 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631801a070 con 0x7f63200d3bf0 2024-05-11T01:01:24.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63167fc640 1 -- 172.21.15.16:0/1393665914 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6318003bb0 con 0x7f63200d3bf0 2024-05-11T01:01:24.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f63167fc640 1 -- 172.21.15.16:0/1393665914 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318004030 con 0x7f63200d3bf0 2024-05-11T01:01:24.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632015fbf0 con 0x7f63200d3bf0 2024-05-11T01:01:24.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.417+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63201601b0 con 0x7f63200d3bf0 2024-05-11T01:01:24.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.418+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632006a5b0 con 0x7f63200d3bf0 2024-05-11T01:01:24.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.419+0000 7f63167fc640 1 -- 172.21.15.16:0/1393665914 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f631801d070 con 0x7f63200d3bf0 2024-05-11T01:01:24.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.419+0000 7f63167fc640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63040762d0 0x7f6304078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.419+0000 7f63167fc640 1 -- 172.21.15.16:0/1393665914 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f63180978a0 con 0x7f63200d3bf0 2024-05-11T01:01:24.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.419+0000 7f6325db1640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63040762d0 0x7f6304078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.420+0000 7f6325db1640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63040762d0 0x7f6304078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f631c034000 tx=0x7f631c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.423+0000 7f63167fc640 1 -- 172.21.15.16:0/1393665914 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6318010070 con 0x7f63200d3bf0 2024-05-11T01:01:24.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.616+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f632006c3e0 con 0x7f63200d3bf0 2024-05-11T01:01:24.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.617+0000 7f63167fc640 1 -- 172.21.15.16:0/1393665914 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f6318060bb0 con 0x7f63200d3bf0 2024-05-11T01:01:24.617 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:24.617 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:10.636137+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63040762d0 msgr2=0x7f6304078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63040762d0 0x7f6304078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f631c034000 tx=0x7f631c02e000 comp rx=0 tx=0).stop 2024-05-11T01:01:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d3bf0 msgr2=0x7f6320161430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d3bf0 0x7f6320161430 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6318009fa0 tx=0x7f631800d560 comp rx=0 tx=0).stop 2024-05-11T01:01:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 shutdown_connections 2024-05-11T01:01:24.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63040762d0 0x7f6304078790 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200d3bf0 0x7f6320161430 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63200d0000 0x7f6320160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 --2- 172.21.15.16:0/1393665914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63200baed0 0x7f632014a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 >> 172.21.15.16:0/1393665914 conn(0x7f6320074140 msgr2=0x7f63200d54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:24.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 shutdown_connections 2024-05-11T01:01:24.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.619+0000 7f6328015640 1 -- 172.21.15.16:0/1393665914 wait complete. 2024-05-11T01:01:24.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:24.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.735+0000 7f58eaf0a640 1 Processor -- start 2024-05-11T01:01:24.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.736+0000 7f58eaf0a640 1 -- start start 2024-05-11T01:01:24.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.736+0000 7f58eaf0a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f58e4162d30 0x7f58e40baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.736+0000 7f58eaf0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e4163210 0x7f58e40b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.736+0000 7f58eaf0a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58e40b7360 0x7f58e406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.736+0000 7f58eaf0a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f58e40d3700 con 0x7f58e40b7360 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.736+0000 7f58eaf0a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f58e41639f0 con 0x7f58e4162d30 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.736+0000 7f58eaf0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f58e4163cd0 con 0x7f58e4163210 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.736+0000 7f58e94a7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58e40b7360 0x7f58e406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e94a7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58e40b7360 0x7f58e406d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46718/0 (socket says 172.21.15.16:46718) 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e94a7640 1 -- 172.21.15.16:0/3465112050 learned_addr learned my addr 172.21.15.16:0/3465112050 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e8ca6640 1 --2- 172.21.15.16:0/3465112050 >> v2:172.21.15.174:3300/0 conn(0x7f58e4162d30 0x7f58e40baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e3fff640 1 --2- 172.21.15.16:0/3465112050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e4163210 0x7f58e40b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e94a7640 1 -- 172.21.15.16:0/3465112050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e4163210 msgr2=0x7f58e40b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e94a7640 1 --2- 172.21.15.16:0/3465112050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e4163210 0x7f58e40b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e94a7640 1 -- 172.21.15.16:0/3465112050 >> v2:172.21.15.174:3300/0 conn(0x7f58e4162d30 msgr2=0x7f58e40baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e94a7640 1 --2- 172.21.15.16:0/3465112050 >> v2:172.21.15.174:3300/0 conn(0x7f58e4162d30 0x7f58e40baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e94a7640 1 -- 172.21.15.16:0/3465112050 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4163fb0 con 0x7f58e40b7360 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.737+0000 7f58e8ca6640 1 --2- 172.21.15.16:0/3465112050 >> v2:172.21.15.174:3300/0 conn(0x7f58e4162d30 0x7f58e40baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58e94a7640 1 --2- 172.21.15.16:0/3465112050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40b7360 0x7f58e406d2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f58e408e5f0 tx=0x7f58dc02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e475fdac6af2704 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58e37fe640 1 -- 172.21.15.16:0/3465112050 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc036070 con 0x7f58e40b7360 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58e37fe640 1 -- 172.21.15.16:0/3465112050 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc031600 con 0x7f58e40b7360 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58e37fe640 1 -- 172.21.15.16:0/3465112050 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0319d0 con 0x7f58e40b7360 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 -- 172.21.15.16:0/3465112050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40b7360 msgr2=0x7f58e406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/3465112050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40b7360 0x7f58e406d2c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f58e408e5f0 tx=0x7f58dc02a570 comp rx=0 tx=0).stop 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 -- 172.21.15.16:0/3465112050 shutdown_connections 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/3465112050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e40b7360 0x7f58e406d2c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/3465112050 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e4163210 0x7f58e40b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/3465112050 >> v2:172.21.15.174:3300/0 conn(0x7f58e4162d30 0x7f58e40baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 -- 172.21.15.16:0/3465112050 >> 172.21.15.16:0/3465112050 conn(0x7f58e40d1e20 msgr2=0x7f58e40d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:24.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 -- 172.21.15.16:0/3465112050 shutdown_connections 2024-05-11T01:01:24.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.738+0000 7f58eaf0a640 1 -- 172.21.15.16:0/3465112050 wait complete. 2024-05-11T01:01:24.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.739+0000 7f58eaf0a640 1 Processor -- start 2024-05-11T01:01:24.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.740+0000 7f58eaf0a640 1 -- start start 2024-05-11T01:01:24.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.740+0000 7f58eaf0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e40b7360 0x7f58e4146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.740+0000 7f58eaf0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58e4162d30 0x7f58e40c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.740+0000 7f58eaf0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e4163210 0x7f58e40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.740+0000 7f58eaf0a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f58e406d800 con 0x7f58e4163210 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.740+0000 7f58eaf0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4163670 con 0x7f58e4162d30 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.740+0000 7f58eaf0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f58e406d980 con 0x7f58e40b7360 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e4163210 0x7f58e40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e4163210 0x7f58e40c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46726/0 (socket says 172.21.15.16:46726) 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 -- 172.21.15.16:0/1391703096 learned_addr learned my addr 172.21.15.16:0/1391703096 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e3fff640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58e4162d30 0x7f58e40c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e8ca6640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e40b7360 0x7f58e4146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 -- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e40b7360 msgr2=0x7f58e4146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e40b7360 0x7f58e4146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 -- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58e4162d30 msgr2=0x7f58e40c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58e4162d30 0x7f58e40c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 -- 172.21.15.16:0/1391703096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e414b6e0 con 0x7f58e4163210 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e94a7640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e4163210 0x7f58e40c8e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009f40 tx=0x7f58dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e17fa640 1 -- 172.21.15.16:0/1391703096 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc041020 con 0x7f58e4163210 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e17fa640 1 -- 172.21.15.16:0/1391703096 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc0077a0 con 0x7f58e4163210 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58e17fa640 1 -- 172.21.15.16:0/1391703096 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc036040 con 0x7f58e4163210 2024-05-11T01:01:24.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e414b9c0 con 0x7f58e4163210 2024-05-11T01:01:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.741+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e414bf80 con 0x7f58e4163210 2024-05-11T01:01:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.742+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e406a5b0 con 0x7f58e4163210 2024-05-11T01:01:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.743+0000 7f58e17fa640 1 -- 172.21.15.16:0/1391703096 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f58dc044020 con 0x7f58e4163210 2024-05-11T01:01:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.744+0000 7f58e17fa640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f58c80762d0 0x7f58c8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.744+0000 7f58e17fa640 1 -- 172.21.15.16:0/1391703096 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58dc0b82a0 con 0x7f58e4163210 2024-05-11T01:01:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.744+0000 7f58e8ca6640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f58c80762d0 0x7f58c8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:24.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.745+0000 7f58e8ca6640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f58c80762d0 0x7f58c8078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f58d8006b10 tx=0x7f58d8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:24.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.748+0000 7f58e17fa640 1 -- 172.21.15.16:0/1391703096 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f58dc04b030 con 0x7f58e4163210 2024-05-11T01:01:24.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.977+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58e41474b0 con 0x7f58e4163210 2024-05-11T01:01:24.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.978+0000 7f58e17fa640 1 -- 172.21.15.16:0/1391703096 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5178 (secure 0 0 0) 0x7f58dc0b80c0 con 0x7f58e4163210 2024-05-11T01:01:24.978 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:24.979 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:09.046368+0000","modified":"2024-05-11T01:01:12.033345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-11T01:01:24.979 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-05-11T01:01:24.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f58c80762d0 msgr2=0x7f58c8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f58c80762d0 0x7f58c8078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f58d8006b10 tx=0x7f58d8008040 comp rx=0 tx=0).stop 2024-05-11T01:01:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e4163210 msgr2=0x7f58e40c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e4163210 0x7f58e40c8e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009f40 tx=0x7f58dc004a40 comp rx=0 tx=0).stop 2024-05-11T01:01:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 shutdown_connections 2024-05-11T01:01:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f58c80762d0 0x7f58c8078790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58e4163210 0x7f58e40c8e10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58e4162d30 0x7f58e40c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 --2- 172.21.15.16:0/1391703096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f58e40b7360 0x7f58e4146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 >> 172.21.15.16:0/1391703096 conn(0x7f58e40d1e20 msgr2=0x7f58e40d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 shutdown_connections 2024-05-11T01:01:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:24.980+0000 7f58eaf0a640 1 -- 172.21.15.16:0/1391703096 wait complete. 2024-05-11T01:01:25.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-11T01:01:09.046368+0000', 'modified': '2024-05-11T01:01:12.033345+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6835/2538287470', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6833', 'nonce': 2538287470}, {'type': 'v1', 'addr': '172.21.15.16:6835', 'nonce': 2538287470}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4260, 'qdb_cluster': [4260]} 2024-05-11T01:01:25.394 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-11T01:01:25.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-11T01:01:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.503+0000 7ffa1a208640 1 Processor -- start 2024-05-11T01:01:25.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.503+0000 7ffa1a208640 1 -- start start 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa1a208640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffa140bac10 0x7ffa140d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa1a208640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa140d3ec0 0x7ffa140d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa1a208640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa14163e90 con 0x7ffa140b6d70 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa1a208640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffa140cfad0 con 0x7ffa140d3ec0 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa1a208640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ffa14163310 con 0x7ffa140bac10 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa137fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ffa140b6d70 0x7ffa140b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42918/0 (socket says 172.21.15.16:42918) 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa137fe640 1 -- 172.21.15.16:0/3821377557 learned_addr learned my addr 172.21.15.16:0/3821377557 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa13fff640 1 --2- 172.21.15.16:0/3821377557 >> v2:172.21.15.16:3300/0 conn(0x7ffa140d3ec0 0x7ffa140d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa127fc640 1 -- 172.21.15.16:0/3821377557 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307545272 0 0) 0x7ffa14163e90 con 0x7ffa140b6d70 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa127fc640 1 -- 172.21.15.16:0/3821377557 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9fc003520 con 0x7ffa140b6d70 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/3821377557 >> v2:172.21.15.174:3300/0 conn(0x7ffa140bac10 0x7ffa140d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa13fff640 1 -- 172.21.15.16:0/3821377557 >> v2:172.21.15.174:3300/0 conn(0x7ffa140bac10 msgr2=0x7ffa140d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa13fff640 1 --2- 172.21.15.16:0/3821377557 >> v2:172.21.15.174:3300/0 conn(0x7ffa140bac10 0x7ffa140d3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa13fff640 1 -- 172.21.15.16:0/3821377557 >> v1:172.21.15.16:6789/0 conn(0x7ffa140b6d70 legacy=0x7ffa140b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.504+0000 7ffa13fff640 1 -- 172.21.15.16:0/3821377557 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa141635f0 con 0x7ffa140d3ec0 2024-05-11T01:01:25.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.505+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/3821377557 >> v2:172.21.15.174:3300/0 conn(0x7ffa140bac10 0x7ffa140d3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:25.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.505+0000 7ffa13fff640 1 --2- 172.21.15.16:0/3821377557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140d3ec0 0x7ffa140d4330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009d90 tx=0x7ffa0c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b855b77b25d43c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:25.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.505+0000 7ffa127fc640 1 -- 172.21.15.16:0/3821377557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c031600 con 0x7ffa140d3ec0 2024-05-11T01:01:25.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.505+0000 7ffa127fc640 1 -- 172.21.15.16:0/3821377557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0317a0 con 0x7ffa140d3ec0 2024-05-11T01:01:25.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.505+0000 7ffa127fc640 1 -- 172.21.15.16:0/3821377557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c031b70 con 0x7ffa140d3ec0 2024-05-11T01:01:25.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.506+0000 7ffa1a208640 1 -- 172.21.15.16:0/3821377557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140d3ec0 msgr2=0x7ffa140d4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.506+0000 7ffa1a208640 1 --2- 172.21.15.16:0/3821377557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140d3ec0 0x7ffa140d4330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009d90 tx=0x7ffa0c02a610 comp rx=0 tx=0).stop 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.506+0000 7ffa1a208640 1 -- 172.21.15.16:0/3821377557 shutdown_connections 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.506+0000 7ffa1a208640 1 --2- 172.21.15.16:0/3821377557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140d3ec0 0x7ffa140d4330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.506+0000 7ffa1a208640 1 --2- 172.21.15.16:0/3821377557 >> v2:172.21.15.174:3300/0 conn(0x7ffa140bac10 0x7ffa140d3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.506+0000 7ffa1a208640 1 -- 172.21.15.16:0/3821377557 >> 172.21.15.16:0/3821377557 conn(0x7ffa14074140 msgr2=0x7ffa140d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.506+0000 7ffa1a208640 1 -- 172.21.15.16:0/3821377557 shutdown_connections 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.506+0000 7ffa1a208640 1 -- 172.21.15.16:0/3821377557 wait complete. 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.507+0000 7ffa1a208640 1 Processor -- start 2024-05-11T01:01:25.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.507+0000 7ffa1a208640 1 -- start start 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa1a208640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140b6d70 0x7ffa1415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa1a208640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa140bac10 0x7ffa141e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa1a208640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa140d3ec0 0x7ffa140b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa1a208640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1415f830 con 0x7ffa140b6d70 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa1a208640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa14163bb0 con 0x7ffa140d3ec0 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa1a208640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffa14162fc0 con 0x7ffa140bac10 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa137fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140b6d70 0x7ffa1415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa137fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140b6d70 0x7ffa1415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46732/0 (socket says 172.21.15.16:46732) 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa137fe640 1 -- 172.21.15.16:0/2450303276 learned_addr learned my addr 172.21.15.16:0/2450303276 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:25.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa140bac10 0x7ffa141e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa13fff640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa140d3ec0 0x7ffa140b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa137fe640 1 -- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa140bac10 msgr2=0x7ffa141e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa140bac10 0x7ffa141e9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa137fe640 1 -- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa140d3ec0 msgr2=0x7ffa140b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa140d3ec0 0x7ffa140b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.508+0000 7ffa137fe640 1 -- 172.21.15.16:0/2450303276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa14160150 con 0x7ffa140b6d70 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.509+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140b6d70 0x7ffa1415a770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c440 tx=0x7ffa0400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.509+0000 7ff9fbfff640 1 -- 172.21.15.16:0/2450303276 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04017070 con 0x7ffa140b6d70 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.509+0000 7ff9fbfff640 1 -- 172.21.15.16:0/2450303276 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa04005ce0 con 0x7ffa140b6d70 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.509+0000 7ffa1a208640 1 -- 172.21.15.16:0/2450303276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa141ea9d0 con 0x7ffa140b6d70 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.509+0000 7ff9fbfff640 1 -- 172.21.15.16:0/2450303276 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04007270 con 0x7ffa140b6d70 2024-05-11T01:01:25.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.509+0000 7ffa1a208640 1 -- 172.21.15.16:0/2450303276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa141eaf90 con 0x7ffa140b6d70 2024-05-11T01:01:25.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.511+0000 7ff9fbfff640 1 -- 172.21.15.16:0/2450303276 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffa0401a070 con 0x7ffa140b6d70 2024-05-11T01:01:25.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.511+0000 7ff9fbfff640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffa000762d0 0x7ffa00078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.511+0000 7ff9fbfff640 1 -- 172.21.15.16:0/2450303276 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa04096760 con 0x7ffa140b6d70 2024-05-11T01:01:25.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.511+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffa000762d0 0x7ffa00078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.512+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffa000762d0 0x7ffa00078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800a990 tx=0x7ffa08008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:25.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.512+0000 7ffa1cff3740 1 Processor -- start 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.512+0000 7ffa1cff3740 1 -- start start 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7a4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e774c50 0x562f3e778460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f3e6de8d0 con 0x562f3e7a23d0 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562f3e697c10 con 0x562f3e774c50 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x562f3e6da890 con 0x562f3e7a1ff0 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7a4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46748/0 (socket says 172.21.15.16:46748) 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 -- 172.21.15.16:0/997698485 learned_addr learned my addr 172.21.15.16:0/997698485 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa13fff640 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e774c50 0x562f3e778460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa137fe640 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 -- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 msgr2=0x562f3e7a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 -- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e774c50 msgr2=0x562f3e778460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e774c50 0x562f3e778460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 -- 172.21.15.16:0/997698485 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3e69f5d0 con 0x562f3e7a23d0 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa137fe640 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa13fff640 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e774c50 0x562f3e778460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7a4d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800fa50 tx=0x7ffa08012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43abc3a874f0e0f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ff9f97fa640 1 -- 172.21.15.16:0/997698485 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0801b050 con 0x562f3e7a23d0 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.513+0000 7ff9f97fa640 1 -- 172.21.15.16:0/997698485 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa08025070 con 0x562f3e7a23d0 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ff9f97fa640 1 -- 172.21.15.16:0/997698485 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08014de0 con 0x562f3e7a23d0 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 -- 172.21.15.16:0/997698485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 msgr2=0x562f3e7a4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7a4d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800fa50 tx=0x7ffa08012000 comp rx=0 tx=0).stop 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 -- 172.21.15.16:0/997698485 shutdown_connections 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e774c50 0x562f3e778460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7a4d40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/997698485 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 -- 172.21.15.16:0/997698485 >> 172.21.15.16:0/997698485 conn(0x562f3e776ec0 msgr2=0x562f3e7bf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:25.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 -- 172.21.15.16:0/997698485 shutdown_connections 2024-05-11T01:01:25.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.514+0000 7ffa1cff3740 1 -- 172.21.15.16:0/997698485 wait complete. 2024-05-11T01:01:25.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.515+0000 7ffa1cff3740 1 -- start start 2024-05-11T01:01:25.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.515+0000 7ffa1cff3740 1 Processor -- start 2024-05-11T01:01:25.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 0x562f3e7a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f3e77a070 con 0x562f3e798e00 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562f3e69b760 con 0x562f3e7a23d0 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x562f3e77a350 con 0x562f3e7a1ff0 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa1cff3740 10 client.0 _ll_register_callbacks cb 0x562f3e6d4cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46750/0 (socket says 172.21.15.16:46750) 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 -- 172.21.15.16:0/3346256436 learned_addr learned my addr 172.21.15.16:0/3346256436 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa137fe640 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 -- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 msgr2=0x562f3e7c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 0x562f3e7a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 -- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 msgr2=0x562f3e7a7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 0x562f3e7a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 -- 172.21.15.16:0/3346256436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3e3f02d0 con 0x562f3e798e00 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa137fe640 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa13fff640 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a8420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009eb0 tx=0x7ffa0c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d909238ae9d7d64b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ff9f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ff9f27fc640 1 -- 172.21.15.16:0/3346256436 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c009450 con 0x562f3e798e00 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ff9f27fc640 1 -- 172.21.15.16:0/3346256436 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa0c03b850 con 0x562f3e798e00 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.516+0000 7ffa1cff3740 1 -- 172.21.15.16:0/3346256436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa08025070 con 0x562f3e798e00 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ff9f27fc640 1 -- 172.21.15.16:0/3346256436 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ffa0c04f050 con 0x562f3e798e00 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa1cff3740 10 client.4599 fetch_fsmap learned FSMap version 8 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa1cff3740 1 -- 172.21.15.16:0/3346256436 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x562f3e4ba6b0 con 0x562f3e798e00 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ff9f27fc640 1 -- 172.21.15.16:0/3346256436 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa08025070 con 0x562f3e798e00 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ff9f27fc640 1 -- 172.21.15.16:0/3346256436 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7ffa0c052020 con 0x562f3e798e00 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa1cff3740 10 client.4599 fetch_fsmap finished waiting for FSMap version 8 2024-05-11T01:01:25.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa1cff3740 10 client.4599 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa1cff3740 20 client.4599 populate_metadata read hostname 'smithi016' 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] conn(0x562f3e7a7440 0x562f3e7a7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa1cff3740 4 client.4599 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa1cff3740 1 -- 172.21.15.16:0/3346256436 --> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f3e662760 con 0x562f3e7a7440 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa137fe640 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] conn(0x562f3e7a7440 0x562f3e7a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ff9f27fc640 10 client.4599 ms_handle_connect on v2:172.21.15.16:6833/2538287470 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.517+0000 7ffa137fe640 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] conn(0x562f3e7a7440 0x562f3e7a7820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8154d45bcb64450 server_cookie=37926ef87f1df9a2 in_seq=0 out_seq=0 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ff9f27fc640 1 -- 172.21.15.16:0/3346256436 <== mds.0 v2:172.21.15.16:6833/2538287470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562f3e662760 con 0x562f3e7a7440 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ff9f27fc640 10 client.4599 handle_command_reply: tid=0 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 client.4599 shutdown 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 -- 172.21.15.16:0/3346256436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 msgr2=0x562f3e7a8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a8420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009eb0 tx=0x7ffa0c004ab0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 -- 172.21.15.16:0/3346256436 shutdown_connections 2024-05-11T01:01:25.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] conn(0x562f3e7a7440 0x562f3e7a7820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a8420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 0x562f3e7a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/3346256436 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ff9f27fc640 0 client.4599 ms_handle_reset on v2:172.21.15.16:6833/2538287470 2024-05-11T01:01:25.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 -- 172.21.15.16:0/3346256436 >> 172.21.15.16:0/3346256436 conn(0x562f3e774c50 msgr2=0x562f3e7a4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:25.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 -- 172.21.15.16:0/3346256436 shutdown_connections 2024-05-11T01:01:25.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 1 -- 172.21.15.16:0/3346256436 wait complete. 2024-05-11T01:01:25.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.518+0000 7ffa1cff3740 20 client.4599 trim_cache size 0 max 16384 2024-05-11T01:01:25.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.537+0000 7ffa1cff3740 1 Processor -- start 2024-05-11T01:01:25.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.537+0000 7ffa1cff3740 1 -- start start 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 0x562f3e7c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffa142016d0 con 0x562f3e798e00 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa14200710 con 0x562f3e7a23d0 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffa141ffaa0 con 0x562f3e7a1ff0 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46764/0 (socket says 172.21.15.16:46764) 2024-05-11T01:01:25.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 -- 172.21.15.16:0/2901337557 learned_addr learned my addr 172.21.15.16:0/2901337557 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 -- 172.21.15.16:0/2901337557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 msgr2=0x562f3e7c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2901337557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 -- 172.21.15.16:0/2901337557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 msgr2=0x562f3e7c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2901337557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 0x562f3e7c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 -- 172.21.15.16:0/2901337557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3e798760 con 0x562f3e798e00 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2901337557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a1410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa0405f770 tx=0x7ffa04094b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56043316835ca6d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ff9f8ff9640 1 -- 172.21.15.16:0/2901337557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04068790 con 0x562f3e798e00 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ff9f8ff9640 1 -- 172.21.15.16:0/2901337557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0405bd00 con 0x562f3e798e00 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.538+0000 7ff9f8ff9640 1 -- 172.21.15.16:0/2901337557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0405ecd0 con 0x562f3e798e00 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2901337557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 msgr2=0x562f3e7a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2901337557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a1410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffa0405f770 tx=0x7ffa04094b60 comp rx=0 tx=0).stop 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2901337557 shutdown_connections 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2901337557 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a23d0 0x562f3e7c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2901337557 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e7a1ff0 0x562f3e7c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2901337557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e798e00 0x562f3e7a1410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2901337557 >> 172.21.15.16:0/2901337557 conn(0x562f3e774c50 msgr2=0x562f3e7a4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2901337557 shutdown_connections 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.539+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2901337557 wait complete. 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.540+0000 7ffa1cff3740 1 -- start start 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.540+0000 7ffa1cff3740 1 Processor -- start 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.540+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e798e00 0x562f3e775b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.540+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a1ff0 0x562f3e7b5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.540+0000 7ffa1cff3740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.540+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x562f3e7a5b20 con 0x562f3e7a23d0 2024-05-11T01:01:25.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.540+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa142000c0 con 0x562f3e7a1ff0 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.540+0000 7ffa1cff3740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x562f3e7a65e0 con 0x562f3e798e00 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa1cff3740 10 client.0 _ll_register_callbacks cb 0x7ff9fc0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46776/0 (socket says 172.21.15.16:46776) 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 -- 172.21.15.16:0/2666910638 learned_addr learned my addr 172.21.15.16:0/2666910638 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa12ffd640 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a1ff0 0x562f3e7b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e798e00 0x562f3e775b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 -- 172.21.15.16:0/2666910638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e798e00 msgr2=0x562f3e775b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e798e00 0x562f3e775b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 -- 172.21.15.16:0/2666910638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a1ff0 msgr2=0x562f3e7b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a1ff0 0x562f3e7b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 -- 172.21.15.16:0/2666910638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3e7e3ce0 con 0x562f3e7a23d0 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa13fff640 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7c1e20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009400 tx=0x7ffa0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c77d80dae3513e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ff9f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-05-11T01:01:25.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ff9f27fc640 1 -- 172.21.15.16:0/2666910638 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c057030 con 0x562f3e7a23d0 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ff9f27fc640 1 -- 172.21.15.16:0/2666910638 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa0c002030 con 0x562f3e7a23d0 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2666910638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa0405bd00 con 0x562f3e7a23d0 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ff9f27fc640 1 -- 172.21.15.16:0/2666910638 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7ffa0c060050 con 0x562f3e7a23d0 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa1cff3740 10 client.4605 fetch_fsmap learned FSMap version 8 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.541+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2666910638 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x562f3e7e42a0 con 0x562f3e7a23d0 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ff9f27fc640 1 -- 172.21.15.16:0/2666910638 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0405bd00 con 0x562f3e7a23d0 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ff9f27fc640 1 -- 172.21.15.16:0/2666910638 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7ffa0c052040 con 0x562f3e7a23d0 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 10 client.4605 fetch_fsmap finished waiting for FSMap version 8 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 10 client.4605 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 20 client.4605 populate_metadata read hostname 'smithi016' 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] conn(0x562f3e774340 0x562f3e795850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 4 client.4605 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2666910638 --> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] -- command(tid 0: {"prefix": "status"}) -- 0x562f3e6ec4e0 con 0x562f3e774340 2024-05-11T01:01:25.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] conn(0x562f3e774340 0x562f3e795850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ff9f27fc640 10 client.4605 ms_handle_connect on v2:172.21.15.16:6833/2538287470 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa137fe640 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] conn(0x562f3e774340 0x562f3e795850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a62c99fe5bb43510 server_cookie=8c07c519f41da2b2 in_seq=0 out_seq=0 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ff9f27fc640 1 -- 172.21.15.16:0/2666910638 <== mds.0 v2:172.21.15.16:6833/2538287470 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x562f3e6ec4e0 con 0x562f3e774340 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ff9f27fc640 10 client.4605 handle_command_reply: tid=0 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 client.4605 shutdown 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2666910638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 msgr2=0x562f3e7c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7c1e20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009400 tx=0x7ffa0c004a40 comp rx=0 tx=0).stop 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2666910638 shutdown_connections 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.16:6833/2538287470,v1:172.21.15.16:6835/2538287470] conn(0x562f3e774340 0x562f3e795850 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x562f3e7a23d0 0x562f3e7c1e20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f3e7a1ff0 0x562f3e7b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 --2- 172.21.15.16:0/2666910638 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x562f3e798e00 0x562f3e775b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2666910638 >> 172.21.15.16:0/2666910638 conn(0x562f3e774c50 msgr2=0x562f3e7c1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ff9f27fc640 0 client.4605 ms_handle_reset on v2:172.21.15.16:6833/2538287470 2024-05-11T01:01:25.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.542+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2666910638 shutdown_connections 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1cff3740 1 -- 172.21.15.16:0/2666910638 wait complete. 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1cff3740 20 client.4605 trim_cache size 0 max 16384 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "3d939707-6559-4ce1-a2ce-e98842b2ed86", 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4260, 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 15.906550018000001, 2024-05-11T01:01:25.552 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 8, 2024-05-11T01:01:25.553 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 20, 2024-05-11T01:01:25.553 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 20, 2024-05-11T01:01:25.553 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 21.622846451000001 2024-05-11T01:01:25.553 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:01:25.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 -- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffa000762d0 msgr2=0x7ffa00078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffa000762d0 0x7ffa00078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800a990 tx=0x7ffa08008040 comp rx=0 tx=0).stop 2024-05-11T01:01:25.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 -- 172.21.15.16:0/2450303276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140b6d70 msgr2=0x7ffa1415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:25.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140b6d70 0x7ffa1415a770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400c440 tx=0x7ffa0400c900 comp rx=0 tx=0).stop 2024-05-11T01:01:25.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 -- 172.21.15.16:0/2450303276 shutdown_connections 2024-05-11T01:01:25.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffa000762d0 0x7ffa00078790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa140d3ec0 0x7ffa140b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa140bac10 0x7ffa141e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 --2- 172.21.15.16:0/2450303276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa140b6d70 0x7ffa1415a770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:25.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 -- 172.21.15.16:0/2450303276 >> 172.21.15.16:0/2450303276 conn(0x7ffa14074140 msgr2=0x7ffa140b7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:25.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 -- 172.21.15.16:0/2450303276 shutdown_connections 2024-05-11T01:01:25.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:25.543+0000 7ffa1a208640 1 -- 172.21.15.16:0/2450303276 wait complete. 2024-05-11T01:01:25.555 INFO:teuthology.run_tasks:Running task sequential... 2024-05-11T01:01:25.565 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-11T01:01:25.565 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-11T01:01:25.565 INFO:teuthology.task.print:Enabling mgr modules 2024-05-11T01:01:25.565 INFO:teuthology.run_tasks:Running task kclient... 2024-05-11T01:01:25.590 INFO:tasks.kclient:Mounting kernel clients... 2024-05-11T01:01:25.591 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-11T01:01:25.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:25.591 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-05-11T01:01:25.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:25.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-05-11T01:01:25.678 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2024-05-11T01:01:25.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:01:25.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:25.680 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-05-11T01:01:25.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:25.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-05-11T01:01:25.804 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2024-05-11T01:01:25.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:01:25.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:25.806 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-11T01:01:25.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:25.826 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-11T01:01:25.898 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-05-11T01:01:25.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:01:25.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:25.900 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-11T01:01:25.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:25.959 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-11T01:01:26.028 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-05-11T01:01:26.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:01:26.030 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-11T01:01:26.030 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-11T01:01:26.030 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:26.030 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-11T01:01:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.135+0000 7f14fe99e640 1 Processor -- start 2024-05-11T01:01:26.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.135+0000 7f14fe99e640 1 -- start start 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fe99e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14f80cea90 0x7f14f80cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fe99e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f14f8070890 0x7f14f8070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fe99e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f80d0f30 con 0x7f14f806c3e0 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fe99e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f14f80d1210 con 0x7f14f8070890 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fe99e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f14f80d14f0 con 0x7f14f80cea90 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fcf3b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f14f8070890 0x7f14f8070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14f7fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f14f806c3e0 0x7f14f806c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42932/0 (socket says 172.21.15.16:42932) 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14f7fff640 1 -- 172.21.15.16:0/313842394 learned_addr learned my addr 172.21.15.16:0/313842394 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14effff640 1 --2- 172.21.15.16:0/313842394 >> v2:172.21.15.174:3300/0 conn(0x7f14f80cea90 0x7f14f80cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fcf3b640 1 -- 172.21.15.16:0/313842394 >> v2:172.21.15.174:3300/0 conn(0x7f14f80cea90 msgr2=0x7f14f80cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fcf3b640 1 --2- 172.21.15.16:0/313842394 >> v2:172.21.15.174:3300/0 conn(0x7f14f80cea90 0x7f14f80cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fcf3b640 1 -- 172.21.15.16:0/313842394 >> v1:172.21.15.16:6789/0 conn(0x7f14f806c3e0 legacy=0x7f14f806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14fcf3b640 1 -- 172.21.15.16:0/313842394 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f80d17d0 con 0x7f14f8070890 2024-05-11T01:01:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14f77fe640 1 -- 172.21.15.16:0/313842394 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934000700 0 0) 0x7f14f80d0f30 con 0x7f14f806c3e0 2024-05-11T01:01:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.136+0000 7f14effff640 1 --2- 172.21.15.16:0/313842394 >> v2:172.21.15.174:3300/0 conn(0x7f14f80cea90 0x7f14f80cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.137+0000 7f14fcf3b640 1 --2- 172.21.15.16:0/313842394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f8070890 0x7f14f8070d20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f14f806f050 tx=0x7f14f002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb6579caf8d18ba server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.137+0000 7f14f77fe640 1 -- 172.21.15.16:0/313842394 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0007740 con 0x7f14f8070890 2024-05-11T01:01:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.137+0000 7f14f77fe640 1 -- 172.21.15.16:0/313842394 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f00078e0 con 0x7f14f8070890 2024-05-11T01:01:26.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.137+0000 7f14f77fe640 1 -- 172.21.15.16:0/313842394 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0007cb0 con 0x7f14f8070890 2024-05-11T01:01:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.138+0000 7f14fe99e640 1 -- 172.21.15.16:0/313842394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f8070890 msgr2=0x7f14f8070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.138+0000 7f14fe99e640 1 --2- 172.21.15.16:0/313842394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f8070890 0x7f14f8070d20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f14f806f050 tx=0x7f14f002a680 comp rx=0 tx=0).stop 2024-05-11T01:01:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.138+0000 7f14fe99e640 1 -- 172.21.15.16:0/313842394 shutdown_connections 2024-05-11T01:01:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.138+0000 7f14fe99e640 1 --2- 172.21.15.16:0/313842394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f8070890 0x7f14f8070d20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.138+0000 7f14fe99e640 1 --2- 172.21.15.16:0/313842394 >> v2:172.21.15.174:3300/0 conn(0x7f14f80cea90 0x7f14f80cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.138+0000 7f14fe99e640 1 -- 172.21.15.16:0/313842394 >> 172.21.15.16:0/313842394 conn(0x7f14f80d2060 msgr2=0x7f14f80d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.138+0000 7f14fe99e640 1 -- 172.21.15.16:0/313842394 shutdown_connections 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.138+0000 7f14fe99e640 1 -- 172.21.15.16:0/313842394 wait complete. 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.139+0000 7f14fe99e640 1 Processor -- start 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.139+0000 7f14fe99e640 1 -- start start 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fe99e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14f806c3e0 0x7f14f80b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fe99e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14f8070890 0x7f14f80cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fe99e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f80cea90 0x7f14f80736d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fe99e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80cf450 con 0x7f14f80cea90 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fe99e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80d0b50 con 0x7f14f806c3e0 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fe99e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f14f80b67a0 con 0x7f14f8070890 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f80cea90 0x7f14f80736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f80cea90 0x7f14f80736d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46792/0 (socket says 172.21.15.16:46792) 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 -- 172.21.15.16:0/3084608295 learned_addr learned my addr 172.21.15.16:0/3084608295 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:26.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14f7fff640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14f806c3e0 0x7f14f80b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 -- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14f8070890 msgr2=0x7f14f80cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14effff640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14f8070890 0x7f14f80cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14f8070890 0x7f14f80cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 -- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14f806c3e0 msgr2=0x7f14f80b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14f806c3e0 0x7f14f80b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 -- 172.21.15.16:0/3084608295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f80b6a80 con 0x7f14f80cea90 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14f7fff640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14f806c3e0 0x7f14f80b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14effff640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14f8070890 0x7f14f80cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fcf3b640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f80cea90 0x7f14f80736d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009e80 tx=0x7f14f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14f57fa640 1 -- 172.21.15.16:0/3084608295 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0040070 con 0x7f14f80cea90 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14f57fa640 1 -- 172.21.15.16:0/3084608295 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f0031c40 con 0x7f14f80cea90 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f80b6d60 con 0x7f14f80cea90 2024-05-11T01:01:26.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14f57fa640 1 -- 172.21.15.16:0/3084608295 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0003b90 con 0x7f14f80cea90 2024-05-11T01:01:26.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.140+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f80ccc50 con 0x7f14f80cea90 2024-05-11T01:01:26.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.141+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f80d0df0 con 0x7f14f80cea90 2024-05-11T01:01:26.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.142+0000 7f14f57fa640 1 -- 172.21.15.16:0/3084608295 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f14f0039040 con 0x7f14f80cea90 2024-05-11T01:01:26.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.142+0000 7f14f57fa640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f14d8076300 0x7f14d80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:26.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.142+0000 7f14f57fa640 1 -- 172.21.15.16:0/3084608295 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f14f00b8960 con 0x7f14f80cea90 2024-05-11T01:01:26.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.143+0000 7f14f7fff640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f14d8076300 0x7f14d80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:26.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.143+0000 7f14f7fff640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f14d8076300 0x7f14d80787c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000f60 tx=0x7f14e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:26.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.147+0000 7f14f57fa640 1 -- 172.21.15.16:0/3084608295 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f14f80d0df0 con 0x7f14f80cea90 2024-05-11T01:01:26.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.375+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f14f813dfe0 con 0x7f14f80cea90 2024-05-11T01:01:26.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.376+0000 7f14f57fa640 1 -- 172.21.15.16:0/3084608295 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f14f0082220 con 0x7f14f80cea90 2024-05-11T01:01:26.376 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-11T01:01:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f14d8076300 msgr2=0x7f14d80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f14d8076300 0x7f14d80787c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000f60 tx=0x7f14e8009040 comp rx=0 tx=0).stop 2024-05-11T01:01:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f80cea90 msgr2=0x7f14f80736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f80cea90 0x7f14f80736d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009e80 tx=0x7f14f0004a40 comp rx=0 tx=0).stop 2024-05-11T01:01:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 shutdown_connections 2024-05-11T01:01:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f14d8076300 0x7f14d80787c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f80cea90 0x7f14f80736d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f14f8070890 0x7f14f80cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 --2- 172.21.15.16:0/3084608295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14f806c3e0 0x7f14f80b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 >> 172.21.15.16:0/3084608295 conn(0x7f14f80d2060 msgr2=0x7f14f8145110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 shutdown_connections 2024-05-11T01:01:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26.378+0000 7f14fe99e640 1 -- 172.21.15.16:0/3084608295 wait complete. 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-11T01:01:26.389 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-11T01:01:26.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:26.389 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-05-11T01:01:26.406 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:26.406 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:26.406 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-11T01:01:26.407 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42763sec preferred_lft 42763sec 2024-05-11T01:01:26.408 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link noprefixroute 2024-05-11T01:01:26.408 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:26.408 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:26.408 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:26.408 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-05-11T01:01:26.408 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-11T01:01:26.409 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:26.409 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:26.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-05-11T01:01:26.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-05-11T01:01:26.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-05-11T01:01:26.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-11T01:01:26.409 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:26.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:26.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:26.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:26.595 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-11T01:01:26.621 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-05-11T01:01:26.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:26.623 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-05-11T01:01:26.690 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-05-11T01:01:26.690 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-11T01:01:26.690 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-11T01:01:26.690 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-11T01:01:26.690 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-11T01:01:26.691 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:26.691 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:26.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-11T01:01:26.692 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-11T01:01:26.692 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-11T01:01:26.692 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:26.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:26.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:26.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:26.979 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-05-11T01:01:26.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:26.997 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-05-11T01:01:27.053 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:27.054 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:27.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-11T01:01:27.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-11T01:01:27.054 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:27.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:27.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:27.174 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-11T01:01:27.174 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:27.174 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:27.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-11T01:01:27.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-11T01:01:27.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-11T01:01:27.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-11T01:01:27.175 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-11T01:01:27.175 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:27.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:27.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:27.305 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:27.305 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:27.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-05-11T01:01:27.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-05-11T01:01:27.305 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:27.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:27.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:27.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:27.386 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:27.402 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-11T01:01:27.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:27.402 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:27.458 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-11T01:01:27.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:27.459 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:27.554 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:27.554 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:27.663 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:27.663 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:27.663 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-11T01:01:27.663 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with new device syntax: 0@3d939707-6559-4ce1-a2ce-e98842b2ed86.cephfs=/ 2024-05-11T01:01:27.663 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.16:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-11T01:01:27.664 INFO:teuthology.orchestra.run.smithi016.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-11T01:01:27.664 INFO:teuthology.orchestra.run.smithi016.stdout: You just mounted a file system that supports labels which does not 2024-05-11T01:01:27.664 INFO:teuthology.orchestra.run.smithi016.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-11T01:01:27.664 INFO:teuthology.orchestra.run.smithi016.stdout: applications will generate AVC messages and not be allowed access to 2024-05-11T01:01:27.664 INFO:teuthology.orchestra.run.smithi016.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-11T01:01:27.666 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-11T01:01:27.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:27.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:27.692 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:27.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:27.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:27.795 INFO:teuthology.orchestra.run.smithi016.stdout:client4579 2024-05-11T01:01:27.795 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:27.796 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:27.812 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:27.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:27.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:27.915 INFO:teuthology.orchestra.run.smithi016.stdout:client4579 2024-05-11T01:01:27.915 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:27.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:27.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:27.978 INFO:teuthology.orchestra.run.smithi016.stdout:client4579 2024-05-11T01:01:27.979 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3d939707-6559-4ce1-a2ce-e98842b2ed86.client4579/status') 2024-05-11T01:01:28.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:28.042 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4579 (3)172.21.15.16:0/854094083 2024-05-11T01:01:28.043 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2024-05-11T01:01:28.043 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2024-05-11T01:01:28.043 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2024-05-11T01:01:28.043 INFO:teuthology.orchestra.run.smithi016.stderr:69 bytes copied, 2.4962e-05 s, 2.8 MB/s 2024-05-11T01:01:28.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:28.050 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-11T01:01:28.050 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-11T01:01:28.050 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-11T01:01:28.050 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-11T01:01:28.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.154+0000 7f420eb4d640 1 Processor -- start 2024-05-11T01:01:28.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.155+0000 7f420eb4d640 1 -- start start 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.155+0000 7f420eb4d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4208162d30 0x7f42080baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.155+0000 7f420eb4d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208163210 0x7f42080b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.155+0000 7f420eb4d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f42080b7360 0x7f420806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.155+0000 7f420eb4d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f42080d3700 con 0x7f4208162d30 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.155+0000 7f420eb4d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f42081639f0 con 0x7f42080b7360 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.155+0000 7f420eb4d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4208163cd0 con 0x7f4208163210 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420c8e9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4208162d30 0x7f42080baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420c8e9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4208162d30 0x7f42080baf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46794/0 (socket says 172.21.15.16:46794) 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420c8e9640 1 -- 172.21.15.16:0/3022724805 learned_addr learned my addr 172.21.15.16:0/3022724805 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420d0ea640 1 --2- 172.21.15.16:0/3022724805 >> v2:172.21.15.174:3300/0 conn(0x7f42080b7360 0x7f420806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:28.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f4207fff640 1 --2- 172.21.15.16:0/3022724805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208163210 0x7f42080b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420c8e9640 1 -- 172.21.15.16:0/3022724805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208163210 msgr2=0x7f42080b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420c8e9640 1 --2- 172.21.15.16:0/3022724805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208163210 0x7f42080b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420c8e9640 1 -- 172.21.15.16:0/3022724805 >> v2:172.21.15.174:3300/0 conn(0x7f42080b7360 msgr2=0x7f420806d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420c8e9640 1 --2- 172.21.15.16:0/3022724805 >> v2:172.21.15.174:3300/0 conn(0x7f42080b7360 0x7f420806d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420c8e9640 1 -- 172.21.15.16:0/3022724805 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4208163fb0 con 0x7f4208162d30 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f420d0ea640 1 --2- 172.21.15.16:0/3022724805 >> v2:172.21.15.174:3300/0 conn(0x7f42080b7360 0x7f420806d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.156+0000 7f4207fff640 1 --2- 172.21.15.16:0/3022724805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208163210 0x7f42080b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420c8e9640 1 --2- 172.21.15.16:0/3022724805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4208162d30 0x7f42080baf60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f420806ed30 tx=0x7f420002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b598781e038cda22 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f42077fe640 1 -- 172.21.15.16:0/3022724805 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200037070 con 0x7f4208162d30 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f42077fe640 1 -- 172.21.15.16:0/3022724805 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420002ae00 con 0x7f4208162d30 2024-05-11T01:01:28.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f42077fe640 1 -- 172.21.15.16:0/3022724805 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200032660 con 0x7f4208162d30 2024-05-11T01:01:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 -- 172.21.15.16:0/3022724805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4208162d30 msgr2=0x7f42080baf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3022724805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4208162d30 0x7f42080baf60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f420806ed30 tx=0x7f420002a0b0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 -- 172.21.15.16:0/3022724805 shutdown_connections 2024-05-11T01:01:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3022724805 >> v2:172.21.15.174:3300/0 conn(0x7f42080b7360 0x7f420806d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3022724805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208163210 0x7f42080b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3022724805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4208162d30 0x7f42080baf60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 -- 172.21.15.16:0/3022724805 >> 172.21.15.16:0/3022724805 conn(0x7f42080d1e20 msgr2=0x7f42080d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 -- 172.21.15.16:0/3022724805 shutdown_connections 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.157+0000 7f420eb4d640 1 -- 172.21.15.16:0/3022724805 wait complete. 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.159+0000 7f420eb4d640 1 Processor -- start 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.159+0000 7f420eb4d640 1 -- start start 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.159+0000 7f420eb4d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42080b7360 0x7f42080d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420eb4d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208162d30 0x7f42081533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420eb4d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4208163210 0x7f42080cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420eb4d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f420806d800 con 0x7f42080b7360 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420eb4d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4208163670 con 0x7f4208163210 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420eb4d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f420806d980 con 0x7f4208162d30 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42080b7360 0x7f42080d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42080b7360 0x7f42080d5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46802/0 (socket says 172.21.15.16:46802) 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 -- 172.21.15.16:0/3983290447 learned_addr learned my addr 172.21.15.16:0/3983290447 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:28.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 -- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208162d30 msgr2=0x7f42081533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f4207fff640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208162d30 0x7f42081533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420d0ea640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4208163210 0x7f42080cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208162d30 0x7f42081533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 -- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4208163210 msgr2=0x7f42080cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4208163210 0x7f42080cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 -- 172.21.15.16:0/3983290447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42081e9980 con 0x7f42080b7360 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420c8e9640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42080b7360 0x7f42080d5d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4200000c00 tx=0x7f42000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f42057fa640 1 -- 172.21.15.16:0/3983290447 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200042070 con 0x7f42080b7360 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f42057fa640 1 -- 172.21.15.16:0/3983290447 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f420003e670 con 0x7f42080b7360 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42081e9c60 con 0x7f42080b7360 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f42057fa640 1 -- 172.21.15.16:0/3983290447 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200037040 con 0x7f42080b7360 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.160+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42081f8e50 con 0x7f42080b7360 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.161+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4208069510 con 0x7f42080b7360 2024-05-11T01:01:28.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.162+0000 7f42057fa640 1 -- 172.21.15.16:0/3983290447 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f420003a040 con 0x7f42080b7360 2024-05-11T01:01:28.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.162+0000 7f42057fa640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41e80762d0 0x7f41e8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:28.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.163+0000 7f42057fa640 1 -- 172.21.15.16:0/3983290447 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f42000b75a0 con 0x7f42080b7360 2024-05-11T01:01:28.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.163+0000 7f4207fff640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41e80762d0 0x7f41e8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:28.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.163+0000 7f4207fff640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41e80762d0 0x7f41e8078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f42080cf5c0 tx=0x7f41f800b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:28.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.167+0000 7f42057fa640 1 -- 172.21.15.16:0/3983290447 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4208069510 con 0x7f42080b7360 2024-05-11T01:01:28.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.398+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f420806a5b0 con 0x7f42080b7360 2024-05-11T01:01:28.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.399+0000 7f42057fa640 1 -- 172.21.15.16:0/3983290447 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f4200080f90 con 0x7f42080b7360 2024-05-11T01:01:28.403 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-11T01:01:28.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41e80762d0 msgr2=0x7f41e8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:28.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41e80762d0 0x7f41e8078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f42080cf5c0 tx=0x7f41f800b040 comp rx=0 tx=0).stop 2024-05-11T01:01:28.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42080b7360 msgr2=0x7f42080d5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:28.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42080b7360 0x7f42080d5d30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4200000c00 tx=0x7f42000046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 shutdown_connections 2024-05-11T01:01:28.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41e80762d0 0x7f41e8078790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4208163210 0x7f42080cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4208162d30 0x7f42081533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 --2- 172.21.15.16:0/3983290447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42080b7360 0x7f42080d5d30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:28.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 >> 172.21.15.16:0/3983290447 conn(0x7f42080d1e20 msgr2=0x7f42080cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:28.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 shutdown_connections 2024-05-11T01:01:28.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28.401+0000 7f420eb4d640 1 -- 172.21.15.16:0/3983290447 wait complete. 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-11T01:01:28.412 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-11T01:01:28.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:28.413 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-05-11T01:01:28.429 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:28.429 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:28.430 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42761sec preferred_lft 42761sec 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link noprefixroute 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 8e:ce:99:4a:60:d1 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::245b:6cff:fe33:c9f/64 scope link 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-11T01:01:28.431 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 8e:ce:99:4a:60:d1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-11T01:01:28.432 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::8cce:99ff:fe4a:60d1/64 scope link tentative 2024-05-11T01:01:28.432 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:28.432 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-11T01:01:28.494 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-05-11T01:01:28.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:28.496 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-05-11T01:01:28.553 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-05-11T01:01:28.553 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-11T01:01:28.553 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-11T01:01:28.553 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-11T01:01:28.553 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-11T01:01:28.554 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:28.554 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:28.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-11T01:01:28.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-11T01:01:28.554 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-11T01:01:28.554 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:28.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:28.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:28.684 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-05-11T01:01:28.700 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-11T01:01:28.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:28.701 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-05-11T01:01:28.757 INFO:teuthology.orchestra.run.smithi016.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-11T01:01:28.758 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:28.758 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:28.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-11T01:01:28.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-11T01:01:28.758 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:28.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:28.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:28.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:28.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-11T01:01:28.906 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:28.906 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:28.906 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:28.906 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.906 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:28.906 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.906 INFO:teuthology.orchestra.run.smithi016.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-11T01:01:28.907 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether c2:61:21:8f:bd:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-11T01:01:28.907 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-11T01:01:28.907 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.907 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::c061:21ff:fe8f:bd89/64 scope link 2024-05-11T01:01:28.907 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:28.909 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-11T01:01:28.975 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:28.975 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:28.975 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:28.975 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.975 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:28.975 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.975 INFO:teuthology.orchestra.run.smithi016.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-11T01:01:28.976 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether c2:61:21:8f:bd:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-11T01:01:28.976 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-11T01:01:28.976 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.976 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::c061:21ff:fe8f:bd89/64 scope link 2024-05-11T01:01:28.976 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:28.977 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-11T01:01:28.977 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:28.977 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:28.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-11T01:01:28.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-11T01:01:28.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-11T01:01:28.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-11T01:01:28.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-11T01:01:28.978 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:29.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:29.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:29.135 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:29.135 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:29.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.1 up 2024-05-11T01:01:29.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.1 master ceph-brx 2024-05-11T01:01:29.135 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:29.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:29.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:29.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:29.215 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-11T01:01:29.231 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-11T01:01:29.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:29.231 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-11T01:01:29.287 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-11T01:01:29.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:29.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:29.373 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:29.373 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:29.386 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:29.386 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:29.386 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-11T01:01:29.386 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with new device syntax: 2@3d939707-6559-4ce1-a2ce-e98842b2ed86.cephfs=/ 2024-05-11T01:01:29.386 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.16:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-11T01:01:29.389 INFO:teuthology.orchestra.run.smithi016.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-11T01:01:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: You just mounted a file system that supports labels which does not 2024-05-11T01:01:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-11T01:01:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: applications will generate AVC messages and not be allowed access to 2024-05-11T01:01:29.389 INFO:teuthology.orchestra.run.smithi016.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-11T01:01:29.389 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-11T01:01:29.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:29.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-11T01:01:29.415 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:29.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:29.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:29.513 INFO:teuthology.orchestra.run.smithi016.stdout:client4623 2024-05-11T01:01:29.514 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:29.514 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:29.531 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:29.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:29.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:29.628 INFO:teuthology.orchestra.run.smithi016.stdout:client4623 2024-05-11T01:01:29.629 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:29.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:29.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:29.686 INFO:teuthology.orchestra.run.smithi016.stdout:client4623 2024-05-11T01:01:29.687 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3d939707-6559-4ce1-a2ce-e98842b2ed86.client4623/status') 2024-05-11T01:01:29.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:29.747 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4623 (3)192.168.0.2:0/3362816155 2024-05-11T01:01:29.747 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2024-05-11T01:01:29.747 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2024-05-11T01:01:29.747 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2024-05-11T01:01:29.747 INFO:teuthology.orchestra.run.smithi016.stderr:69 bytes copied, 2.6788e-05 s, 2.6 MB/s 2024-05-11T01:01:29.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:29.755 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-11T01:01:29.755 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-11T01:01:29.755 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-11T01:01:29.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-11T01:01:29.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.859+0000 7f7eb1859640 1 Processor -- start 2024-05-11T01:01:29.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.859+0000 7f7eb1859640 1 -- start start 2024-05-11T01:01:29.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7eb1859640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7eac157a50 0x7f7eac0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:29.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7eb1859640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eac0d2120 con 0x7f7eac0cdf00 2024-05-11T01:01:29.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7eb1859640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eac0d1080 con 0x7f7eac0b5400 2024-05-11T01:01:29.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7eb1859640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7eac0d1360 con 0x7f7eac157a50 2024-05-11T01:01:29.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7eaa7fc640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7eac0cdf00 0x7f7eac0b4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42946/0 (socket says 172.21.15.16:42946) 2024-05-11T01:01:29.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7eaa7fc640 1 -- 172.21.15.16:0/1108489784 learned_addr learned my addr 172.21.15.16:0/1108489784 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:29.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7eaaffd640 1 --2- 172.21.15.16:0/1108489784 >> v2:172.21.15.174:3300/0 conn(0x7f7eac157a50 0x7f7eac0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:29.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 115988256 0 0) 0x7f7ea0001110 con 0x7f7eac0cdf00 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e94003520 con 0x7f7eac0cdf00 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3662914697 0 0) 0x7f7e94003520 con 0x7f7eac0cdf00 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 >> v2:172.21.15.174:3300/0 conn(0x7f7eac157a50 msgr2=0x7f7eac0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7ea9ffb640 1 --2- 172.21.15.16:0/1108489784 >> v2:172.21.15.174:3300/0 conn(0x7f7eac157a50 0x7f7eac0cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.860+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 >> v1:172.21.15.174:6789/0 conn(0x7f7eac0b5400 legacy=0x7f7eac0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac0d1640 con 0x7f7eac0cdf00 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f7ea00018c0 con 0x7f7eac0cdf00 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 >> v1:172.21.15.16:6789/0 conn(0x7f7eac0cdf00 legacy=0x7f7eac0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e94003a50 0x7f7e94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e94004800 0x7f7e94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940053c0 0x7f7e9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac0d1360 con 0x7f7e940053c0 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9400c230 con 0x7f7e94003a50 2024-05-11T01:01:29.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7e9400c430 con 0x7f7e94004800 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7eab7fe640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940053c0 0x7f7e9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7eaaffd640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e94003a50 0x7f7e94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7eaa7fc640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e94004800 0x7f7e94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7eab7fe640 1 -- 172.21.15.16:0/1108489784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e94004800 msgr2=0x7f7e94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7eab7fe640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e94004800 0x7f7e94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7eab7fe640 1 -- 172.21.15.16:0/1108489784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e94003a50 msgr2=0x7f7e94003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7eab7fe640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7e94003a50 0x7f7e94003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.861+0000 7f7eab7fe640 1 -- 172.21.15.16:0/1108489784 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e94003520 con 0x7f7e940053c0 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.862+0000 7f7eab7fe640 1 -- 172.21.15.16:0/1108489784 reap_dead start 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.862+0000 7f7eab7fe640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940053c0 0x7f7e9400b9c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4001e60 tx=0x7f7e94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c89016e1b6bbe1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.862+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4001ab0 con 0x7f7e940053c0 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.862+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea402ae40 con 0x7f7e940053c0 2024-05-11T01:01:29.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.862+0000 7f7ea9ffb640 1 -- 172.21.15.16:0/1108489784 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4003bb0 con 0x7f7e940053c0 2024-05-11T01:01:29.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.862+0000 7f7eb1859640 1 -- 172.21.15.16:0/1108489784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940053c0 msgr2=0x7f7e9400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.862+0000 7f7eb1859640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940053c0 0x7f7e9400b9c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4001e60 tx=0x7f7e94005830 comp rx=0 tx=0).stop 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.863+0000 7f7eb1859640 1 -- 172.21.15.16:0/1108489784 shutdown_connections 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.863+0000 7f7eb1859640 1 --2- 172.21.15.16:0/1108489784 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940053c0 0x7f7e9400b9c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.863+0000 7f7eb1859640 1 -- 172.21.15.16:0/1108489784 >> 172.21.15.16:0/1108489784 conn(0x7f7eac0681c0 msgr2=0x7f7eac0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.863+0000 7f7eb1859640 1 -- 172.21.15.16:0/1108489784 shutdown_connections 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.863+0000 7f7eb1859640 1 -- 172.21.15.16:0/1108489784 wait complete. 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.864+0000 7f7eb1859640 1 Processor -- start 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.864+0000 7f7eb1859640 1 -- start start 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eb1859640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e940053c0 0x7f7eac158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eb1859640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7eac0b6d70 0x7f7eac1f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eb1859640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7eac1f70f0 0x7f7eac1f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eb1859640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac157e30 con 0x7f7eac1f70f0 2024-05-11T01:01:29.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eb1859640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac0d1c00 con 0x7f7eac0b6d70 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eb1859640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac0cf9b0 con 0x7f7e940053c0 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7eac1f70f0 0x7f7eac1f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7eac1f70f0 0x7f7eac1f75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46820/0 (socket says 172.21.15.16:46820) 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 -- 172.21.15.16:0/1789218028 learned_addr learned my addr 172.21.15.16:0/1789218028 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eaa7fc640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7eac0b6d70 0x7f7eac1f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eaaffd640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e940053c0 0x7f7eac158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 -- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e940053c0 msgr2=0x7f7eac158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e940053c0 0x7f7eac158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 -- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7eac0b6d70 msgr2=0x7f7eac1f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7eac0b6d70 0x7f7eac1f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 -- 172.21.15.16:0/1789218028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac0b7570 con 0x7f7eac1f70f0 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eab7fe640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7eac1f70f0 0x7f7eac1f75a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ea402a8f0 tx=0x7f7ea40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7e93fff640 1 -- 172.21.15.16:0/1789218028 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4007df0 con 0x7f7eac1f70f0 2024-05-11T01:01:29.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7e93fff640 1 -- 172.21.15.16:0/1789218028 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea402ac40 con 0x7f7eac1f70f0 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7e93fff640 1 -- 172.21.15.16:0/1789218028 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4001ab0 con 0x7f7eac1f70f0 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.865+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eac0b7850 con 0x7f7eac1f70f0 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.866+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eac1f4df0 con 0x7f7eac1f70f0 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.866+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eac1f4ff0 con 0x7f7eac1f70f0 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.867+0000 7f7e93fff640 1 -- 172.21.15.16:0/1789218028 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7ea40054e0 con 0x7f7eac1f70f0 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.868+0000 7f7e93fff640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e980762d0 0x7f7e98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.868+0000 7f7e93fff640 1 -- 172.21.15.16:0/1789218028 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ea40b6560 con 0x7f7eac1f70f0 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.868+0000 7f7eaaffd640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e980762d0 0x7f7e98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:29.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.869+0000 7f7eaaffd640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e980762d0 0x7f7e98078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009a80 tx=0x7f7e9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:29.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:29.872+0000 7f7e93fff640 1 -- 172.21.15.16:0/1789218028 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7eac1f4ff0 con 0x7f7eac1f70f0 2024-05-11T01:01:30.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.107+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7eac06a5b0 con 0x7f7eac1f70f0 2024-05-11T01:01:30.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.108+0000 7f7e93fff640 1 -- 172.21.15.16:0/1789218028 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f7ea407feb0 con 0x7f7eac1f70f0 2024-05-11T01:01:30.108 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-11T01:01:30.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e980762d0 msgr2=0x7f7e98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e980762d0 0x7f7e98078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009a80 tx=0x7f7e9c008040 comp rx=0 tx=0).stop 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7eac1f70f0 msgr2=0x7f7eac1f75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7eac1f70f0 0x7f7eac1f75a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7ea402a8f0 tx=0x7f7ea40014a0 comp rx=0 tx=0).stop 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 shutdown_connections 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f7e980762d0 0x7f7e98078790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7eac1f70f0 0x7f7eac1f75a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7eac0b6d70 0x7f7eac1f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 --2- 172.21.15.16:0/1789218028 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7e940053c0 0x7f7eac158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 >> 172.21.15.16:0/1789218028 conn(0x7f7eac0681c0 msgr2=0x7f7eac0b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:30.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 shutdown_connections 2024-05-11T01:01:30.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:30.110+0000 7f7eb1859640 1 -- 172.21.15.16:0/1789218028 wait complete. 2024-05-11T01:01:30.121 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-11T01:01:30.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-11T01:01:30.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-05-11T01:01:30.121 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-11T01:01:30.121 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-11T01:01:30.122 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-11T01:01:30.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-11T01:01:30.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-11T01:01:30.122 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-11T01:01:30.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:30.122 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-05-11T01:01:30.141 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:30.142 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2024-05-11T01:01:30.143 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:30.143 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:30.143 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-11T01:01:30.143 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:30.143 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-11T01:01:30.143 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42685sec preferred_lft 42685sec 2024-05-11T01:01:30.143 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2024-05-11T01:01:30.143 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:30.143 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-11T01:01:30.143 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:30.144 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:30.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add name ceph-brx type bridge 2024-05-11T01:01:30.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr flush dev ceph-brx 2024-05-11T01:01:30.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set ceph-brx up 2024-05-11T01:01:30.144 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-11T01:01:30.144 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:30.239 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:30.341 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:30.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:30.349 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-11T01:01:30.374 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-05-11T01:01:30.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:30.376 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-05-11T01:01:30.441 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-05-11T01:01:30.441 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-11T01:01:30.441 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-11T01:01:30.442 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-11T01:01:30.442 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-11T01:01:30.446 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:30.446 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:30.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-11T01:01:30.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-11T01:01:30.446 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-11T01:01:30.446 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:30.529 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:30.733 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:30.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:30.739 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-11T01:01:30.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:30.755 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2024-05-11T01:01:30.810 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:30.810 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:30.810 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-11T01:01:30.810 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-11T01:01:30.810 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:30.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:30.923 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:30.929 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-11T01:01:30.929 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:30.929 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:30.929 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-11T01:01:30.929 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-11T01:01:30.929 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-11T01:01:30.929 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-11T01:01:30.929 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-11T01:01:30.930 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:30.978 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:31.074 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:31.080 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:31.080 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:31.080 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.0 up 2024-05-11T01:01:31.080 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.0 master ceph-brx 2024-05-11T01:01:31.080 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:31.129 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:31.151 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:31.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:31.158 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-11T01:01:31.173 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-11T01:01:31.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:31.173 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-11T01:01:31.228 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-11T01:01:31.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:31.228 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:31.362 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:31.363 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:31.466 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:31.466 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:31.466 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-11T01:01:31.466 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with new device syntax: 1@3d939707-6559-4ce1-a2ce-e98842b2ed86.cephfs=/ 2024-05-11T01:01:31.466 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.16:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-11T01:01:31.466 INFO:teuthology.orchestra.run.smithi174.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-11T01:01:31.467 INFO:teuthology.orchestra.run.smithi174.stdout: You just mounted a file system that supports labels which does not 2024-05-11T01:01:31.467 INFO:teuthology.orchestra.run.smithi174.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-11T01:01:31.467 INFO:teuthology.orchestra.run.smithi174.stdout: applications will generate AVC messages and not be allowed access to 2024-05-11T01:01:31.467 INFO:teuthology.orchestra.run.smithi174.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-11T01:01:31.468 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-11T01:01:31.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:31.468 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-11T01:01:31.493 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:31.582 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:31.584 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:31.590 INFO:teuthology.orchestra.run.smithi174.stdout:client4433 2024-05-11T01:01:31.590 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:01:31.590 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:31.606 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:31.694 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:31.696 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:31.702 INFO:teuthology.orchestra.run.smithi174.stdout:client4433 2024-05-11T01:01:31.702 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:31.751 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:31.754 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:31.759 INFO:teuthology.orchestra.run.smithi174.stdout:client4433 2024-05-11T01:01:31.759 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3d939707-6559-4ce1-a2ce-e98842b2ed86.client4433/status') 2024-05-11T01:01:31.808 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:31.818 INFO:teuthology.orchestra.run.smithi174.stdout:instance: client.4433 (3)192.168.0.1:0/2150947494 2024-05-11T01:01:31.818 INFO:teuthology.orchestra.run.smithi174.stdout:blocklisted: false 2024-05-11T01:01:31.818 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records in 2024-05-11T01:01:31.819 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records out 2024-05-11T01:01:31.819 INFO:teuthology.orchestra.run.smithi174.stderr:69 bytes copied, 2.192e-05 s, 3.1 MB/s 2024-05-11T01:01:31.819 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:31.825 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-11T01:01:31.825 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-11T01:01:31.825 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-11T01:01:31.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-11T01:01:31.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.943+0000 7f840c845640 1 Processor -- start 2024-05-11T01:01:31.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.944+0000 7f840c845640 1 -- start start 2024-05-11T01:01:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.944+0000 7f840c845640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84080cefe0 0x7f84080b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.944+0000 7f840c845640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f840806f0b0 0x7f84080cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.944+0000 7f840c845640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840806f4f0 con 0x7f84080cfdf0 2024-05-11T01:01:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.944+0000 7f840c845640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f84080d0cf0 con 0x7f84080cefe0 2024-05-11T01:01:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.944+0000 7f840c845640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8408071210 con 0x7f840806f0b0 2024-05-11T01:01:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.945+0000 7f840659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84080cefe0 0x7f84080b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:31.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.945+0000 7f840659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f84080cefe0 0x7f84080b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46822/0 (socket says 172.21.15.16:46822) 2024-05-11T01:01:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.945+0000 7f840659c640 1 -- 172.21.15.16:0/34160432 learned_addr learned my addr 172.21.15.16:0/34160432 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.945+0000 7f83fffff640 1 --2- 172.21.15.16:0/34160432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f840806f0b0 0x7f84080cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.945+0000 7f840659c640 1 -- 172.21.15.16:0/34160432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f840806f0b0 msgr2=0x7f84080cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.945+0000 7f840659c640 1 --2- 172.21.15.16:0/34160432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f840806f0b0 0x7f84080cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.945+0000 7f840659c640 1 -- 172.21.15.16:0/34160432 >> v1:172.21.15.174:6789/0 conn(0x7f84080cfdf0 legacy=0x7f840806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:31.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.945+0000 7f840659c640 1 -- 172.21.15.16:0/34160432 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080714f0 con 0x7f84080cefe0 2024-05-11T01:01:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f840659c640 1 --2- 172.21.15.16:0/34160432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84080cefe0 0x7f84080b55b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009870 tx=0x7f83f802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9776fc632b8e462c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f8405d9b640 1 -- 172.21.15.16:0/34160432 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8037070 con 0x7f84080cefe0 2024-05-11T01:01:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f8405d9b640 1 -- 172.21.15.16:0/34160432 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f8032440 con 0x7f84080cefe0 2024-05-11T01:01:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f8405d9b640 1 -- 172.21.15.16:0/34160432 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8032810 con 0x7f84080cefe0 2024-05-11T01:01:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f840c845640 1 -- 172.21.15.16:0/34160432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84080cefe0 msgr2=0x7f84080b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:31.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f840c845640 1 --2- 172.21.15.16:0/34160432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84080cefe0 0x7f84080b55b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009870 tx=0x7f83f802a1c0 comp rx=0 tx=0).stop 2024-05-11T01:01:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f840c845640 1 -- 172.21.15.16:0/34160432 shutdown_connections 2024-05-11T01:01:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f840c845640 1 --2- 172.21.15.16:0/34160432 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f840806f0b0 0x7f84080cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f840c845640 1 --2- 172.21.15.16:0/34160432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84080cefe0 0x7f84080b55b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f840c845640 1 -- 172.21.15.16:0/34160432 >> 172.21.15.16:0/34160432 conn(0x7f8408072b60 msgr2=0x7f84080681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.946+0000 7f840c845640 1 -- 172.21.15.16:0/34160432 shutdown_connections 2024-05-11T01:01:31.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.947+0000 7f840c845640 1 -- 172.21.15.16:0/34160432 wait complete. 2024-05-11T01:01:31.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.948+0000 7f840c845640 1 Processor -- start 2024-05-11T01:01:31.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.948+0000 7f840c845640 1 -- start start 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840c845640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f840806f0b0 0x7f840815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840c845640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84080cefe0 0x7f84080c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840c845640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84080cfdf0 0x7f84080c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840c845640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f84080cf3c0 con 0x7f840806f0b0 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840c845640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f84080d1220 con 0x7f84080cefe0 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840c845640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f840806dc00 con 0x7f84080cfdf0 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f840806f0b0 0x7f840815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f840806f0b0 0x7f840815a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46824/0 (socket says 172.21.15.16:46824) 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 -- 172.21.15.16:0/3541645092 learned_addr learned my addr 172.21.15.16:0/3541645092 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f8406d9d640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84080cfdf0 0x7f84080c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f83fffff640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84080cefe0 0x7f84080c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 -- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84080cfdf0 msgr2=0x7f84080c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84080cfdf0 0x7f84080c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:31.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 -- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84080cefe0 msgr2=0x7f84080c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84080cefe0 0x7f84080c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 -- 172.21.15.16:0/3541645092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84080c7610 con 0x7f840806f0b0 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f840659c640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f840806f0b0 0x7f840815a6a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000c00 tx=0x7f83f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.949+0000 7f83feffd640 1 -- 172.21.15.16:0/3541645092 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8037040 con 0x7f840806f0b0 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.950+0000 7f83feffd640 1 -- 172.21.15.16:0/3541645092 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f8042070 con 0x7f840806f0b0 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.950+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84080c78f0 con 0x7f840806f0b0 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.950+0000 7f83feffd640 1 -- 172.21.15.16:0/3541645092 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8030860 con 0x7f840806f0b0 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.950+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84080c8190 con 0x7f840806f0b0 2024-05-11T01:01:31.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.951+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f840806a5b0 con 0x7f840806f0b0 2024-05-11T01:01:31.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.951+0000 7f83feffd640 1 -- 172.21.15.16:0/3541645092 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f83f802ad10 con 0x7f840806f0b0 2024-05-11T01:01:31.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.952+0000 7f83feffd640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f83e8076300 0x7f83e80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:31.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.952+0000 7f83feffd640 1 -- 172.21.15.16:0/3541645092 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f83f80b7aa0 con 0x7f840806f0b0 2024-05-11T01:01:31.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.952+0000 7f83fffff640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f83e8076300 0x7f83e80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:31.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.952+0000 7f83fffff640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f83e8076300 0x7f83e80787c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f840806d7d0 tx=0x7f83f0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:31.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:31.956+0000 7f83feffd640 1 -- 172.21.15.16:0/3541645092 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f83f8080d20 con 0x7f840806f0b0 2024-05-11T01:01:32.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.187+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8408070f50 con 0x7f840806f0b0 2024-05-11T01:01:32.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.187+0000 7f83feffd640 1 -- 172.21.15.16:0/3541645092 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f83f8085020 con 0x7f840806f0b0 2024-05-11T01:01:32.187 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-11T01:01:32.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f83e8076300 msgr2=0x7f83e80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f83e8076300 0x7f83e80787c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f840806d7d0 tx=0x7f83f0009190 comp rx=0 tx=0).stop 2024-05-11T01:01:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f840806f0b0 msgr2=0x7f840815a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f840806f0b0 0x7f840815a6a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000c00 tx=0x7f83f80046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 shutdown_connections 2024-05-11T01:01:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f83e8076300 0x7f83e80787c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f84080cfdf0 0x7f84080c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84080cefe0 0x7f84080c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:32.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 --2- 172.21.15.16:0/3541645092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f840806f0b0 0x7f840815a6a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:32.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 >> 172.21.15.16:0/3541645092 conn(0x7f8408072b60 msgr2=0x7f84080b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:32.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 shutdown_connections 2024-05-11T01:01:32.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:32.189+0000 7f840c845640 1 -- 172.21.15.16:0/3541645092 wait complete. 2024-05-11T01:01:32.201 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-11T01:01:32.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-11T01:01:32.201 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi174.front.sepia.ceph.com 2024-05-11T01:01:32.201 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-11T01:01:32.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-11T01:01:32.201 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-11T01:01:32.202 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-11T01:01:32.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-11T01:01:32.202 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-11T01:01:32.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:32.202 DEBUG:teuthology.orchestra.run.smithi174:> ip addr 2024-05-11T01:01:32.219 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:32.219 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:32.219 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:32.219 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.219 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:32.219 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.219 INFO:teuthology.orchestra.run.smithi174.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e0 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f0 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:d9:36:e1 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: altname enp7s0f1 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1a brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 0c:c4:7a:88:77:1b brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: inet 172.21.15.174/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft 42683sec preferred_lft 42683sec 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::ec4:7aff:fe88:771b/64 scope link 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.220 INFO:teuthology.orchestra.run.smithi174.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 86:94:f1:7f:84:d3 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::c418:83ff:fede:46f/64 scope link 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether 86:94:f1:7f:84:d3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::8494:f1ff:fe7f:84d3/64 scope link tentative 2024-05-11T01:01:32.221 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:32.222 DEBUG:teuthology.orchestra.run.smithi174:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-11T01:01:32.283 INFO:teuthology.orchestra.run.smithi174.stdout:1 2024-05-11T01:01:32.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:32.285 DEBUG:teuthology.orchestra.run.smithi174:> route 2024-05-11T01:01:32.341 INFO:teuthology.orchestra.run.smithi174.stdout:Kernel IP routing table 2024-05-11T01:01:32.342 INFO:teuthology.orchestra.run.smithi174.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-11T01:01:32.342 INFO:teuthology.orchestra.run.smithi174.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-11T01:01:32.342 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-11T01:01:32.342 INFO:teuthology.orchestra.run.smithi174.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-11T01:01:32.342 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:32.342 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:32.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-11T01:01:32.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-11T01:01:32.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-11T01:01:32.343 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:32.430 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:32.463 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:32.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:32.469 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-11T01:01:32.485 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-11T01:01:32.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:32.485 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list-id 2024-05-11T01:01:32.541 INFO:teuthology.orchestra.run.smithi174.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-11T01:01:32.541 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:32.541 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:32.541 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-11T01:01:32.541 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-11T01:01:32.541 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:32.630 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:32.653 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:32.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:32.659 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-11T01:01:32.683 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether a6:94:06:ba:ad:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::a494:6ff:feba:ad6c/64 scope link tentative 2024-05-11T01:01:32.684 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:32.685 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-11T01:01:32.750 INFO:teuthology.orchestra.run.smithi174.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: link/ether a6:94:06:ba:ad:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: inet6 fe80::a494:6ff:feba:ad6c/64 scope link tentative 2024-05-11T01:01:32.751 INFO:teuthology.orchestra.run.smithi174.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:32.752 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-11T01:01:32.752 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:32.753 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:32.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-11T01:01:32.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-11T01:01:32.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-11T01:01:32.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-11T01:01:32.753 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-11T01:01:32.753 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:32.841 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:32.899 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:32.907 DEBUG:teuthology.orchestra.run.smithi174:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:32.907 DEBUG:teuthology.orchestra.run.smithi174:> set -e 2024-05-11T01:01:32.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set brx.1 up 2024-05-11T01:01:32.907 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link set dev brx.1 master ceph-brx 2024-05-11T01:01:32.907 DEBUG:teuthology.orchestra.run.smithi174:> ') 2024-05-11T01:01:32.955 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:32.977 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:32.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:32.985 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-11T01:01:32.999 INFO:teuthology.orchestra.run.smithi174.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-11T01:01:33.000 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:33.000 DEBUG:teuthology.orchestra.run.smithi174:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-11T01:01:33.055 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-11T01:01:33.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:33.056 DEBUG:teuthology.orchestra.run.smithi174:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:33.139 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:33.139 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:33.156 INFO:teuthology.orchestra.run.smithi174.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:33.156 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:33.156 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-11T01:01:33.156 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: trying mount with new device syntax: 3@3d939707-6559-4ce1-a2ce-e98842b2ed86.cephfs=/ 2024-05-11T01:01:33.156 INFO:teuthology.orchestra.run.smithi174.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.16:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-11T01:01:33.157 INFO:teuthology.orchestra.run.smithi174.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-11T01:01:33.157 INFO:teuthology.orchestra.run.smithi174.stdout: You just mounted a file system that supports labels which does not 2024-05-11T01:01:33.157 INFO:teuthology.orchestra.run.smithi174.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-11T01:01:33.157 INFO:teuthology.orchestra.run.smithi174.stdout: applications will generate AVC messages and not be allowed access to 2024-05-11T01:01:33.157 INFO:teuthology.orchestra.run.smithi174.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-11T01:01:33.158 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-11T01:01:33.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:33.158 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-11T01:01:33.224 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:33.313 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:33.315 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:33.321 INFO:teuthology.orchestra.run.smithi174.stdout:client4600 2024-05-11T01:01:33.321 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:01:33.321 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:33.337 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:33.426 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:33.428 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:33.433 INFO:teuthology.orchestra.run.smithi174.stdout:client4600 2024-05-11T01:01:33.434 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:33.482 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:33.484 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:33.490 INFO:teuthology.orchestra.run.smithi174.stdout:client4600 2024-05-11T01:01:33.490 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3d939707-6559-4ce1-a2ce-e98842b2ed86.client4600/status') 2024-05-11T01:01:33.539 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:33.549 INFO:teuthology.orchestra.run.smithi174.stdout:instance: client.4600 (3)192.168.0.2:0/4087774447 2024-05-11T01:01:33.549 INFO:teuthology.orchestra.run.smithi174.stdout:blocklisted: false 2024-05-11T01:01:33.550 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records in 2024-05-11T01:01:33.550 INFO:teuthology.orchestra.run.smithi174.stderr:0+1 records out 2024-05-11T01:01:33.550 INFO:teuthology.orchestra.run.smithi174.stderr:69 bytes copied, 2.2603e-05 s, 3.1 MB/s 2024-05-11T01:01:33.550 INFO:teuthology.orchestra.run.smithi174.stderr:2024-05-11T01:01:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:33.557 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-11T01:01:33.589 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2024-05-11T01:01:33.589 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-05-11T01:01:33.590 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:33.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.709+0000 7f3fafea7640 1 Processor -- start 2024-05-11T01:01:33.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.709+0000 7f3fafea7640 1 -- start start 2024-05-11T01:01:33.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.710+0000 7f3fafea7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa80bab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.710+0000 7f3fafea7640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80d3800 con 0x7f3fa80b8380 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.710+0000 7f3fafea7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80d3ae0 con 0x7f3fa80b6d70 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.710+0000 7f3fafea7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80d35b0 con 0x7f3fa80d2ec0 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.710+0000 7f3fae444640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3fa80b8380 0x7f3fa80d45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47084/0 (socket says 172.21.15.16:47084) 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.710+0000 7f3fae444640 1 -- 172.21.15.16:0/3433975524 learned_addr learned my addr 172.21.15.16:0/3433975524 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.710+0000 7f3fad442640 1 --2- 172.21.15.16:0/3433975524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa80bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.711+0000 7f3facc41640 1 -- 172.21.15.16:0/3433975524 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2073542225 0 0) 0x7f3fa80d3800 con 0x7f3fa80b8380 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.711+0000 7f3facc41640 1 -- 172.21.15.16:0/3433975524 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f94003520 con 0x7f3fa80b8380 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.711+0000 7f3facc41640 1 -- 172.21.15.16:0/3433975524 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60856181 0 0) 0x7f3fa80d3ae0 con 0x7f3fa80b6d70 2024-05-11T01:01:33.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.711+0000 7f3facc41640 1 -- 172.21.15.16:0/3433975524 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa80d3800 con 0x7f3fa80b6d70 2024-05-11T01:01:33.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.711+0000 7f3fad442640 1 -- 172.21.15.16:0/3433975524 >> v1:172.21.15.174:6789/0 conn(0x7f3fa80b6d70 legacy=0x7f3fa80b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:33.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.711+0000 7f3fad442640 1 -- 172.21.15.16:0/3433975524 >> v1:172.21.15.16:6789/0 conn(0x7f3fa80b8380 legacy=0x7f3fa80d45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:33.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.711+0000 7f3fad442640 1 -- 172.21.15.16:0/3433975524 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80d3dc0 con 0x7f3fa80d2ec0 2024-05-11T01:01:33.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3fad442640 1 --2- 172.21.15.16:0/3433975524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa80bab70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3f980097d0 tx=0x7f3f9802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9e93140f19f3b44 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:33.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3facc41640 1 -- 172.21.15.16:0/3433975524 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98037070 con 0x7f3fa80d2ec0 2024-05-11T01:01:33.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3facc41640 1 -- 172.21.15.16:0/3433975524 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f98032440 con 0x7f3fa80d2ec0 2024-05-11T01:01:33.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3facc41640 1 -- 172.21.15.16:0/3433975524 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98032810 con 0x7f3fa80d2ec0 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3fafea7640 1 -- 172.21.15.16:0/3433975524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 msgr2=0x7f3fa80bab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3fafea7640 1 --2- 172.21.15.16:0/3433975524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa80bab70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3f980097d0 tx=0x7f3f9802a210 comp rx=0 tx=0).stop 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3fafea7640 1 -- 172.21.15.16:0/3433975524 shutdown_connections 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3fafea7640 1 --2- 172.21.15.16:0/3433975524 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa80bab70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3fafea7640 1 -- 172.21.15.16:0/3433975524 >> 172.21.15.16:0/3433975524 conn(0x7f3fa8074140 msgr2=0x7f3fa80d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3fafea7640 1 -- 172.21.15.16:0/3433975524 shutdown_connections 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.712+0000 7f3fafea7640 1 -- 172.21.15.16:0/3433975524 wait complete. 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.714+0000 7f3fafea7640 1 Processor -- start 2024-05-11T01:01:33.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.714+0000 7f3fafea7640 1 -- start start 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.714+0000 7f3fafea7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fa80b6d70 0x7f3fa81f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.714+0000 7f3fafea7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa80b8380 0x7f3fa80cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.714+0000 7f3fafea7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa81e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.714+0000 7f3fafea7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa80b8810 con 0x7f3fa80b6d70 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.714+0000 7f3fafea7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa80bb0b0 con 0x7f3fa80b8380 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.714+0000 7f3fafea7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80b8990 con 0x7f3fa80d2ec0 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fa80b6d70 0x7f3fa81f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fa80b6d70 0x7f3fa81f47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33402/0 (socket says 172.21.15.16:33402) 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 -- 172.21.15.16:0/1429847950 learned_addr learned my addr 172.21.15.16:0/1429847950 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fae444640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa81e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fad442640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa80b8380 0x7f3fa80cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 -- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 msgr2=0x7f3fa81e7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa81e7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:33.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 -- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa80b8380 msgr2=0x7f3fa80cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa80b8380 0x7f3fa80cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 -- 172.21.15.16:0/1429847950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa8160790 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fae444640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa81e7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fadc43640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fa80b6d70 0x7f3fa81f47e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c460 tx=0x7f3fa400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3f9e7fc640 1 -- 172.21.15.16:0/1429847950 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40052d0 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3f9e7fc640 1 -- 172.21.15.16:0/1429847950 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa4005490 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa80ce870 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3f9e7fc640 1 -- 172.21.15.16:0/1429847950 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4012870 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.715+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa81f4d20 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.717+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa806a5b0 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.717+0000 7f3f9e7fc640 1 -- 172.21.15.16:0/1429847950 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3fa4012a10 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.718+0000 7f3f9e7fc640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f8c0762d0 0x7f3f8c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.718+0000 7f3f9e7fc640 1 -- 172.21.15.16:0/1429847950 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3fa4097060 con 0x7f3fa80b6d70 2024-05-11T01:01:33.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.718+0000 7f3fad442640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f8c0762d0 0x7f3f8c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:33.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.719+0000 7f3fad442640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f8c0762d0 0x7f3f8c078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3f98034000 tx=0x7f3f9802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:33.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.723+0000 7f3f9e7fc640 1 -- 172.21.15.16:0/1429847950 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3fa4060370 con 0x7f3fa80b6d70 2024-05-11T01:01:33.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.915+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fa80b4a30 con 0x7f3fa80b6d70 2024-05-11T01:01:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.916+0000 7f3f9e7fc640 1 -- 172.21.15.16:0/1429847950 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f3fa4064670 con 0x7f3fa80b6d70 2024-05-11T01:01:33.916 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:33.917 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:10.636137+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f8c0762d0 msgr2=0x7f3f8c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f8c0762d0 0x7f3f8c078790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3f98034000 tx=0x7f3f9802e000 comp rx=0 tx=0).stop 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fa80b6d70 msgr2=0x7f3fa81f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fa80b6d70 0x7f3fa81f47e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c460 tx=0x7f3fa400c920 comp rx=0 tx=0).stop 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 shutdown_connections 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f3f8c0762d0 0x7f3f8c078790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fa80d2ec0 0x7f3fa81e7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fa80b8380 0x7f3fa80cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 --2- 172.21.15.16:0/1429847950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fa80b6d70 0x7f3fa81f47e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 >> 172.21.15.16:0/1429847950 conn(0x7f3fa8074140 msgr2=0x7f3fa80d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 shutdown_connections 2024-05-11T01:01:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:33.918+0000 7f3fafea7640 1 -- 172.21.15.16:0/1429847950 wait complete. 2024-05-11T01:01:33.932 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-11T01:01:03.770695+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-11T01:01:07.219708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-11T01:01:07.972820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-11T01:01:33.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-11T01:01:34.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.040+0000 7f70342c8640 1 Processor -- start 2024-05-11T01:01:34.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.040+0000 7f70342c8640 1 -- start start 2024-05-11T01:01:34.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f70342c8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f702c148e50 0x7f702c0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f70342c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0707a0 0x7f702c070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f70342c8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f702c0b4c80 0x7f702c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f70342c8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f702c071140 con 0x7f702c148e50 2024-05-11T01:01:34.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f70342c8640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f702c149230 con 0x7f702c0b4c80 2024-05-11T01:01:34.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f70342c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f702c163290 con 0x7f702c0707a0 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032064640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f702c148e50 0x7f702c0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032064640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f702c148e50 0x7f702c0b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33410/0 (socket says 172.21.15.16:33410) 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032064640 1 -- 172.21.15.16:0/4197875336 learned_addr learned my addr 172.21.15.16:0/4197875336 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7031863640 1 --2- 172.21.15.16:0/4197875336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0707a0 0x7f702c070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032865640 1 --2- 172.21.15.16:0/4197875336 >> v2:172.21.15.174:3300/0 conn(0x7f702c0b4c80 0x7f702c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032064640 1 -- 172.21.15.16:0/4197875336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0707a0 msgr2=0x7f702c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032064640 1 --2- 172.21.15.16:0/4197875336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0707a0 0x7f702c070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032064640 1 -- 172.21.15.16:0/4197875336 >> v2:172.21.15.174:3300/0 conn(0x7f702c0b4c80 msgr2=0x7f702c0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032064640 1 --2- 172.21.15.16:0/4197875336 >> v2:172.21.15.174:3300/0 conn(0x7f702c0b4c80 0x7f702c0b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.041+0000 7f7032064640 1 -- 172.21.15.16:0/4197875336 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c163570 con 0x7f702c148e50 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.042+0000 7f7032865640 1 --2- 172.21.15.16:0/4197875336 >> v2:172.21.15.174:3300/0 conn(0x7f702c0b4c80 0x7f702c0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.042+0000 7f7032064640 1 --2- 172.21.15.16:0/4197875336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c148e50 0x7f702c0b66a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f702c0d41a0 tx=0x7f702402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c9c6cea3127d89 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.042+0000 7f7031062640 1 -- 172.21.15.16:0/4197875336 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024037070 con 0x7f702c148e50 2024-05-11T01:01:34.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.042+0000 7f7031062640 1 -- 172.21.15.16:0/4197875336 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7024032440 con 0x7f702c148e50 2024-05-11T01:01:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.042+0000 7f7031062640 1 -- 172.21.15.16:0/4197875336 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024032810 con 0x7f702c148e50 2024-05-11T01:01:34.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 -- 172.21.15.16:0/4197875336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c148e50 msgr2=0x7f702c0b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 --2- 172.21.15.16:0/4197875336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c148e50 0x7f702c0b66a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f702c0d41a0 tx=0x7f702402a1e0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 -- 172.21.15.16:0/4197875336 shutdown_connections 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 --2- 172.21.15.16:0/4197875336 >> v2:172.21.15.174:3300/0 conn(0x7f702c0b4c80 0x7f702c0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 --2- 172.21.15.16:0/4197875336 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0707a0 0x7f702c070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 --2- 172.21.15.16:0/4197875336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c148e50 0x7f702c0b66a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 -- 172.21.15.16:0/4197875336 >> 172.21.15.16:0/4197875336 conn(0x7f702c0b8510 msgr2=0x7f702c0b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 -- 172.21.15.16:0/4197875336 shutdown_connections 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.043+0000 7f70342c8640 1 -- 172.21.15.16:0/4197875336 wait complete. 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.044+0000 7f70342c8640 1 Processor -- start 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.044+0000 7f70342c8640 1 -- start start 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f70342c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c0707a0 0x7f702c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f70342c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0b4c80 0x7f702c15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f70342c8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f702c148e50 0x7f702c161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f70342c8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f702c0b6be0 con 0x7f702c0707a0 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f70342c8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f702c163b30 con 0x7f702c148e50 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f70342c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f702c0b6d60 con 0x7f702c0b4c80 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032064640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c0707a0 0x7f702c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032064640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c0707a0 0x7f702c15e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33416/0 (socket says 172.21.15.16:33416) 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032064640 1 -- 172.21.15.16:0/3277161842 learned_addr learned my addr 172.21.15.16:0/3277161842 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032865640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f702c148e50 0x7f702c161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7031863640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0b4c80 0x7f702c15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032064640 1 -- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0b4c80 msgr2=0x7f702c15e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032064640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0b4c80 0x7f702c15e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032064640 1 -- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f702c148e50 msgr2=0x7f702c161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032064640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f702c148e50 0x7f702c161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.045+0000 7f7032064640 1 -- 172.21.15.16:0/3277161842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c141f00 con 0x7f702c0707a0 2024-05-11T01:01:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.046+0000 7f7032064640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c0707a0 0x7f702c15e050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7024000c00 tx=0x7f70240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.046+0000 7f702affd640 1 -- 172.21.15.16:0/3277161842 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024041070 con 0x7f702c0707a0 2024-05-11T01:01:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.046+0000 7f702affd640 1 -- 172.21.15.16:0/3277161842 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702403c870 con 0x7f702c0707a0 2024-05-11T01:01:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.046+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702c1421e0 con 0x7f702c0707a0 2024-05-11T01:01:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.046+0000 7f702affd640 1 -- 172.21.15.16:0/3277161842 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024037040 con 0x7f702c0707a0 2024-05-11T01:01:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.046+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702c13f090 con 0x7f702c0707a0 2024-05-11T01:01:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.047+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f702c142700 con 0x7f702c0707a0 2024-05-11T01:01:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.047+0000 7f702affd640 1 -- 172.21.15.16:0/3277161842 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7024044070 con 0x7f702c0707a0 2024-05-11T01:01:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.048+0000 7f702affd640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f70180762d0 0x7f7018078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.048+0000 7f702affd640 1 -- 172.21.15.16:0/3277161842 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f70240b7fc0 con 0x7f702c0707a0 2024-05-11T01:01:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.048+0000 7f7031863640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f70180762d0 0x7f7018078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.049+0000 7f7031863640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f70180762d0 0x7f7018078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f702c141710 tx=0x7f7020009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.052+0000 7f702affd640 1 -- 172.21.15.16:0/3277161842 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f70240812d0 con 0x7f702c0707a0 2024-05-11T01:01:34.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.242+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f702c06a5b0 con 0x7f702c0707a0 2024-05-11T01:01:34.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.243+0000 7f702affd640 1 -- 172.21.15.16:0/3277161842 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f70240855d0 con 0x7f702c0707a0 2024-05-11T01:01:34.243 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-05-11T01:01:34.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f70180762d0 msgr2=0x7f7018078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f70180762d0 0x7f7018078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f702c141710 tx=0x7f7020009190 comp rx=0 tx=0).stop 2024-05-11T01:01:34.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c0707a0 msgr2=0x7f702c15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c0707a0 0x7f702c15e050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7024000c00 tx=0x7f70240046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 shutdown_connections 2024-05-11T01:01:34.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f70180762d0 0x7f7018078790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f702c148e50 0x7f702c161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f702c0b4c80 0x7f702c15e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 --2- 172.21.15.16:0/3277161842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f702c0707a0 0x7f702c15e050 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 >> 172.21.15.16:0/3277161842 conn(0x7f702c0b8510 msgr2=0x7f702c0b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:34.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 shutdown_connections 2024-05-11T01:01:34.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.245+0000 7f70342c8640 1 -- 172.21.15.16:0/3277161842 wait complete. 2024-05-11T01:01:34.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-11T01:01:34.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.363+0000 7f42d7190640 1 Processor -- start 2024-05-11T01:01:34.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.363+0000 7f42d7190640 1 -- start start 2024-05-11T01:01:34.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d7190640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42d015f6b0 0x7f42d00d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d7190640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f42d00d00e0 0x7f42d00d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d7190640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d015fa90 con 0x7f42d00bac80 2024-05-11T01:01:34.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d7190640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f42d00d3750 con 0x7f42d015f6b0 2024-05-11T01:01:34.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d7190640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f42d00d39f0 con 0x7f42d00d00e0 2024-05-11T01:01:34.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d4f2c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42d015f6b0 0x7f42d00d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d4f2c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42d015f6b0 0x7f42d00d3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33432/0 (socket says 172.21.15.16:33432) 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d4f2c640 1 -- 172.21.15.16:0/2041655059 learned_addr learned my addr 172.21.15.16:0/2041655059 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42c7fff640 1 --1- 172.21.15.16:0/2041655059 >> v1:172.21.15.16:6789/0 conn(0x7f42d00bac80 0x7f42d00d4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47096/0 (socket says 172.21.15.16:47096) 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d572d640 1 --2- 172.21.15.16:0/2041655059 >> v2:172.21.15.174:3300/0 conn(0x7f42d00d00e0 0x7f42d00d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d4f2c640 1 -- 172.21.15.16:0/2041655059 >> v2:172.21.15.174:3300/0 conn(0x7f42d00d00e0 msgr2=0x7f42d00d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d4f2c640 1 --2- 172.21.15.16:0/2041655059 >> v2:172.21.15.174:3300/0 conn(0x7f42d00d00e0 0x7f42d00d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d4f2c640 1 -- 172.21.15.16:0/2041655059 >> v1:172.21.15.16:6789/0 conn(0x7f42d00bac80 legacy=0x7f42d00d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.364+0000 7f42d4f2c640 1 -- 172.21.15.16:0/2041655059 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d00d3cd0 con 0x7f42d015f6b0 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.365+0000 7f42d4f2c640 1 --2- 172.21.15.16:0/2041655059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00d3210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42d00cfb30 tx=0x7f42cc02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15504c9840688519 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.365+0000 7f42c77fe640 1 -- 172.21.15.16:0/2041655059 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc036070 con 0x7f42d015f6b0 2024-05-11T01:01:34.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.365+0000 7f42c77fe640 1 -- 172.21.15.16:0/2041655059 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc031600 con 0x7f42d015f6b0 2024-05-11T01:01:34.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.365+0000 7f42c77fe640 1 -- 172.21.15.16:0/2041655059 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0319f0 con 0x7f42d015f6b0 2024-05-11T01:01:34.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.365+0000 7f42d7190640 1 -- 172.21.15.16:0/2041655059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 msgr2=0x7f42d00d3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.365+0000 7f42d7190640 1 --2- 172.21.15.16:0/2041655059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00d3210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42d00cfb30 tx=0x7f42cc02a7c0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.366+0000 7f42d7190640 1 -- 172.21.15.16:0/2041655059 shutdown_connections 2024-05-11T01:01:34.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.366+0000 7f42d7190640 1 --2- 172.21.15.16:0/2041655059 >> v2:172.21.15.174:3300/0 conn(0x7f42d00d00e0 0x7f42d00d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.366+0000 7f42d7190640 1 --2- 172.21.15.16:0/2041655059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00d3210 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.366+0000 7f42d7190640 1 -- 172.21.15.16:0/2041655059 >> 172.21.15.16:0/2041655059 conn(0x7f42d0073f00 msgr2=0x7f42d0074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.366+0000 7f42d7190640 1 -- 172.21.15.16:0/2041655059 shutdown_connections 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.366+0000 7f42d7190640 1 -- 172.21.15.16:0/2041655059 wait complete. 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.367+0000 7f42d7190640 1 Processor -- start 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.367+0000 7f42d7190640 1 -- start start 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d7190640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d00bac80 0x7f42d014df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d7190640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d00d00e0 0x7f42d0150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d7190640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d7190640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00d4570 con 0x7f42d015f6b0 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d7190640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00d4290 con 0x7f42d00d00e0 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d7190640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f42d00b8400 con 0x7f42d00bac80 2024-05-11T01:01:34.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33434/0 (socket says 172.21.15.16:33434) 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 -- 172.21.15.16:0/2910175418 learned_addr learned my addr 172.21.15.16:0/2910175418 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 -- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d00bac80 msgr2=0x7f42d014df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d00bac80 0x7f42d014df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 -- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d00d00e0 msgr2=0x7f42d0150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42c7fff640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d00d00e0 0x7f42d0150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d00d00e0 0x7f42d0150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 -- 172.21.15.16:0/2910175418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d015a380 con 0x7f42d015f6b0 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d572d640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00b3230 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f42c800d800 tx=0x7f42c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42c57fa640 1 -- 172.21.15.16:0/2910175418 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c800b6c0 con 0x7f42d015f6b0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42c57fa640 1 -- 172.21.15.16:0/2910175418 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c8019070 con 0x7f42d015f6b0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d015a660 con 0x7f42d015f6b0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42c57fa640 1 -- 172.21.15.16:0/2910175418 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c800bac0 con 0x7f42d015f6b0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.368+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d015ac20 con 0x7f42d015f6b0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.369+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d015af50 con 0x7f42d015f6b0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.370+0000 7f42c57fa640 1 -- 172.21.15.16:0/2910175418 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42c800bc60 con 0x7f42d015f6b0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.371+0000 7f42c57fa640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f42bc0762d0 0x7f42bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.371+0000 7f42c57fa640 1 -- 172.21.15.16:0/2910175418 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f42c8097b30 con 0x7f42d015f6b0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.371+0000 7f42d4f2c640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f42bc0762d0 0x7f42bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.371+0000 7f42d4f2c640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f42bc0762d0 0x7f42bc078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42cc033000 tx=0x7f42cc02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.375+0000 7f42c57fa640 1 -- 172.21.15.16:0/2910175418 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f42c8061400 con 0x7f42d015f6b0 2024-05-11T01:01:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.564+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f42d006a5b0 con 0x7f42d015f6b0 2024-05-11T01:01:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.565+0000 7f42c57fa640 1 -- 172.21.15.16:0/2910175418 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f42c8060d00 con 0x7f42d015f6b0 2024-05-11T01:01:34.565 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f42bc0762d0 msgr2=0x7f42bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f42bc0762d0 0x7f42bc078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42cc033000 tx=0x7f42cc02e000 comp rx=0 tx=0).stop 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 msgr2=0x7f42d00b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00b3230 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f42c800d800 tx=0x7f42c800dcc0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 shutdown_connections 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f42bc0762d0 0x7f42bc078790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42d015f6b0 0x7f42d00b3230 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f42d00d00e0 0x7f42d0150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 --2- 172.21.15.16:0/2910175418 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f42d00bac80 0x7f42d014df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 >> 172.21.15.16:0/2910175418 conn(0x7f42d0073f00 msgr2=0x7f42d0161f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:34.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 shutdown_connections 2024-05-11T01:01:34.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.567+0000 7f42d7190640 1 -- 172.21.15.16:0/2910175418 wait complete. 2024-05-11T01:01:34.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-11T01:01:34.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.685+0000 7f6a6b415640 1 Processor -- start 2024-05-11T01:01:34.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.685+0000 7f6a6b415640 1 -- start start 2024-05-11T01:01:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a6b415640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6a640bac80 0x7f6a640d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a6b415640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6a640d00e0 0x7f6a640d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a6b415640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6415fa90 con 0x7f6a6415f6b0 2024-05-11T01:01:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a6b415640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6a640d39f0 con 0x7f6a640bac80 2024-05-11T01:01:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a6b415640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f6a640d3cd0 con 0x7f6a640d00e0 2024-05-11T01:01:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a691b1640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6a6415f6b0 0x7f6a640d3210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47106/0 (socket says 172.21.15.16:47106) 2024-05-11T01:01:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a689b0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6a640bac80 0x7f6a640d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a691b1640 1 -- 172.21.15.16:0/725119860 learned_addr learned my addr 172.21.15.16:0/725119860 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a699b2640 1 --2- 172.21.15.16:0/725119860 >> v2:172.21.15.174:3300/0 conn(0x7f6a640d00e0 0x7f6a640d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a689b0640 1 -- 172.21.15.16:0/725119860 >> v2:172.21.15.174:3300/0 conn(0x7f6a640d00e0 msgr2=0x7f6a640d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a689b0640 1 --2- 172.21.15.16:0/725119860 >> v2:172.21.15.174:3300/0 conn(0x7f6a640d00e0 0x7f6a640d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a689b0640 1 -- 172.21.15.16:0/725119860 >> v1:172.21.15.16:6789/0 conn(0x7f6a6415f6b0 legacy=0x7f6a640d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.686+0000 7f6a689b0640 1 -- 172.21.15.16:0/725119860 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a640d3fb0 con 0x7f6a640bac80 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.687+0000 7f6a689b0640 1 --2- 172.21.15.16:0/725119860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640bac80 0x7f6a640d4a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a640cfb60 tx=0x7f6a5402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5930afc9b58707 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.687+0000 7f6a5bfff640 1 -- 172.21.15.16:0/725119860 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54037070 con 0x7f6a640bac80 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.687+0000 7f6a5bfff640 1 -- 172.21.15.16:0/725119860 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54032440 con 0x7f6a640bac80 2024-05-11T01:01:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.687+0000 7f6a5bfff640 1 -- 172.21.15.16:0/725119860 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54032810 con 0x7f6a640bac80 2024-05-11T01:01:34.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.688+0000 7f6a6b415640 1 -- 172.21.15.16:0/725119860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640bac80 msgr2=0x7f6a640d4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.688+0000 7f6a6b415640 1 --2- 172.21.15.16:0/725119860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640bac80 0x7f6a640d4a90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a640cfb60 tx=0x7f6a5402a230 comp rx=0 tx=0).stop 2024-05-11T01:01:34.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.688+0000 7f6a6b415640 1 -- 172.21.15.16:0/725119860 shutdown_connections 2024-05-11T01:01:34.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.688+0000 7f6a6b415640 1 --2- 172.21.15.16:0/725119860 >> v2:172.21.15.174:3300/0 conn(0x7f6a640d00e0 0x7f6a640d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.688+0000 7f6a6b415640 1 --2- 172.21.15.16:0/725119860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640bac80 0x7f6a640d4a90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.688+0000 7f6a6b415640 1 -- 172.21.15.16:0/725119860 >> 172.21.15.16:0/725119860 conn(0x7f6a64073f00 msgr2=0x7f6a64074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.688+0000 7f6a6b415640 1 -- 172.21.15.16:0/725119860 shutdown_connections 2024-05-11T01:01:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.688+0000 7f6a6b415640 1 -- 172.21.15.16:0/725119860 wait complete. 2024-05-11T01:01:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.689+0000 7f6a6b415640 1 Processor -- start 2024-05-11T01:01:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.689+0000 7f6a6b415640 1 -- start start 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a6b415640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a640bac80 0x7f6a641f7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a6b415640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640d00e0 0x7f6a640b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a6b415640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a6415f6b0 0x7f6a640ce760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a6b415640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6a640d4fd0 con 0x7f6a640d00e0 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a6b415640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6a640d4570 con 0x7f6a6415f6b0 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a6b415640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6a640b5590 con 0x7f6a640bac80 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640d00e0 0x7f6a640b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640d00e0 0x7f6a640b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33454/0 (socket says 172.21.15.16:33454) 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 -- 172.21.15.16:0/238880834 learned_addr learned my addr 172.21.15.16:0/238880834 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a699b2640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a6415f6b0 0x7f6a640ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a691b1640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a640bac80 0x7f6a641f7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 -- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a640bac80 msgr2=0x7f6a641f7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a640bac80 0x7f6a641f7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 -- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a6415f6b0 msgr2=0x7f6a640ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a6415f6b0 0x7f6a640ce760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 -- 172.21.15.16:0/238880834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a640b5870 con 0x7f6a640d00e0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a691b1640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a640bac80 0x7f6a641f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.690+0000 7f6a689b0640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640d00e0 0x7f6a640b4ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000c00 tx=0x7f6a540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.691+0000 7f6a59ffb640 1 -- 172.21.15.16:0/238880834 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54037040 con 0x7f6a640d00e0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.691+0000 7f6a59ffb640 1 -- 172.21.15.16:0/238880834 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54042070 con 0x7f6a640d00e0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.691+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a640cc480 con 0x7f6a640d00e0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.691+0000 7f6a59ffb640 1 -- 172.21.15.16:0/238880834 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54030bd0 con 0x7f6a640d00e0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.691+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6414d510 con 0x7f6a640d00e0 2024-05-11T01:01:34.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.692+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6406a5b0 con 0x7f6a640d00e0 2024-05-11T01:01:34.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.692+0000 7f6a59ffb640 1 -- 172.21.15.16:0/238880834 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6a54047460 con 0x7f6a640d00e0 2024-05-11T01:01:34.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.693+0000 7f6a59ffb640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6a480762d0 0x7f6a48078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:34.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.693+0000 7f6a59ffb640 1 -- 172.21.15.16:0/238880834 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6a540b8100 con 0x7f6a640d00e0 2024-05-11T01:01:34.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.693+0000 7f6a691b1640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6a480762d0 0x7f6a48078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:34.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.694+0000 7f6a691b1640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6a480762d0 0x7f6a48078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000f60 tx=0x7f6a60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:34.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.697+0000 7f6a59ffb640 1 -- 172.21.15.16:0/238880834 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6a54032e20 con 0x7f6a640d00e0 2024-05-11T01:01:34.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.892+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6a640cfd70 con 0x7f6a640d00e0 2024-05-11T01:01:34.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.892+0000 7f6a59ffb640 1 -- 172.21.15.16:0/238880834 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f6a54081af0 con 0x7f6a640d00e0 2024-05-11T01:01:34.892 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.894+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6a480762d0 msgr2=0x7f6a48078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.894+0000 7f6a6b415640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6a480762d0 0x7f6a48078790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6a60000f60 tx=0x7f6a60009040 comp rx=0 tx=0).stop 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.894+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640d00e0 msgr2=0x7f6a640b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.894+0000 7f6a6b415640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640d00e0 0x7f6a640b4ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000c00 tx=0x7f6a540046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.895+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 shutdown_connections 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.895+0000 7f6a6b415640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6a480762d0 0x7f6a48078790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.895+0000 7f6a6b415640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6a6415f6b0 0x7f6a640ce760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.895+0000 7f6a6b415640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a640d00e0 0x7f6a640b4ad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.895+0000 7f6a6b415640 1 --2- 172.21.15.16:0/238880834 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6a640bac80 0x7f6a641f7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:34.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.895+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 >> 172.21.15.16:0/238880834 conn(0x7f6a64073f00 msgr2=0x7f6a64160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:34.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.895+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 shutdown_connections 2024-05-11T01:01:34.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:34.895+0000 7f6a6b415640 1 -- 172.21.15.16:0/238880834 wait complete. 2024-05-11T01:01:34.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2024-05-11T01:01:35.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.009+0000 7f2d9ef22640 1 Processor -- start 2024-05-11T01:01:35.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.009+0000 7f2d9ef22640 1 -- start start 2024-05-11T01:01:35.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9ef22640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d98165ef0 0x7f2d981682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9ef22640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d980d0f30 con 0x7f2d9806c3e0 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9ef22640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d980d1210 con 0x7f2d980cea90 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9ef22640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2d980718a0 con 0x7f2d98165ef0 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9d4bf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d98165ef0 0x7f2d981682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9d4bf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d98165ef0 0x7f2d981682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33470/0 (socket says 172.21.15.16:33470) 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9ccbe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2d9806c3e0 0x7f2d9806c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47114/0 (socket says 172.21.15.16:47114) 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9d4bf640 1 -- 172.21.15.16:0/953149074 learned_addr learned my addr 172.21.15.16:0/953149074 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.010+0000 7f2d9d4bf640 1 -- 172.21.15.16:0/953149074 >> v1:172.21.15.174:6789/0 conn(0x7f2d980cea90 legacy=0x7f2d980cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.011+0000 7f2d977fe640 1 -- 172.21.15.16:0/953149074 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804437916 0 0) 0x7f2d980d0f30 con 0x7f2d9806c3e0 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.011+0000 7f2d9d4bf640 1 -- 172.21.15.16:0/953149074 >> v1:172.21.15.16:6789/0 conn(0x7f2d9806c3e0 legacy=0x7f2d9806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.011+0000 7f2d9d4bf640 1 -- 172.21.15.16:0/953149074 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d980d14f0 con 0x7f2d98165ef0 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.011+0000 7f2d9d4bf640 1 --2- 172.21.15.16:0/953149074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d98165ef0 0x7f2d981682e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009870 tx=0x7f2d8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a910cd4077e610c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.011+0000 7f2d977fe640 1 -- 172.21.15.16:0/953149074 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80037070 con 0x7f2d98165ef0 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.011+0000 7f2d977fe640 1 -- 172.21.15.16:0/953149074 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d80032440 con 0x7f2d98165ef0 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.011+0000 7f2d977fe640 1 -- 172.21.15.16:0/953149074 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80032810 con 0x7f2d98165ef0 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.012+0000 7f2d9ef22640 1 -- 172.21.15.16:0/953149074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d98165ef0 msgr2=0x7f2d981682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.012+0000 7f2d9ef22640 1 --2- 172.21.15.16:0/953149074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d98165ef0 0x7f2d981682e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009870 tx=0x7f2d8002a270 comp rx=0 tx=0).stop 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.012+0000 7f2d9ef22640 1 -- 172.21.15.16:0/953149074 shutdown_connections 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.012+0000 7f2d9ef22640 1 --2- 172.21.15.16:0/953149074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d98165ef0 0x7f2d981682e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.012+0000 7f2d9ef22640 1 -- 172.21.15.16:0/953149074 >> 172.21.15.16:0/953149074 conn(0x7f2d980d2060 msgr2=0x7f2d980d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.012+0000 7f2d9ef22640 1 -- 172.21.15.16:0/953149074 shutdown_connections 2024-05-11T01:01:35.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.012+0000 7f2d9ef22640 1 -- 172.21.15.16:0/953149074 wait complete. 2024-05-11T01:01:35.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.013+0000 7f2d9ef22640 1 Processor -- start 2024-05-11T01:01:35.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.013+0000 7f2d9ef22640 1 -- start start 2024-05-11T01:01:35.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ef22640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d9806c3e0 0x7f2d9815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ef22640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d980cea90 0x7f2d9806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ef22640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d98165ef0 0x7f2d98160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ef22640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2d981463a0 con 0x7f2d9806c3e0 2024-05-11T01:01:35.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ef22640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980d0b50 con 0x7f2d98165ef0 2024-05-11T01:01:35.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ef22640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2d9815db60 con 0x7f2d980cea90 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ccbe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d9806c3e0 0x7f2d9815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ccbe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d9806c3e0 0x7f2d9815e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33476/0 (socket says 172.21.15.16:33476) 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9ccbe640 1 -- 172.21.15.16:0/293147933 learned_addr learned my addr 172.21.15.16:0/293147933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.014+0000 7f2d9d4bf640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d98165ef0 0x7f2d98160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d97fff640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d980cea90 0x7f2d9806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9ccbe640 1 -- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d980cea90 msgr2=0x7f2d9806fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9ccbe640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d980cea90 0x7f2d9806fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9ccbe640 1 -- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d98165ef0 msgr2=0x7f2d98160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9ccbe640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d98165ef0 0x7f2d98160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9ccbe640 1 -- 172.21.15.16:0/293147933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9815de40 con 0x7f2d9806c3e0 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9d4bf640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d98165ef0 0x7f2d98160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9ccbe640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d9806c3e0 0x7f2d9815e920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c490 tx=0x7f2d9000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d957fa640 1 -- 172.21.15.16:0/293147933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90018070 con 0x7f2d9806c3e0 2024-05-11T01:01:35.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d957fa640 1 -- 172.21.15.16:0/293147933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d90007500 con 0x7f2d9806c3e0 2024-05-11T01:01:35.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9815e120 con 0x7f2d9806c3e0 2024-05-11T01:01:35.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d957fa640 1 -- 172.21.15.16:0/293147933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90004a20 con 0x7f2d9806c3e0 2024-05-11T01:01:35.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.015+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9815c1e0 con 0x7f2d9806c3e0 2024-05-11T01:01:35.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.016+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d9806a5b0 con 0x7f2d9806c3e0 2024-05-11T01:01:35.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.017+0000 7f2d957fa640 1 -- 172.21.15.16:0/293147933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2d9001b070 con 0x7f2d9806c3e0 2024-05-11T01:01:35.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.017+0000 7f2d957fa640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f2d780762d0 0x7f2d78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.017+0000 7f2d957fa640 1 -- 172.21.15.16:0/293147933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d90096930 con 0x7f2d9806c3e0 2024-05-11T01:01:35.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.017+0000 7f2d97fff640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f2d780762d0 0x7f2d78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.018+0000 7f2d97fff640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f2d780762d0 0x7f2d78078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d88007fd0 tx=0x7f2d88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:35.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.021+0000 7f2d957fa640 1 -- 172.21.15.16:0/293147933 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2d90060290 con 0x7f2d9806c3e0 2024-05-11T01:01:35.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.287+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) -- 0x7f2d980d04e0 con 0x7f2d9806c3e0 2024-05-11T01:01:35.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.856+0000 7f2d957fa640 1 -- 172.21.15.16:0/293147933 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v37) ==== 161+0+0 (secure 0 0 0) 0x7f2d9005fb90 con 0x7f2d9806c3e0 2024-05-11T01:01:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f2d780762d0 msgr2=0x7f2d78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f2d780762d0 0x7f2d78078790 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d88007fd0 tx=0x7f2d88009040 comp rx=0 tx=0).stop 2024-05-11T01:01:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d9806c3e0 msgr2=0x7f2d9815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d9806c3e0 0x7f2d9815e920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000c490 tx=0x7f2d9000c950 comp rx=0 tx=0).stop 2024-05-11T01:01:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 shutdown_connections 2024-05-11T01:01:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f2d780762d0 0x7f2d78078790 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d98165ef0 0x7f2d98160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2d980cea90 0x7f2d9806fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 --2- 172.21.15.16:0/293147933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d9806c3e0 0x7f2d9815e920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 >> 172.21.15.16:0/293147933 conn(0x7f2d980d2060 msgr2=0x7f2d9813bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:35.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 shutdown_connections 2024-05-11T01:01:35.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.859+0000 7f2d9ef22640 1 -- 172.21.15.16:0/293147933 wait complete. 2024-05-11T01:01:35.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-11T01:01:35.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.981+0000 7f5c9e79d640 1 Processor -- start 2024-05-11T01:01:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.981+0000 7f5c9e79d640 1 -- start start 2024-05-11T01:01:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.982+0000 7f5c9e79d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c98162a60 0x7f5c980b8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.982+0000 7f5c9e79d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5c980d0050 0x7f5c980d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.982+0000 7f5c9e79d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c980d3840 con 0x7f5c980d33e0 2024-05-11T01:01:35.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.982+0000 7f5c9e79d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5c980d09c0 con 0x7f5c980d0050 2024-05-11T01:01:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.982+0000 7f5c9e79d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f5c980b8ab0 con 0x7f5c98162a60 2024-05-11T01:01:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.982+0000 7f5c9cd3a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5c980d0050 0x7f5c980d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.983+0000 7f5c9cd3a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5c980d0050 0x7f5c980d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33484/0 (socket says 172.21.15.16:33484) 2024-05-11T01:01:35.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.983+0000 7f5c9cd3a640 1 -- 172.21.15.16:0/1784417841 learned_addr learned my addr 172.21.15.16:0/1784417841 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.983+0000 7f5c97fff640 1 --2- 172.21.15.16:0/1784417841 >> v2:172.21.15.174:3300/0 conn(0x7f5c98162a60 0x7f5c980b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.983+0000 7f5c9cd3a640 1 -- 172.21.15.16:0/1784417841 >> v2:172.21.15.174:3300/0 conn(0x7f5c98162a60 msgr2=0x7f5c980b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.983+0000 7f5c9cd3a640 1 --2- 172.21.15.16:0/1784417841 >> v2:172.21.15.174:3300/0 conn(0x7f5c98162a60 0x7f5c980b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.983+0000 7f5c9cd3a640 1 -- 172.21.15.16:0/1784417841 >> v1:172.21.15.174:6789/0 conn(0x7f5c980d33e0 legacy=0x7f5c980bad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.983+0000 7f5c9cd3a640 1 -- 172.21.15.16:0/1784417841 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c980b8d90 con 0x7f5c980d0050 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.983+0000 7f5c97fff640 1 --2- 172.21.15.16:0/1784417841 >> v2:172.21.15.174:3300/0 conn(0x7f5c98162a60 0x7f5c980b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9cd3a640 1 --2- 172.21.15.16:0/1784417841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d0050 0x7f5c980d0480 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c980cc3e0 tx=0x7f5c9002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b1590311d37c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c977fe640 1 -- 172.21.15.16:0/1784417841 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90036070 con 0x7f5c980d0050 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c977fe640 1 -- 172.21.15.16:0/1784417841 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c90031600 con 0x7f5c980d0050 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c977fe640 1 -- 172.21.15.16:0/1784417841 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c900319d0 con 0x7f5c980d0050 2024-05-11T01:01:35.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9e79d640 1 -- 172.21.15.16:0/1784417841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d0050 msgr2=0x7f5c980d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/1784417841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d0050 0x7f5c980d0480 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5c980cc3e0 tx=0x7f5c9002a660 comp rx=0 tx=0).stop 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9e79d640 1 -- 172.21.15.16:0/1784417841 shutdown_connections 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/1784417841 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d0050 0x7f5c980d0480 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/1784417841 >> v2:172.21.15.174:3300/0 conn(0x7f5c98162a60 0x7f5c980b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9e79d640 1 -- 172.21.15.16:0/1784417841 >> 172.21.15.16:0/1784417841 conn(0x7f5c98073f00 msgr2=0x7f5c98074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9e79d640 1 -- 172.21.15.16:0/1784417841 shutdown_connections 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.984+0000 7f5c9e79d640 1 -- 172.21.15.16:0/1784417841 wait complete. 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c9e79d640 1 Processor -- start 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c9e79d640 1 -- start start 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c9e79d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c980d0050 0x7f5c98159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c9e79d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d33e0 0x7f5c98143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c9e79d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c98162a60 0x7f5c98162e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c9e79d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980b9630 con 0x7f5c980d33e0 2024-05-11T01:01:35.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c9e79d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5c980b9350 con 0x7f5c980d0050 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c9e79d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5c980b9b50 con 0x7f5c98162a60 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d33e0 0x7f5c98143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c8ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d33e0 0x7f5c98143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33492/0 (socket says 172.21.15.16:33492) 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.986+0000 7f5c8ffff640 1 -- 172.21.15.16:0/361120700 learned_addr learned my addr 172.21.15.16:0/361120700 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c8ffff640 1 -- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c98162a60 msgr2=0x7f5c98162e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c8ffff640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c98162a60 0x7f5c98162e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c8ffff640 1 -- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c980d0050 msgr2=0x7f5c98159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c8ffff640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c980d0050 0x7f5c98159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c8ffff640 1 -- 172.21.15.16:0/361120700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c981445f0 con 0x7f5c980d33e0 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c8ffff640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d33e0 0x7f5c98143080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000c430 tx=0x7f5c8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c957fa640 1 -- 172.21.15.16:0/361120700 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80011790 con 0x7f5c980d33e0 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c957fa640 1 -- 172.21.15.16:0/361120700 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c80017070 con 0x7f5c980d33e0 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c98143970 con 0x7f5c980d33e0 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c957fa640 1 -- 172.21.15.16:0/361120700 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80011b70 con 0x7f5c980d33e0 2024-05-11T01:01:35.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.987+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c98143f30 con 0x7f5c980d33e0 2024-05-11T01:01:35.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.988+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c9806a5b0 con 0x7f5c980d33e0 2024-05-11T01:01:35.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.989+0000 7f5c957fa640 1 -- 172.21.15.16:0/361120700 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c80011d10 con 0x7f5c980d33e0 2024-05-11T01:01:35.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.989+0000 7f5c957fa640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5c780762d0 0x7f5c78078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:35.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.989+0000 7f5c957fa640 1 -- 172.21.15.16:0/361120700 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5c800973e0 con 0x7f5c980d33e0 2024-05-11T01:01:35.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.989+0000 7f5c97fff640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5c780762d0 0x7f5c78078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:35.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.990+0000 7f5c97fff640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5c780762d0 0x7f5c78078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5c88006fd0 tx=0x7f5c88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:35.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:35.993+0000 7f5c957fa640 1 -- 172.21.15.16:0/361120700 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c80060dd0 con 0x7f5c980d33e0 2024-05-11T01:01:36.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.182+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5c9815cc70 con 0x7f5c980d33e0 2024-05-11T01:01:36.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.186+0000 7f5c957fa640 1 -- 172.21.15.16:0/361120700 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f5c800606d0 con 0x7f5c980d33e0 2024-05-11T01:01:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.187+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5c780762d0 msgr2=0x7f5c78078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.187+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5c780762d0 0x7f5c78078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5c88006fd0 tx=0x7f5c88008040 comp rx=0 tx=0).stop 2024-05-11T01:01:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d33e0 msgr2=0x7f5c98143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d33e0 0x7f5c98143080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000c430 tx=0x7f5c8000c8f0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 shutdown_connections 2024-05-11T01:01:36.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5c780762d0 0x7f5c78078790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c98162a60 0x7f5c98162e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c980d33e0 0x7f5c98143080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 --2- 172.21.15.16:0/361120700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c980d0050 0x7f5c98159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 >> 172.21.15.16:0/361120700 conn(0x7f5c98073f00 msgr2=0x7f5c9815f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:36.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 shutdown_connections 2024-05-11T01:01:36.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.188+0000 7f5c9e79d640 1 -- 172.21.15.16:0/361120700 wait complete. 2024-05-11T01:01:36.199 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-11T01:01:36.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-11T01:01:36.240 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-11T01:01:36.295 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-11T01:01:36.296 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:36.296 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:36.312 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:36.312 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:36.369 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:36.369 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:36.427 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-11T01:01:36.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.571+0000 7f06dc093640 1 Processor -- start 2024-05-11T01:01:36.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.572+0000 7f06dc093640 1 -- start start 2024-05-11T01:01:36.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.572+0000 7f06dc093640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f06d40baed0 0x7f06d4162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:36.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.572+0000 7f06dc093640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d4163820 con 0x7f06d40d0000 2024-05-11T01:01:36.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.572+0000 7f06dc093640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d4163b00 con 0x7f06d40d3bf0 2024-05-11T01:01:36.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.572+0000 7f06dc093640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f06d40d33f0 con 0x7f06d40baed0 2024-05-11T01:01:36.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d9e2f640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f06d40d0000 0x7f06d40d03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47116/0 (socket says 172.21.15.16:47116) 2024-05-11T01:01:36.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d9e2f640 1 -- 172.21.15.16:0/3964809075 learned_addr learned my addr 172.21.15.16:0/3964809075 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:36.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813907946 0 0) 0x7f06d4163820 con 0x7f06d40d0000 2024-05-11T01:01:36.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06c0003520 con 0x7f06d40d0000 2024-05-11T01:01:36.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d962e640 1 --2- 172.21.15.16:0/3964809075 >> v2:172.21.15.174:3300/0 conn(0x7f06d40baed0 0x7f06d4162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:36.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3634148067 0 0) 0x7f06c0003520 con 0x7f06d40d0000 2024-05-11T01:01:36.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 >> v2:172.21.15.174:3300/0 conn(0x7f06d40baed0 msgr2=0x7f06d4162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:36.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 --2- 172.21.15.16:0/3964809075 >> v2:172.21.15.174:3300/0 conn(0x7f06d40baed0 0x7f06d4162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 >> v1:172.21.15.174:6789/0 conn(0x7f06d40d3bf0 legacy=0x7f06d40d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d40d36d0 con 0x7f06d40d0000 2024-05-11T01:01:36.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f06d00016f0 con 0x7f06d40d0000 2024-05-11T01:01:36.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 >> v1:172.21.15.16:6789/0 conn(0x7f06d40d0000 legacy=0x7f06d40d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06c0003a50 0x7f06c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:36.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c0004800 0x7f06c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:36.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c00051c0 0x7f06c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:36.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40d33f0 con 0x7f06c0003a50 2024-05-11T01:01:36.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f06c000c160 con 0x7f06c00051c0 2024-05-11T01:01:36.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f06c000c360 con 0x7f06c0004800 2024-05-11T01:01:36.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.573+0000 7f06d9e2f640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06c0003a50 0x7f06c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:36.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06da630640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c00051c0 0x7f06c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:36.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06d962e640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c0004800 0x7f06c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:36.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06d9e2f640 1 -- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c0004800 msgr2=0x7f06c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06d9e2f640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c0004800 0x7f06c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06d9e2f640 1 -- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c00051c0 msgr2=0x7f06c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06d9e2f640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c00051c0 0x7f06c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06d9e2f640 1 -- 172.21.15.16:0/3964809075 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c0003520 con 0x7f06c0003a50 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06da630640 1 -- 172.21.15.16:0/3964809075 reap_dead start 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06d962e640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06c0004800 0x7f06c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.574+0000 7f06d9e2f640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06c0003a50 0x7f06c0003e70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f06d0001050 tx=0x7f06c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60aa43229193badf server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0007d10 con 0x7f06c0003a50 2024-05-11T01:01:36.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d0005ad0 con 0x7f06c0003a50 2024-05-11T01:01:36.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06d8e2d640 1 -- 172.21.15.16:0/3964809075 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0007070 con 0x7f06c0003a50 2024-05-11T01:01:36.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06dc093640 1 -- 172.21.15.16:0/3964809075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06c0003a50 msgr2=0x7f06c0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06dc093640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06c0003a50 0x7f06c0003e70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f06d0001050 tx=0x7f06c0005830 comp rx=0 tx=0).stop 2024-05-11T01:01:36.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06dc093640 1 -- 172.21.15.16:0/3964809075 shutdown_connections 2024-05-11T01:01:36.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06dc093640 1 --2- 172.21.15.16:0/3964809075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06c0003a50 0x7f06c0003e70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06dc093640 1 -- 172.21.15.16:0/3964809075 >> 172.21.15.16:0/3964809075 conn(0x7f06d4074140 msgr2=0x7f06d40b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:36.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06dc093640 1 -- 172.21.15.16:0/3964809075 shutdown_connections 2024-05-11T01:01:36.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.575+0000 7f06dc093640 1 -- 172.21.15.16:0/3964809075 wait complete. 2024-05-11T01:01:36.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.576+0000 7f06dc093640 1 Processor -- start 2024-05-11T01:01:36.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.576+0000 7f06dc093640 1 -- start start 2024-05-11T01:01:36.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06dc093640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c0003a50 0x7f06d41439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:36.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06dc093640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06d40cc400 0x7f06d41f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:36.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06dc093640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cda40 0x7f06d41f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:36.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06dc093640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06d415f8d0 con 0x7f06d40cda40 2024-05-11T01:01:36.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06dc093640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f06d415f750 con 0x7f06c0003a50 2024-05-11T01:01:36.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06dc093640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f06d40d03e0 con 0x7f06d40cc400 2024-05-11T01:01:36.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06da630640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cda40 0x7f06d41f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:36.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06da630640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cda40 0x7f06d41f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33518/0 (socket says 172.21.15.16:33518) 2024-05-11T01:01:36.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06da630640 1 -- 172.21.15.16:0/3247691249 learned_addr learned my addr 172.21.15.16:0/3247691249 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:36.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06d962e640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06d40cc400 0x7f06d41f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:36.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.577+0000 7f06d9e2f640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c0003a50 0x7f06d41439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:36.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06da630640 1 -- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06d40cc400 msgr2=0x7f06d41f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06da630640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06d40cc400 0x7f06d41f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06da630640 1 -- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c0003a50 msgr2=0x7f06d41439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06da630640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c0003a50 0x7f06d41439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06da630640 1 -- 172.21.15.16:0/3247691249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d40cc9a0 con 0x7f06d40cda40 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06da630640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cda40 0x7f06d41f6850 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00f8b0 tx=0x7f06cc00fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06ca7fc640 1 -- 172.21.15.16:0/3247691249 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc019070 con 0x7f06d40cda40 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06ca7fc640 1 -- 172.21.15.16:0/3247691249 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06cc006d60 con 0x7f06d40cda40 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d40ccc80 con 0x7f06d40cda40 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06ca7fc640 1 -- 172.21.15.16:0/3247691249 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc003bb0 con 0x7f06d40cda40 2024-05-11T01:01:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.578+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d40cd240 con 0x7f06d40cda40 2024-05-11T01:01:36.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.579+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d406a5b0 con 0x7f06d40cda40 2024-05-11T01:01:36.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.580+0000 7f06ca7fc640 1 -- 172.21.15.16:0/3247691249 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06cc0050d0 con 0x7f06d40cda40 2024-05-11T01:01:36.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.580+0000 7f06ca7fc640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06b8076300 0x7f06b80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:36.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.580+0000 7f06ca7fc640 1 -- 172.21.15.16:0/3247691249 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f06cc0966f0 con 0x7f06d40cda40 2024-05-11T01:01:36.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.581+0000 7f06d9e2f640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06b8076300 0x7f06b80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:36.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.581+0000 7f06d9e2f640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06b8076300 0x7f06b80787c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06d0032000 tx=0x7f06d0009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:36.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.585+0000 7f06ca7fc640 1 -- 172.21.15.16:0/3247691249 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06cc05f9f0 con 0x7f06d40cda40 2024-05-11T01:01:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.787+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f06d40d43d0 con 0x7f06d40cda40 2024-05-11T01:01:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.787+0000 7f06ca7fc640 1 -- 172.21.15.16:0/3247691249 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f06cc063cf0 con 0x7f06d40cda40 2024-05-11T01:01:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-05-11T01:01:36.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06b8076300 msgr2=0x7f06b80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06b8076300 0x7f06b80787c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06d0032000 tx=0x7f06d0009030 comp rx=0 tx=0).stop 2024-05-11T01:01:36.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cda40 msgr2=0x7f06d41f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:36.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cda40 0x7f06d41f6850 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00f8b0 tx=0x7f06cc00fd70 comp rx=0 tx=0).stop 2024-05-11T01:01:36.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 shutdown_connections 2024-05-11T01:01:36.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06b8076300 0x7f06b80787c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06d40cda40 0x7f06d41f6850 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06d40cc400 0x7f06d41f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 --2- 172.21.15.16:0/3247691249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06c0003a50 0x7f06d41439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:36.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 >> 172.21.15.16:0/3247691249 conn(0x7f06d4074140 msgr2=0x7f06d40b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:36.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 shutdown_connections 2024-05-11T01:01:36.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:36.789+0000 7f06dc093640 1 -- 172.21.15.16:0/3247691249 wait complete. 2024-05-11T01:01:36.802 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-11T01:01:36.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:36.803 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-11T01:01:36.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:01:36.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:36.832 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-11T01:01:36.892 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:01:36.892 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:36.912 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:01:36.912 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:36.972 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:01:36.972 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:37.029 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-11T01:01:37.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.135+0000 7f8186932640 1 Processor -- start 2024-05-11T01:01:37.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.135+0000 7f8186932640 1 -- start start 2024-05-11T01:01:37.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.135+0000 7f8186932640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f81800cfa80 0x7f81800ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.135+0000 7f8186932640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8180160f90 con 0x7f81800b33e0 2024-05-11T01:01:37.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.135+0000 7f8186932640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8180161270 con 0x7f81801402f0 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.135+0000 7f8186932640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8180161550 con 0x7f81800cfa80 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817f7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f81800b33e0 0x7f81800cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47120/0 (socket says 172.21.15.16:47120) 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817f7fe640 1 -- 172.21.15.16:0/4238219673 learned_addr learned my addr 172.21.15.16:0/4238219673 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 39724404 0 0) 0x7f8180160f90 con 0x7f81800b33e0 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f8184ecf640 1 --2- 172.21.15.16:0/4238219673 >> v2:172.21.15.174:3300/0 conn(0x7f81800cfa80 0x7f81800ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8168003520 con 0x7f81800b33e0 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2607076182 0 0) 0x7f8168003520 con 0x7f81800b33e0 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 >> v2:172.21.15.174:3300/0 conn(0x7f81800cfa80 msgr2=0x7f81800ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 --2- 172.21.15.16:0/4238219673 >> v2:172.21.15.174:3300/0 conn(0x7f81800cfa80 0x7f81800ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 >> v1:172.21.15.174:6789/0 conn(0x7f81801402f0 legacy=0x7f81800b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8180161830 con 0x7f81800b33e0 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f81740016f0 con 0x7f81800b33e0 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 >> v1:172.21.15.16:6789/0 conn(0x7f81800b33e0 legacy=0x7f81800cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8168003a50 0x7f8168003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8168004800 0x7f8168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81680053c0 0x7f816800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8180161550 con 0x7f8168003a50 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f816800c230 con 0x7f8168004800 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f816800c430 con 0x7f81680053c0 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.136+0000 7f817ffff640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8168003a50 0x7f8168003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f817f7fe640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8168004800 0x7f8168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f8184ecf640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81680053c0 0x7f816800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f817ffff640 1 -- 172.21.15.16:0/4238219673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81680053c0 msgr2=0x7f816800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f817ffff640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f81680053c0 0x7f816800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f817ffff640 1 -- 172.21.15.16:0/4238219673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8168004800 msgr2=0x7f8168004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f817ffff640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8168004800 0x7f8168004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f817ffff640 1 -- 172.21.15.16:0/4238219673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8168003520 con 0x7f8168003a50 2024-05-11T01:01:37.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f8184ecf640 1 -- 172.21.15.16:0/4238219673 reap_dead start 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.137+0000 7f817ffff640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8168003a50 0x7f8168003e70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8170001790 tx=0x7f8168005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee98685475752ccd server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81700013b0 con 0x7f8168003a50 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81700052d0 con 0x7f8168003a50 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f817effd640 1 -- 172.21.15.16:0/4238219673 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817002aaa0 con 0x7f8168003a50 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f8186932640 1 -- 172.21.15.16:0/4238219673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8168003a50 msgr2=0x7f8168003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f8186932640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8168003a50 0x7f8168003e70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8170001790 tx=0x7f8168005830 comp rx=0 tx=0).stop 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f8186932640 1 -- 172.21.15.16:0/4238219673 shutdown_connections 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f8186932640 1 --2- 172.21.15.16:0/4238219673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8168003a50 0x7f8168003e70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f8186932640 1 -- 172.21.15.16:0/4238219673 >> 172.21.15.16:0/4238219673 conn(0x7f818006fd90 msgr2=0x7f818006c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f8186932640 1 -- 172.21.15.16:0/4238219673 shutdown_connections 2024-05-11T01:01:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.138+0000 7f8186932640 1 -- 172.21.15.16:0/4238219673 wait complete. 2024-05-11T01:01:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.139+0000 7f8186932640 1 Processor -- start 2024-05-11T01:01:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8186932640 1 -- start start 2024-05-11T01:01:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8186932640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8168003a50 0x7f818013d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8186932640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8180073ec0 0x7f818015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8186932640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818013e9a0 0x7f818013ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8186932640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f81800b3060 con 0x7f818013e9a0 2024-05-11T01:01:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8186932640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81800b2ee0 con 0x7f8180073ec0 2024-05-11T01:01:37.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8186932640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f81800b31e0 con 0x7f8168003a50 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8184ecf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818013e9a0 0x7f818013ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8184ecf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818013e9a0 0x7f818013ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33528/0 (socket says 172.21.15.16:33528) 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.140+0000 7f8184ecf640 1 -- 172.21.15.16:0/512893884 learned_addr learned my addr 172.21.15.16:0/512893884 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f817ffff640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8168003a50 0x7f818013d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f8184ecf640 1 -- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8168003a50 msgr2=0x7f818013d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f8184ecf640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8168003a50 0x7f818013d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f817f7fe640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8180073ec0 0x7f818015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f8184ecf640 1 -- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8180073ec0 msgr2=0x7f818015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f8184ecf640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8180073ec0 0x7f818015a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f8184ecf640 1 -- 172.21.15.16:0/512893884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8180074340 con 0x7f818013e9a0 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f8184ecf640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818013e9a0 0x7f818013ee20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8178011bf0 tx=0x7f817800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f817cff9640 1 -- 172.21.15.16:0/512893884 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817800fe10 con 0x7f818013e9a0 2024-05-11T01:01:37.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f817cff9640 1 -- 172.21.15.16:0/512893884 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8178015430 con 0x7f818013e9a0 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f818013da10 con 0x7f818013e9a0 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f817cff9640 1 -- 172.21.15.16:0/512893884 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8178015820 con 0x7f818013e9a0 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.141+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81801f8f20 con 0x7f818013e9a0 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.142+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818013f360 con 0x7f818013e9a0 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.143+0000 7f817cff9640 1 -- 172.21.15.16:0/512893884 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f81780159c0 con 0x7f818013e9a0 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.143+0000 7f817cff9640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f816c076300 0x7f816c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.144+0000 7f817cff9640 1 -- 172.21.15.16:0/512893884 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f81780982d0 con 0x7f818013e9a0 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.144+0000 7f817ffff640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f816c076300 0x7f816c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.144+0000 7f817ffff640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f816c076300 0x7f816c0787c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8170032000 tx=0x7f817002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:37.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.148+0000 7f817cff9640 1 -- 172.21.15.16:0/512893884 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8178019030 con 0x7f818013e9a0 2024-05-11T01:01:37.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.350+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f818006d0b0 con 0x7f818013e9a0 2024-05-11T01:01:37.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.350+0000 7f817cff9640 1 -- 172.21.15.16:0/512893884 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f8178010040 con 0x7f818013e9a0 2024-05-11T01:01:37.351 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f816c076300 msgr2=0x7f816c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f816c076300 0x7f816c0787c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8170032000 tx=0x7f817002e000 comp rx=0 tx=0).stop 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818013e9a0 msgr2=0x7f818013ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818013e9a0 0x7f818013ee20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8178011bf0 tx=0x7f817800f580 comp rx=0 tx=0).stop 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 shutdown_connections 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f816c076300 0x7f816c0787c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f818013e9a0 0x7f818013ee20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8180073ec0 0x7f818015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 --2- 172.21.15.16:0/512893884 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8168003a50 0x7f818013d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.352+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 >> 172.21.15.16:0/512893884 conn(0x7f818006fd90 msgr2=0x7f81800d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.353+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 shutdown_connections 2024-05-11T01:01:37.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.353+0000 7f8186932640 1 -- 172.21.15.16:0/512893884 wait complete. 2024-05-11T01:01:37.364 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-11T01:01:37.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:37.364 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-11T01:01:37.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:01:37.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:37.395 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-11T01:01:37.462 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:37.462 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:37.479 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:37.479 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:37.535 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:37.535 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:37.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-11T01:01:37.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.735+0000 7fbc6aee1640 1 Processor -- start 2024-05-11T01:01:37.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.735+0000 7fbc6aee1640 1 -- start start 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.736+0000 7fbc6aee1640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbc640b6d70 0x7fbc640b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.736+0000 7fbc6aee1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 0x7fbc6406db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.736+0000 7fbc6aee1640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc64163e90 con 0x7fbc640bac10 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.736+0000 7fbc6aee1640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fbc640cfad0 con 0x7fbc640b6d70 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.736+0000 7fbc6aee1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbc640b7690 con 0x7fbc640d4990 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.736+0000 7fbc63fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbc640bac10 0x7fbc6406d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47124/0 (socket says 172.21.15.16:47124) 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.736+0000 7fbc63fff640 1 -- 172.21.15.16:0/2251954922 learned_addr learned my addr 172.21.15.16:0/2251954922 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc68c7d640 1 --2- 172.21.15.16:0/2251954922 >> v2:172.21.15.174:3300/0 conn(0x7fbc640b6d70 0x7fbc640b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc6947e640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 0x7fbc6406db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606833270 0 0) 0x7fbc64163e90 con 0x7fbc640bac10 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc4c003520 con 0x7fbc640bac10 2024-05-11T01:01:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1227741595 0 0) 0x7fbc4c003520 con 0x7fbc640bac10 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 msgr2=0x7fbc6406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 0x7fbc6406db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 >> v2:172.21.15.174:3300/0 conn(0x7fbc640b6d70 msgr2=0x7fbc640b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 --2- 172.21.15.16:0/2251954922 >> v2:172.21.15.174:3300/0 conn(0x7fbc640b6d70 0x7fbc640b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc64163310 con 0x7fbc640bac10 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fbc580016f0 con 0x7fbc640bac10 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 >> v1:172.21.15.16:6789/0 conn(0x7fbc640bac10 legacy=0x7fbc6406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc4c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c004800 0x7fbc4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 0x7fbc4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbc640cfad0 con 0x7fbc4c003a00 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbc640b7690 con 0x7fbc4c004800 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbc4c00ba40 con 0x7fbc640d4990 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc68c7d640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc4c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc63fff640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c004800 0x7fbc4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc6947e640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 0x7fbc4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc68c7d640 1 -- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 msgr2=0x7fbc4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc68c7d640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 0x7fbc4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc68c7d640 1 -- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c004800 msgr2=0x7fbc4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc68c7d640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc4c004800 0x7fbc4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc68c7d640 1 -- 172.21.15.16:0/2251954922 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4c003520 con 0x7fbc4c003a00 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.737+0000 7fbc6947e640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640d4990 0x7fbc4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.738+0000 7fbc68c7d640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc4c003e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009fc0 tx=0x7fbc4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a0e80e814537cd server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.738+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c009c10 con 0x7fbc4c003a00 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.738+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c036070 con 0x7fbc4c003a00 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.738+0000 7fbc637fe640 1 -- 172.21.15.16:0/2251954922 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c02d070 con 0x7fbc4c003a00 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.739+0000 7fbc6aee1640 1 -- 172.21.15.16:0/2251954922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 msgr2=0x7fbc4c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.739+0000 7fbc6aee1640 1 --2- 172.21.15.16:0/2251954922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc4c003e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009fc0 tx=0x7fbc4c005830 comp rx=0 tx=0).stop 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.739+0000 7fbc6947e640 1 -- 172.21.15.16:0/2251954922 reap_dead start 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.739+0000 7fbc6aee1640 1 -- 172.21.15.16:0/2251954922 shutdown_connections 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.739+0000 7fbc6aee1640 1 -- 172.21.15.16:0/2251954922 >> 172.21.15.16:0/2251954922 conn(0x7fbc64074140 msgr2=0x7fbc640d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.739+0000 7fbc6aee1640 1 -- 172.21.15.16:0/2251954922 shutdown_connections 2024-05-11T01:01:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.739+0000 7fbc6aee1640 1 -- 172.21.15.16:0/2251954922 wait complete. 2024-05-11T01:01:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.740+0000 7fbc6aee1640 1 Processor -- start 2024-05-11T01:01:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.740+0000 7fbc6aee1640 1 -- start start 2024-05-11T01:01:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc6aee1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc641f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc6aee1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640ce060 0x7fbc64161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc6aee1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc64161ca0 0x7fbc640cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc6aee1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbc64163bb0 con 0x7fbc4c003a00 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc6aee1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbc641638d0 con 0x7fbc64161ca0 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc6aee1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6415f830 con 0x7fbc640ce060 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc68c7d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc641f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc68c7d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc641f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33536/0 (socket says 172.21.15.16:33536) 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc68c7d640 1 -- 172.21.15.16:0/1778173176 learned_addr learned my addr 172.21.15.16:0/1778173176 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.741+0000 7fbc6947e640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc64161ca0 0x7fbc640cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc68c7d640 1 -- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640ce060 msgr2=0x7fbc64161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc63fff640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640ce060 0x7fbc64161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc68c7d640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640ce060 0x7fbc64161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc68c7d640 1 -- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc64161ca0 msgr2=0x7fbc640cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc68c7d640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc64161ca0 0x7fbc640cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc68c7d640 1 -- 172.21.15.16:0/1778173176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc641f5f90 con 0x7fbc4c003a00 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc6947e640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc64161ca0 0x7fbc640cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc68c7d640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc641f5a50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e230 tx=0x7fbc5c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc617fa640 1 -- 172.21.15.16:0/1778173176 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c009c10 con 0x7fbc4c003a00 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc617fa640 1 -- 172.21.15.16:0/1778173176 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc5c003bb0 con 0x7fbc4c003a00 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6415fdd0 con 0x7fbc4c003a00 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc617fa640 1 -- 172.21.15.16:0/1778173176 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c004020 con 0x7fbc4c003a00 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.742+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc64160390 con 0x7fbc4c003a00 2024-05-11T01:01:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.743+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc6406a5b0 con 0x7fbc4c003a00 2024-05-11T01:01:37.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.744+0000 7fbc617fa640 1 -- 172.21.15.16:0/1778173176 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbc5c005d10 con 0x7fbc4c003a00 2024-05-11T01:01:37.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.744+0000 7fbc617fa640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbc50076300 0x7fbc500787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:37.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.744+0000 7fbc617fa640 1 -- 172.21.15.16:0/1778173176 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbc5c0b89e0 con 0x7fbc4c003a00 2024-05-11T01:01:37.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.745+0000 7fbc63fff640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbc50076300 0x7fbc500787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:37.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.745+0000 7fbc63fff640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbc50076300 0x7fbc500787c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbc58000ff0 tx=0x7fbc58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:37.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.749+0000 7fbc617fa640 1 -- 172.21.15.16:0/1778173176 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbc641f5f90 con 0x7fbc4c003a00 2024-05-11T01:01:37.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.953+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbc64162080 con 0x7fbc4c003a00 2024-05-11T01:01:37.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.954+0000 7fbc617fa640 1 -- 172.21.15.16:0/1778173176 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fbc5c0823d0 con 0x7fbc4c003a00 2024-05-11T01:01:37.954 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-05-11T01:01:37.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbc50076300 msgr2=0x7fbc500787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbc50076300 0x7fbc500787c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbc58000ff0 tx=0x7fbc58009040 comp rx=0 tx=0).stop 2024-05-11T01:01:37.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 msgr2=0x7fbc641f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc641f5a50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e230 tx=0x7fbc5c009750 comp rx=0 tx=0).stop 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 shutdown_connections 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbc50076300 0x7fbc500787c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc64161ca0 0x7fbc640cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbc640ce060 0x7fbc64161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 --2- 172.21.15.16:0/1778173176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc4c003a00 0x7fbc641f5a50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 >> 172.21.15.16:0/1778173176 conn(0x7fbc64074140 msgr2=0x7fbc640b4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 shutdown_connections 2024-05-11T01:01:37.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:37.956+0000 7fbc6aee1640 1 -- 172.21.15.16:0/1778173176 wait complete. 2024-05-11T01:01:37.967 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-11T01:01:37.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:37.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-11T01:01:37.994 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:01:37.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:37.995 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-11T01:01:38.052 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:01:38.052 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:38.073 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:01:38.073 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:38.133 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:01:38.133 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:38.192 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-11T01:01:38.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.297+0000 7f06621c8640 1 Processor -- start 2024-05-11T01:01:38.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.297+0000 7f06621c8640 1 -- start start 2024-05-11T01:01:38.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.298+0000 7f06621c8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f065c0d4090 0x7f065c0d4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.298+0000 7f06621c8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f065c163e90 con 0x7f065c0b6d70 2024-05-11T01:01:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.298+0000 7f06621c8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f065c163310 con 0x7f065c0bac10 2024-05-11T01:01:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.298+0000 7f06621c8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f065c0cfad0 con 0x7f065c0d4090 2024-05-11T01:01:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.298+0000 7f065bfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f065c0d4090 0x7f065c0d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.298+0000 7f065b7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f065c0b6d70 0x7f065c0b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47140/0 (socket says 172.21.15.16:47140) 2024-05-11T01:01:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.298+0000 7f065b7fe640 1 -- 172.21.15.16:0/1775181783 learned_addr learned my addr 172.21.15.16:0/1775181783 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.299+0000 7f065bfff640 1 -- 172.21.15.16:0/1775181783 >> v1:172.21.15.174:6789/0 conn(0x7f065c0bac10 legacy=0x7f065c0d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.299+0000 7f065bfff640 1 -- 172.21.15.16:0/1775181783 >> v1:172.21.15.16:6789/0 conn(0x7f065c0b6d70 legacy=0x7f065c0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.299+0000 7f065bfff640 1 -- 172.21.15.16:0/1775181783 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c1635f0 con 0x7f065c0d4090 2024-05-11T01:01:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.299+0000 7f065bfff640 1 --2- 172.21.15.16:0/1775181783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0d4090 0x7f065c0d4500 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0654009dc0 tx=0x7f065402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5323243703ecf3f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.299+0000 7f065a7fc640 1 -- 172.21.15.16:0/1775181783 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654007740 con 0x7f065c0d4090 2024-05-11T01:01:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.299+0000 7f065a7fc640 1 -- 172.21.15.16:0/1775181783 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06540078e0 con 0x7f065c0d4090 2024-05-11T01:01:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.299+0000 7f065a7fc640 1 -- 172.21.15.16:0/1775181783 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654007cb0 con 0x7f065c0d4090 2024-05-11T01:01:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.300+0000 7f06621c8640 1 -- 172.21.15.16:0/1775181783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0d4090 msgr2=0x7f065c0d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.300+0000 7f06621c8640 1 --2- 172.21.15.16:0/1775181783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0d4090 0x7f065c0d4500 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0654009dc0 tx=0x7f065402a5f0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.300+0000 7f06621c8640 1 -- 172.21.15.16:0/1775181783 shutdown_connections 2024-05-11T01:01:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.300+0000 7f06621c8640 1 --2- 172.21.15.16:0/1775181783 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0d4090 0x7f065c0d4500 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.300+0000 7f06621c8640 1 -- 172.21.15.16:0/1775181783 >> 172.21.15.16:0/1775181783 conn(0x7f065c074140 msgr2=0x7f065c0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.300+0000 7f06621c8640 1 -- 172.21.15.16:0/1775181783 shutdown_connections 2024-05-11T01:01:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.300+0000 7f06621c8640 1 -- 172.21.15.16:0/1775181783 wait complete. 2024-05-11T01:01:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.301+0000 7f06621c8640 1 Processor -- start 2024-05-11T01:01:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.301+0000 7f06621c8640 1 -- start start 2024-05-11T01:01:38.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f06621c8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c0b6d70 0x7f065c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f06621c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0bac10 0x7f065c0b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f06621c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f065c0d4090 0x7f065c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f06621c8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f065c15f830 con 0x7f065c0bac10 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f06621c8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f065c163bb0 con 0x7f065c0b6d70 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f06621c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f065c162fc0 con 0x7f065c0d4090 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f065affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0bac10 0x7f065c0b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f065affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0bac10 0x7f065c0b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33548/0 (socket says 172.21.15.16:33548) 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f065affd640 1 -- 172.21.15.16:0/1284394851 learned_addr learned my addr 172.21.15.16:0/1284394851 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f065b7fe640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c0b6d70 0x7f065c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.302+0000 7f065bfff640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f065c0d4090 0x7f065c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f065affd640 1 -- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f065c0d4090 msgr2=0x7f065c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f065affd640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f065c0d4090 0x7f065c0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f065affd640 1 -- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c0b6d70 msgr2=0x7f065c14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f065affd640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c0b6d70 0x7f065c14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f065affd640 1 -- 172.21.15.16:0/1284394851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c0cd730 con 0x7f065c0bac10 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f065affd640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0bac10 0x7f065c0b5890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f065000c440 tx=0x7f065000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f0643fff640 1 -- 172.21.15.16:0/1284394851 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650017070 con 0x7f065c0bac10 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f0643fff640 1 -- 172.21.15.16:0/1284394851 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06500035f0 con 0x7f065c0bac10 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c0cda10 con 0x7f065c0bac10 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f0643fff640 1 -- 172.21.15.16:0/1284394851 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06500039e0 con 0x7f065c0bac10 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.303+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c0cdfd0 con 0x7f065c0bac10 2024-05-11T01:01:38.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.304+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c06a5b0 con 0x7f065c0bac10 2024-05-11T01:01:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.305+0000 7f0643fff640 1 -- 172.21.15.16:0/1284394851 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f065001a070 con 0x7f065c0bac10 2024-05-11T01:01:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.305+0000 7f0643fff640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06480762d0 0x7f0648078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.305+0000 7f0643fff640 1 -- 172.21.15.16:0/1284394851 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0650096870 con 0x7f065c0bac10 2024-05-11T01:01:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.306+0000 7f065b7fe640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06480762d0 0x7f0648078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.306+0000 7f065b7fe640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06480762d0 0x7f0648078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f064c000f60 tx=0x7f064c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:38.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.310+0000 7f0643fff640 1 -- 172.21.15.16:0/1284394851 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06500010c0 con 0x7f065c0bac10 2024-05-11T01:01:38.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.513+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f065c0b4a30 con 0x7f065c0bac10 2024-05-11T01:01:38.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.514+0000 7f0643fff640 1 -- 172.21.15.16:0/1284394851 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f0650068250 con 0x7f065c0bac10 2024-05-11T01:01:38.513 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06480762d0 msgr2=0x7f0648078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06480762d0 0x7f0648078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f064c000f60 tx=0x7f064c009040 comp rx=0 tx=0).stop 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0bac10 msgr2=0x7f065c0b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0bac10 0x7f065c0b5890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f065000c440 tx=0x7f065000c900 comp rx=0 tx=0).stop 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 shutdown_connections 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f06480762d0 0x7f0648078790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f065c0d4090 0x7f065c0b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f065c0bac10 0x7f065c0b5890 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 --2- 172.21.15.16:0/1284394851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c0b6d70 0x7f065c14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 >> 172.21.15.16:0/1284394851 conn(0x7f065c074140 msgr2=0x7f065c0ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 shutdown_connections 2024-05-11T01:01:38.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.516+0000 7f06621c8640 1 -- 172.21.15.16:0/1284394851 wait complete. 2024-05-11T01:01:38.527 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-11T01:01:38.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:38.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-11T01:01:38.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:01:38.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:38.559 DEBUG:teuthology.orchestra.run.smithi174:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-11T01:01:38.618 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-11T01:01:38.618 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.723+0000 7f1002378640 1 Processor -- start 2024-05-11T01:01:38.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.723+0000 7f1002378640 1 -- start start 2024-05-11T01:01:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f1002378640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0ffc0bac10 0x7f0ffc0d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f1002378640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0ffc0d3ec0 0x7f0ffc0d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f1002378640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ffc163e90 con 0x7f0ffc0b6d70 2024-05-11T01:01:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f1002378640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0ffc0cfad0 con 0x7f0ffc0bac10 2024-05-11T01:01:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f1002378640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f0ffc163310 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f0ff3fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0ffc0bac10 0x7f0ffc0d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f0ffbfff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0ffc0b6d70 0x7f0ffc0b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47144/0 (socket says 172.21.15.16:47144) 2024-05-11T01:01:38.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f0ffbfff640 1 -- 172.21.15.16:0/256337759 learned_addr learned my addr 172.21.15.16:0/256337759 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:38.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f1000915640 1 --2- 172.21.15.16:0/256337759 >> v2:172.21.15.174:3300/0 conn(0x7f0ffc0d3ec0 0x7f0ffc0d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f0ff3fff640 1 -- 172.21.15.16:0/256337759 >> v2:172.21.15.174:3300/0 conn(0x7f0ffc0d3ec0 msgr2=0x7f0ffc0d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:38.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f0ff3fff640 1 --2- 172.21.15.16:0/256337759 >> v2:172.21.15.174:3300/0 conn(0x7f0ffc0d3ec0 0x7f0ffc0d4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f0ff3fff640 1 -- 172.21.15.16:0/256337759 >> v1:172.21.15.16:6789/0 conn(0x7f0ffc0b6d70 legacy=0x7f0ffc0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f0ff3fff640 1 -- 172.21.15.16:0/256337759 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc1635f0 con 0x7f0ffc0bac10 2024-05-11T01:01:38.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.724+0000 7f1000915640 1 --2- 172.21.15.16:0/256337759 >> v2:172.21.15.174:3300/0 conn(0x7f0ffc0d3ec0 0x7f0ffc0d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:38.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.725+0000 7f0ff3fff640 1 --2- 172.21.15.16:0/256337759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0bac10 0x7f0ffc0d3980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40097a0 tx=0x7f0fe402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0f5e996fdcb1f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:38.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.725+0000 7f0ffb7fe640 1 -- 172.21.15.16:0/256337759 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4037070 con 0x7f0ffc0bac10 2024-05-11T01:01:38.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.725+0000 7f0ffb7fe640 1 -- 172.21.15.16:0/256337759 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fe402ae50 con 0x7f0ffc0bac10 2024-05-11T01:01:38.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.725+0000 7f0ffb7fe640 1 -- 172.21.15.16:0/256337759 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4032660 con 0x7f0ffc0bac10 2024-05-11T01:01:38.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.726+0000 7f1002378640 1 -- 172.21.15.16:0/256337759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0bac10 msgr2=0x7f0ffc0d3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.726+0000 7f1002378640 1 --2- 172.21.15.16:0/256337759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0bac10 0x7f0ffc0d3980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40097a0 tx=0x7f0fe402a140 comp rx=0 tx=0).stop 2024-05-11T01:01:38.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.726+0000 7f1002378640 1 -- 172.21.15.16:0/256337759 shutdown_connections 2024-05-11T01:01:38.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.726+0000 7f1002378640 1 --2- 172.21.15.16:0/256337759 >> v2:172.21.15.174:3300/0 conn(0x7f0ffc0d3ec0 0x7f0ffc0d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.726+0000 7f1002378640 1 --2- 172.21.15.16:0/256337759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0bac10 0x7f0ffc0d3980 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.726+0000 7f1002378640 1 -- 172.21.15.16:0/256337759 >> 172.21.15.16:0/256337759 conn(0x7f0ffc074140 msgr2=0x7f0ffc0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:38.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.726+0000 7f1002378640 1 -- 172.21.15.16:0/256337759 shutdown_connections 2024-05-11T01:01:38.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.726+0000 7f1002378640 1 -- 172.21.15.16:0/256337759 wait complete. 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.727+0000 7f1002378640 1 Processor -- start 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.727+0000 7f1002378640 1 -- start start 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1002378640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ffc0b6d70 0x7f0ffc1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1002378640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ffc0bac10 0x7f0ffc0b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1002378640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0d3ec0 0x7f0ffc0b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1002378640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc15f830 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1002378640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc163bb0 con 0x7f0ffc0b6d70 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1002378640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0ffc162fc0 con 0x7f0ffc0bac10 2024-05-11T01:01:38.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0d3ec0 0x7f0ffc0b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0d3ec0 0x7f0ffc0b9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33560/0 (socket says 172.21.15.16:33560) 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 -- 172.21.15.16:0/3009640931 learned_addr learned my addr 172.21.15.16:0/3009640931 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 -- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ffc0bac10 msgr2=0x7f0ffc0b93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ffc0bac10 0x7f0ffc0b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 -- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ffc0b6d70 msgr2=0x7f0ffc1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ffc0b6d70 0x7f0ffc1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 -- 172.21.15.16:0/3009640931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc1f8c10 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1000915640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0d3ec0 0x7f0ffc0b9930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400cef0 tx=0x7f0ff400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f0ff97fa640 1 -- 172.21.15.16:0/3009640931 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff401a070 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f0ff97fa640 1 -- 172.21.15.16:0/3009640931 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff400d860 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f0ff97fa640 1 -- 172.21.15.16:0/3009640931 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400dc50 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ffc1f8ef0 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.728+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ffc1f94b0 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.729+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ffc06a5b0 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.730+0000 7f0ff97fa640 1 -- 172.21.15.16:0/3009640931 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ff401d070 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.731+0000 7f0ff97fa640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fdc0762d0 0x7f0fdc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.731+0000 7f0ff97fa640 1 -- 172.21.15.16:0/3009640931 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0ff4097e60 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.731+0000 7f0ffbfff640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fdc0762d0 0x7f0fdc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:38.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.731+0000 7f0ffbfff640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fdc0762d0 0x7f0fdc078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0fec001540 tx=0x7f0fec007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.735+0000 7f0ff97fa640 1 -- 172.21.15.16:0/3009640931 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ff4061880 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.967+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ffc1542a0 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.968+0000 7f0ff97fa640 1 -- 172.21.15.16:0/3009640931 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5178 (secure 0 0 0) 0x7f0ff4061180 con 0x7f0ffc0d3ec0 2024-05-11T01:01:38.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:38.968 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:09.046368+0000","modified":"2024-05-11T01:01:12.033345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-11T01:01:38.968 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-05-11T01:01:38.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fdc0762d0 msgr2=0x7f0fdc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fdc0762d0 0x7f0fdc078790 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0fec001540 tx=0x7f0fec007a40 comp rx=0 tx=0).stop 2024-05-11T01:01:38.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0d3ec0 msgr2=0x7f0ffc0b9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0d3ec0 0x7f0ffc0b9930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400cef0 tx=0x7f0ff400a710 comp rx=0 tx=0).stop 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 shutdown_connections 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fdc0762d0 0x7f0fdc078790 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ffc0d3ec0 0x7f0ffc0b9930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0ffc0bac10 0x7f0ffc0b93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 --2- 172.21.15.16:0/3009640931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ffc0b6d70 0x7f0ffc1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 >> 172.21.15.16:0/3009640931 conn(0x7f0ffc074140 msgr2=0x7f0ffc0b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 shutdown_connections 2024-05-11T01:01:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:38.970+0000 7f1002378640 1 -- 172.21.15.16:0/3009640931 wait complete. 2024-05-11T01:01:38.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.085+0000 7f5fd011c640 1 Processor -- start 2024-05-11T01:01:39.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.085+0000 7f5fd011c640 1 -- start start 2024-05-11T01:01:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fd011c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5fc80b2f40 0x7f5fc8142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fd011c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5fc80b3320 0x7f5fc815fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fd011c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fc81601d0 con 0x7f5fc813f850 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fd011c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc8160470 con 0x7f5fc80b2f40 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fd011c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f5fc8160750 con 0x7f5fc80b3320 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fcdeb8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5fc80b2f40 0x7f5fc8142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fcdeb8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5fc80b2f40 0x7f5fc8142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33574/0 (socket says 172.21.15.16:33574) 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fcdeb8640 1 -- 172.21.15.16:0/2053629881 learned_addr learned my addr 172.21.15.16:0/2053629881 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fcd6b7640 1 --2- 172.21.15.16:0/2053629881 >> v2:172.21.15.174:3300/0 conn(0x7f5fc80b3320 0x7f5fc815fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fcdeb8640 1 -- 172.21.15.16:0/2053629881 >> v2:172.21.15.174:3300/0 conn(0x7f5fc80b3320 msgr2=0x7f5fc815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fcdeb8640 1 --2- 172.21.15.16:0/2053629881 >> v2:172.21.15.174:3300/0 conn(0x7f5fc80b3320 0x7f5fc815fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fcdeb8640 1 -- 172.21.15.16:0/2053629881 >> v1:172.21.15.174:6789/0 conn(0x7f5fc813f850 legacy=0x7f5fc8073dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:39.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.086+0000 7f5fcdeb8640 1 -- 172.21.15.16:0/2053629881 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc8160a30 con 0x7f5fc80b2f40 2024-05-11T01:01:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.087+0000 7f5fcdeb8640 1 --2- 172.21.15.16:0/2053629881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b2f40 0x7f5fc8142440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80704e0 tx=0x7f5fc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68969fa74f689ed server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.087+0000 7f5fcceb6640 1 -- 172.21.15.16:0/2053629881 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4037070 con 0x7f5fc80b2f40 2024-05-11T01:01:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.087+0000 7f5fcceb6640 1 -- 172.21.15.16:0/2053629881 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc4032440 con 0x7f5fc80b2f40 2024-05-11T01:01:39.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.087+0000 7f5fcceb6640 1 -- 172.21.15.16:0/2053629881 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4032810 con 0x7f5fc80b2f40 2024-05-11T01:01:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.088+0000 7f5fd011c640 1 -- 172.21.15.16:0/2053629881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b2f40 msgr2=0x7f5fc8142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.088+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2053629881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b2f40 0x7f5fc8142440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80704e0 tx=0x7f5fc402a270 comp rx=0 tx=0).stop 2024-05-11T01:01:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.088+0000 7f5fd011c640 1 -- 172.21.15.16:0/2053629881 shutdown_connections 2024-05-11T01:01:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.088+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2053629881 >> v2:172.21.15.174:3300/0 conn(0x7f5fc80b3320 0x7f5fc815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.088+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2053629881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b2f40 0x7f5fc8142440 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.088+0000 7f5fd011c640 1 -- 172.21.15.16:0/2053629881 >> 172.21.15.16:0/2053629881 conn(0x7f5fc806fd90 msgr2=0x7f5fc806c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.088+0000 7f5fd011c640 1 -- 172.21.15.16:0/2053629881 shutdown_connections 2024-05-11T01:01:39.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.088+0000 7f5fd011c640 1 -- 172.21.15.16:0/2053629881 wait complete. 2024-05-11T01:01:39.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.089+0000 7f5fd011c640 1 Processor -- start 2024-05-11T01:01:39.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.089+0000 7f5fd011c640 1 -- start start 2024-05-11T01:01:39.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fd011c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fc80b2f40 0x7f5fc813e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fd011c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b3320 0x7f5fc80b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fd011c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5fc813f850 0x7f5fc80aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fd011c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc8074660 con 0x7f5fc80b3320 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fd011c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc80744e0 con 0x7f5fc813f850 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fd011c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc813fca0 con 0x7f5fc80b2f40 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcd6b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b3320 0x7f5fc80b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcd6b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b3320 0x7f5fc80b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33588/0 (socket says 172.21.15.16:33588) 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcd6b7640 1 -- 172.21.15.16:0/2843006869 learned_addr learned my addr 172.21.15.16:0/2843006869 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcdeb8640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fc80b2f40 0x7f5fc813e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcd6b7640 1 -- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fc80b2f40 msgr2=0x7f5fc813e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcd6b7640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fc80b2f40 0x7f5fc813e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcd6b7640 1 -- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5fc813f850 msgr2=0x7f5fc80aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcd6b7640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5fc813f850 0x7f5fc80aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.090+0000 7f5fcd6b7640 1 -- 172.21.15.16:0/2843006869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc813ec60 con 0x7f5fc80b3320 2024-05-11T01:01:39.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.091+0000 7f5fcd6b7640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b3320 0x7f5fc80b1c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800d830 tx=0x7f5fb800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.091+0000 7f5fbe7fc640 1 -- 172.21.15.16:0/2843006869 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800b6c0 con 0x7f5fc80b3320 2024-05-11T01:01:39.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.091+0000 7f5fbe7fc640 1 -- 172.21.15.16:0/2843006869 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb8019070 con 0x7f5fc80b3320 2024-05-11T01:01:39.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.091+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc80ae020 con 0x7f5fc80b3320 2024-05-11T01:01:39.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.091+0000 7f5fbe7fc640 1 -- 172.21.15.16:0/2843006869 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800ba80 con 0x7f5fc80b3320 2024-05-11T01:01:39.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.091+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc80b2450 con 0x7f5fc80b3320 2024-05-11T01:01:39.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.092+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc806a5b0 con 0x7f5fc80b3320 2024-05-11T01:01:39.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.092+0000 7f5fbe7fc640 1 -- 172.21.15.16:0/2843006869 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5fb801e460 con 0x7f5fc80b3320 2024-05-11T01:01:39.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.093+0000 7f5fbe7fc640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5fac0762d0 0x7f5fac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.093+0000 7f5fbe7fc640 1 -- 172.21.15.16:0/2843006869 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5fb8097cf0 con 0x7f5fc80b3320 2024-05-11T01:01:39.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.093+0000 7f5fcdeb8640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5fac0762d0 0x7f5fac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.094+0000 7f5fcdeb8640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5fac0762d0 0x7f5fac078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4034000 tx=0x7f5fc402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.098+0000 7f5fbe7fc640 1 -- 172.21.15.16:0/2843006869 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5fb8061640 con 0x7f5fc80b3320 2024-05-11T01:01:39.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.328+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5fc8142380 con 0x7f5fc80b3320 2024-05-11T01:01:39.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.329+0000 7f5fbe7fc640 1 -- 172.21.15.16:0/2843006869 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5178 (secure 0 0 0) 0x7f5fb8060f40 con 0x7f5fc80b3320 2024-05-11T01:01:39.329 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:39.329 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:09.046368+0000","modified":"2024-05-11T01:01:12.033345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-11T01:01:39.329 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-05-11T01:01:39.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5fac0762d0 msgr2=0x7f5fac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5fac0762d0 0x7f5fac078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4034000 tx=0x7f5fc402e000 comp rx=0 tx=0).stop 2024-05-11T01:01:39.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b3320 msgr2=0x7f5fc80b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b3320 0x7f5fc80b1c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800d830 tx=0x7f5fb800dcf0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 shutdown_connections 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f5fac0762d0 0x7f5fac078790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5fc813f850 0x7f5fc80aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fc80b3320 0x7f5fc80b1c70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 --2- 172.21.15.16:0/2843006869 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5fc80b2f40 0x7f5fc813e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 >> 172.21.15.16:0/2843006869 conn(0x7f5fc806fd90 msgr2=0x7f5fc80b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 shutdown_connections 2024-05-11T01:01:39.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.331+0000 7f5fd011c640 1 -- 172.21.15.16:0/2843006869 wait complete. 2024-05-11T01:01:39.343 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:39.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.446+0000 7fce56551640 1 Processor -- start 2024-05-11T01:01:39.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.446+0000 7fce56551640 1 -- start start 2024-05-11T01:01:39.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.447+0000 7fce56551640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fce5015f960 0x7fce501639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.447+0000 7fce56551640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5015fde0 con 0x7fce500b0ec0 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.447+0000 7fce56551640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce501600c0 con 0x7fce500b4ea0 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.447+0000 7fce56551640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fce501609f0 con 0x7fce5015f960 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.447+0000 7fce4ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fce500b0ec0 0x7fce500b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47158/0 (socket says 172.21.15.16:47158) 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.447+0000 7fce4ffff640 1 -- 172.21.15.16:0/2653178826 learned_addr learned my addr 172.21.15.16:0/2653178826 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.447+0000 7fce4f7fe640 1 --2- 172.21.15.16:0/2653178826 >> v2:172.21.15.174:3300/0 conn(0x7fce5015f960 0x7fce501639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.447+0000 7fce4effd640 1 -- 172.21.15.16:0/2653178826 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916224834 0 0) 0x7fce5015fde0 con 0x7fce500b0ec0 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.448+0000 7fce4effd640 1 -- 172.21.15.16:0/2653178826 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce38003520 con 0x7fce500b0ec0 2024-05-11T01:01:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.448+0000 7fce4effd640 1 -- 172.21.15.16:0/2653178826 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466288751 0 0) 0x7fce501600c0 con 0x7fce500b4ea0 2024-05-11T01:01:39.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.448+0000 7fce4effd640 1 -- 172.21.15.16:0/2653178826 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce5015fde0 con 0x7fce500b4ea0 2024-05-11T01:01:39.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.448+0000 7fce4f7fe640 1 -- 172.21.15.16:0/2653178826 >> v1:172.21.15.174:6789/0 conn(0x7fce500b4ea0 legacy=0x7fce5006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.448+0000 7fce4f7fe640 1 -- 172.21.15.16:0/2653178826 >> v1:172.21.15.16:6789/0 conn(0x7fce500b0ec0 legacy=0x7fce500b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.448+0000 7fce4f7fe640 1 -- 172.21.15.16:0/2653178826 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce501603a0 con 0x7fce5015f960 2024-05-11T01:01:39.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.448+0000 7fce4f7fe640 1 --2- 172.21.15.16:0/2653178826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 0x7fce501639b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce440097a0 tx=0x7fce4402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb772f7ecddebdc server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce4effd640 1 -- 172.21.15.16:0/2653178826 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44037070 con 0x7fce5015f960 2024-05-11T01:01:39.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce4effd640 1 -- 172.21.15.16:0/2653178826 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce44032440 con 0x7fce5015f960 2024-05-11T01:01:39.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce4effd640 1 -- 172.21.15.16:0/2653178826 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4402ae60 con 0x7fce5015f960 2024-05-11T01:01:39.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce56551640 1 -- 172.21.15.16:0/2653178826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 msgr2=0x7fce501639b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce56551640 1 --2- 172.21.15.16:0/2653178826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 0x7fce501639b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce440097a0 tx=0x7fce4402a110 comp rx=0 tx=0).stop 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce56551640 1 -- 172.21.15.16:0/2653178826 shutdown_connections 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce56551640 1 --2- 172.21.15.16:0/2653178826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 0x7fce501639b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce56551640 1 -- 172.21.15.16:0/2653178826 >> 172.21.15.16:0/2653178826 conn(0x7fce500d17a0 msgr2=0x7fce500d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce56551640 1 -- 172.21.15.16:0/2653178826 shutdown_connections 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.449+0000 7fce56551640 1 -- 172.21.15.16:0/2653178826 wait complete. 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.450+0000 7fce56551640 1 Processor -- start 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.451+0000 7fce56551640 1 -- start start 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.451+0000 7fce56551640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce500b0ec0 0x7fce50157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.451+0000 7fce56551640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500b4ea0 0x7fce50145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.451+0000 7fce56551640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 0x7fce50145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.451+0000 7fce56551640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fce5006ce20 con 0x7fce500b0ec0 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.451+0000 7fce56551640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fce500709b0 con 0x7fce5015f960 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.451+0000 7fce56551640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fce5006cfa0 con 0x7fce500b4ea0 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.451+0000 7fce4ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce500b0ec0 0x7fce50157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce500b0ec0 0x7fce50157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33596/0 (socket says 172.21.15.16:33596) 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4ffff640 1 -- 172.21.15.16:0/1907149261 learned_addr learned my addr 172.21.15.16:0/1907149261 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce54aee640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 0x7fce50145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4ffff640 1 -- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500b4ea0 msgr2=0x7fce50145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4ffff640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500b4ea0 0x7fce50145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4ffff640 1 -- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 msgr2=0x7fce50145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4ffff640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 0x7fce50145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4ffff640 1 -- 172.21.15.16:0/1907149261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce50145580 con 0x7fce500b0ec0 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce54aee640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 0x7fce50145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:39.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4ffff640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce500b0ec0 0x7fce50157670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c4d0 tx=0x7fce4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4cff9640 1 -- 172.21.15.16:0/1907149261 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40017070 con 0x7fce500b0ec0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4cff9640 1 -- 172.21.15.16:0/1907149261 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce40005ce0 con 0x7fce500b0ec0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce50146030 con 0x7fce500b0ec0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce4cff9640 1 -- 172.21.15.16:0/1907149261 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40007270 con 0x7fce500b0ec0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.452+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce501465f0 con 0x7fce500b0ec0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.453+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5006a5b0 con 0x7fce500b0ec0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.454+0000 7fce4cff9640 1 -- 172.21.15.16:0/1907149261 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce4001a070 con 0x7fce500b0ec0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.454+0000 7fce4cff9640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fce3c0762d0 0x7fce3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.454+0000 7fce4cff9640 1 -- 172.21.15.16:0/1907149261 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fce40096820 con 0x7fce500b0ec0 2024-05-11T01:01:39.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.455+0000 7fce4f7fe640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fce3c0762d0 0x7fce3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.455+0000 7fce4f7fe640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fce3c0762d0 0x7fce3c078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce44034000 tx=0x7fce4402c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.459+0000 7fce4cff9640 1 -- 172.21.15.16:0/1907149261 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce4005fbc0 con 0x7fce500b0ec0 2024-05-11T01:01:39.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.649+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce500d1d90 con 0x7fce500b0ec0 2024-05-11T01:01:39.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.650+0000 7fce4cff9640 1 -- 172.21.15.16:0/1907149261 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fce40068030 con 0x7fce500b0ec0 2024-05-11T01:01:39.651 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:39.651 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:10.636137+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fce3c0762d0 msgr2=0x7fce3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fce3c0762d0 0x7fce3c078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce44034000 tx=0x7fce4402c000 comp rx=0 tx=0).stop 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce500b0ec0 msgr2=0x7fce50157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce500b0ec0 0x7fce50157670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c4d0 tx=0x7fce4000c990 comp rx=0 tx=0).stop 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 shutdown_connections 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fce3c0762d0 0x7fce3c078790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce5015f960 0x7fce50145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fce500b4ea0 0x7fce50145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 --2- 172.21.15.16:0/1907149261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce500b0ec0 0x7fce50157670 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 >> 172.21.15.16:0/1907149261 conn(0x7fce500d17a0 msgr2=0x7fce5015e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 shutdown_connections 2024-05-11T01:01:39.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.652+0000 7fce56551640 1 -- 172.21.15.16:0/1907149261 wait complete. 2024-05-11T01:01:39.664 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-11T01:01:39.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:39.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.768+0000 7f8c22bc9640 1 Processor -- start 2024-05-11T01:01:39.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.769+0000 7f8c22bc9640 1 -- start start 2024-05-11T01:01:39.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.769+0000 7f8c22bc9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d1400 0x7f8c1c0cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.769+0000 7f8c22bc9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c1c0cf510 con 0x7f8c1c0d18b0 2024-05-11T01:01:39.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.769+0000 7f8c22bc9640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c1c0cd810 con 0x7f8c1c1609b0 2024-05-11T01:01:39.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.769+0000 7f8c22bc9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c0cdaf0 con 0x7f8c1c0d1400 2024-05-11T01:01:39.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.769+0000 7f8c1bfff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8c1c0d18b0 0x7f8c1c0d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47162/0 (socket says 172.21.15.16:47162) 2024-05-11T01:01:39.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.769+0000 7f8c1bfff640 1 -- 172.21.15.16:0/2888645531 learned_addr learned my addr 172.21.15.16:0/2888645531 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:39.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.770+0000 7f8c21166640 1 --2- 172.21.15.16:0/2888645531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d1400 0x7f8c1c0cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.770+0000 7f8c1b7fe640 1 -- 172.21.15.16:0/2888645531 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938920613 0 0) 0x7f8c1c0cf510 con 0x7f8c1c0d18b0 2024-05-11T01:01:39.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.770+0000 7f8c1b7fe640 1 -- 172.21.15.16:0/2888645531 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c04003520 con 0x7f8c1c0d18b0 2024-05-11T01:01:39.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.770+0000 7f8c1b7fe640 1 -- 172.21.15.16:0/2888645531 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207656741 0 0) 0x7f8c1c0cd810 con 0x7f8c1c1609b0 2024-05-11T01:01:39.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.770+0000 7f8c21166640 1 -- 172.21.15.16:0/2888645531 >> v1:172.21.15.174:6789/0 conn(0x7f8c1c1609b0 legacy=0x7f8c1c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.770+0000 7f8c21166640 1 -- 172.21.15.16:0/2888645531 >> v1:172.21.15.16:6789/0 conn(0x7f8c1c0d18b0 legacy=0x7f8c1c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.770+0000 7f8c21166640 1 -- 172.21.15.16:0/2888645531 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c161cb0 con 0x7f8c1c0d1400 2024-05-11T01:01:39.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.771+0000 7f8c21166640 1 --2- 172.21.15.16:0/2888645531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d1400 0x7f8c1c0cf9f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0097d0 tx=0x7f8c0c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2538c93ad19d76d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.771+0000 7f8c1b7fe640 1 -- 172.21.15.16:0/2888645531 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037070 con 0x7f8c1c0d1400 2024-05-11T01:01:39.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.771+0000 7f8c1b7fe640 1 -- 172.21.15.16:0/2888645531 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c02ac10 con 0x7f8c1c0d1400 2024-05-11T01:01:39.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.771+0000 7f8c1b7fe640 1 -- 172.21.15.16:0/2888645531 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c100016f0 con 0x7f8c1c0d1400 2024-05-11T01:01:39.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.772+0000 7f8c22bc9640 1 -- 172.21.15.16:0/2888645531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d1400 msgr2=0x7f8c1c0cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.772+0000 7f8c22bc9640 1 --2- 172.21.15.16:0/2888645531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d1400 0x7f8c1c0cf9f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0097d0 tx=0x7f8c0c02a180 comp rx=0 tx=0).stop 2024-05-11T01:01:39.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.772+0000 7f8c22bc9640 1 -- 172.21.15.16:0/2888645531 shutdown_connections 2024-05-11T01:01:39.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.772+0000 7f8c22bc9640 1 --2- 172.21.15.16:0/2888645531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d1400 0x7f8c1c0cf9f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.772+0000 7f8c22bc9640 1 -- 172.21.15.16:0/2888645531 >> 172.21.15.16:0/2888645531 conn(0x7f8c1c072b60 msgr2=0x7f8c1c0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:39.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.772+0000 7f8c22bc9640 1 -- 172.21.15.16:0/2888645531 shutdown_connections 2024-05-11T01:01:39.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.772+0000 7f8c22bc9640 1 -- 172.21.15.16:0/2888645531 wait complete. 2024-05-11T01:01:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.773+0000 7f8c22bc9640 1 Processor -- start 2024-05-11T01:01:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.773+0000 7f8c22bc9640 1 -- start start 2024-05-11T01:01:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c22bc9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c1c0d1400 0x7f8c1c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c22bc9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d18b0 0x7f8c1c0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c22bc9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c1c1609b0 0x7f8c1c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c22bc9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c1619c0 con 0x7f8c1c1609b0 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c22bc9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c161840 con 0x7f8c1c0d1400 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c22bc9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c0d2a40 con 0x7f8c1c0d18b0 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c21166640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c1c1609b0 0x7f8c1c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c21166640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c1c1609b0 0x7f8c1c1544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33604/0 (socket says 172.21.15.16:33604) 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c21166640 1 -- 172.21.15.16:0/3917907852 learned_addr learned my addr 172.21.15.16:0/3917907852 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c20965640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c1c0d1400 0x7f8c1c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c1bfff640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d18b0 0x7f8c1c0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c21166640 1 -- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d18b0 msgr2=0x7f8c1c0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c21166640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d18b0 0x7f8c1c0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c21166640 1 -- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c1c0d1400 msgr2=0x7f8c1c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c21166640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c1c0d1400 0x7f8c1c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c21166640 1 -- 172.21.15.16:0/3917907852 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c0b3f10 con 0x7f8c1c1609b0 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.774+0000 7f8c20965640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c1c0d1400 0x7f8c1c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:39.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.775+0000 7f8c21166640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c1c1609b0 0x7f8c1c1544b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0097d0 tx=0x7f8c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.775+0000 7f8c197fa640 1 -- 172.21.15.16:0/3917907852 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c042070 con 0x7f8c1c1609b0 2024-05-11T01:01:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.775+0000 7f8c197fa640 1 -- 172.21.15.16:0/3917907852 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c03e460 con 0x7f8c1c1609b0 2024-05-11T01:01:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.775+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c0b4250 con 0x7f8c1c1609b0 2024-05-11T01:01:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.775+0000 7f8c197fa640 1 -- 172.21.15.16:0/3917907852 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037040 con 0x7f8c1c1609b0 2024-05-11T01:01:39.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.775+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c0b4a90 con 0x7f8c1c1609b0 2024-05-11T01:01:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.776+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c06a5b0 con 0x7f8c1c1609b0 2024-05-11T01:01:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.776+0000 7f8c197fa640 1 -- 172.21.15.16:0/3917907852 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c0c045070 con 0x7f8c1c1609b0 2024-05-11T01:01:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.777+0000 7f8c197fa640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8c080762d0 0x7f8c08078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.777+0000 7f8c197fa640 1 -- 172.21.15.16:0/3917907852 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c0c0b7bc0 con 0x7f8c1c1609b0 2024-05-11T01:01:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.777+0000 7f8c20965640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8c080762d0 0x7f8c08078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:39.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.778+0000 7f8c20965640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8c080762d0 0x7f8c08078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c14007fd0 tx=0x7f8c14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:39.782+0000 7f8c197fa640 1 -- 172.21.15.16:0/3917907852 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c1c0b4250 con 0x7f8c1c1609b0 2024-05-11T01:01:40.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.011+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c1c0d1d70 con 0x7f8c1c1609b0 2024-05-11T01:01:40.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.012+0000 7f8c197fa640 1 -- 172.21.15.16:0/3917907852 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5178 (secure 0 0 0) 0x7f8c0c081520 con 0x7f8c1c1609b0 2024-05-11T01:01:40.012 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:40.012 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:09.046368+0000","modified":"2024-05-11T01:01:12.033345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-11T01:01:40.012 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-05-11T01:01:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8c080762d0 msgr2=0x7f8c08078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8c080762d0 0x7f8c08078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c14007fd0 tx=0x7f8c14009040 comp rx=0 tx=0).stop 2024-05-11T01:01:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c1c1609b0 msgr2=0x7f8c1c1544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c1c1609b0 0x7f8c1c1544b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c0097d0 tx=0x7f8c0c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 shutdown_connections 2024-05-11T01:01:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8c080762d0 0x7f8c08078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c1c1609b0 0x7f8c1c1544b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8c1c0d18b0 0x7f8c1c0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 --2- 172.21.15.16:0/3917907852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c1c0d1400 0x7f8c1c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 >> 172.21.15.16:0/3917907852 conn(0x7f8c1c072b60 msgr2=0x7f8c1c0b66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 shutdown_connections 2024-05-11T01:01:40.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.014+0000 7f8c22bc9640 1 -- 172.21.15.16:0/3917907852 wait complete. 2024-05-11T01:01:40.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:40.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.128+0000 7f35af79e640 1 Processor -- start 2024-05-11T01:01:40.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.129+0000 7f35af79e640 1 -- start start 2024-05-11T01:01:40.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.129+0000 7f35af79e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f35a80baed0 0x7f35a8162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.129+0000 7f35af79e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a8163820 con 0x7f35a80d3bf0 2024-05-11T01:01:40.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f35af79e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a8163b00 con 0x7f35a80d0000 2024-05-11T01:01:40.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f35af79e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f35a80d33f0 con 0x7f35a80baed0 2024-05-11T01:01:40.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f35acd39640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f35a80baed0 0x7f35a8162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f35add3b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f35a80d3bf0 0x7f35a80d4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47168/0 (socket says 172.21.15.16:47168) 2024-05-11T01:01:40.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f35add3b640 1 -- 172.21.15.16:0/433039469 learned_addr learned my addr 172.21.15.16:0/433039469 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:40.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f359ffff640 1 -- 172.21.15.16:0/433039469 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551364703 0 0) 0x7f35a8163820 con 0x7f35a80d3bf0 2024-05-11T01:01:40.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f359ffff640 1 -- 172.21.15.16:0/433039469 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3594003520 con 0x7f35a80d3bf0 2024-05-11T01:01:40.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f35acd39640 1 -- 172.21.15.16:0/433039469 >> v1:172.21.15.174:6789/0 conn(0x7f35a80d0000 legacy=0x7f35a80d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f35acd39640 1 -- 172.21.15.16:0/433039469 >> v1:172.21.15.16:6789/0 conn(0x7f35a80d3bf0 legacy=0x7f35a80d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.130+0000 7f35acd39640 1 -- 172.21.15.16:0/433039469 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a80d36d0 con 0x7f35a80baed0 2024-05-11T01:01:40.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.131+0000 7f35acd39640 1 --2- 172.21.15.16:0/433039469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a8162fd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35980097a0 tx=0x7f359802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c78cfc54d76036 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.131+0000 7f359ffff640 1 -- 172.21.15.16:0/433039469 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598037070 con 0x7f35a80baed0 2024-05-11T01:01:40.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.131+0000 7f359ffff640 1 -- 172.21.15.16:0/433039469 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3598032440 con 0x7f35a80baed0 2024-05-11T01:01:40.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.131+0000 7f359ffff640 1 -- 172.21.15.16:0/433039469 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3598032810 con 0x7f35a80baed0 2024-05-11T01:01:40.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.131+0000 7f35af79e640 1 -- 172.21.15.16:0/433039469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 msgr2=0x7f35a8162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.131+0000 7f35af79e640 1 --2- 172.21.15.16:0/433039469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a8162fd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35980097a0 tx=0x7f359802a230 comp rx=0 tx=0).stop 2024-05-11T01:01:40.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.131+0000 7f35af79e640 1 -- 172.21.15.16:0/433039469 shutdown_connections 2024-05-11T01:01:40.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.131+0000 7f35af79e640 1 --2- 172.21.15.16:0/433039469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a8162fd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.132+0000 7f35af79e640 1 -- 172.21.15.16:0/433039469 >> 172.21.15.16:0/433039469 conn(0x7f35a8074140 msgr2=0x7f35a80b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:40.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.132+0000 7f35af79e640 1 -- 172.21.15.16:0/433039469 shutdown_connections 2024-05-11T01:01:40.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.132+0000 7f35af79e640 1 -- 172.21.15.16:0/433039469 wait complete. 2024-05-11T01:01:40.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.133+0000 7f35af79e640 1 Processor -- start 2024-05-11T01:01:40.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.133+0000 7f35af79e640 1 -- start start 2024-05-11T01:01:40.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35af79e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a81e8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35af79e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a80d0000 0x7f35a81548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35af79e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a80d3bf0 0x7f35a80cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35af79e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f35a815f750 con 0x7f35a80baed0 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35af79e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f35a8163de0 con 0x7f35a80d3bf0 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35af79e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f35a815f8d0 con 0x7f35a80d0000 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a81e8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a81e8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33616/0 (socket says 172.21.15.16:33616) 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 -- 172.21.15.16:0/2068626280 learned_addr learned my addr 172.21.15.16:0/2068626280 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35add3b640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a80d3bf0 0x7f35a80cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35acd39640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a80d0000 0x7f35a81548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 -- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a80d0000 msgr2=0x7f35a81548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a80d0000 0x7f35a81548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 -- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a80d3bf0 msgr2=0x7f35a80cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a80d3bf0 0x7f35a80cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 -- 172.21.15.16:0/2068626280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a81e91b0 con 0x7f35a80baed0 2024-05-11T01:01:40.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35add3b640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a80d3bf0 0x7f35a80cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:40.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35ad53a640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a81e8c70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f35a400c450 tx=0x7f35a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f359dffb640 1 -- 172.21.15.16:0/2068626280 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a40052d0 con 0x7f35a80baed0 2024-05-11T01:01:40.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f359dffb640 1 -- 172.21.15.16:0/2068626280 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a4005470 con 0x7f35a80baed0 2024-05-11T01:01:40.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a81e9450 con 0x7f35a80baed0 2024-05-11T01:01:40.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.134+0000 7f359dffb640 1 -- 172.21.15.16:0/2068626280 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4012870 con 0x7f35a80baed0 2024-05-11T01:01:40.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.135+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a81e9a10 con 0x7f35a80baed0 2024-05-11T01:01:40.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.136+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a806a5b0 con 0x7f35a80baed0 2024-05-11T01:01:40.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.136+0000 7f359dffb640 1 -- 172.21.15.16:0/2068626280 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35a4012a10 con 0x7f35a80baed0 2024-05-11T01:01:40.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.137+0000 7f359dffb640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f358c076300 0x7f358c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.137+0000 7f359dffb640 1 -- 172.21.15.16:0/2068626280 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f35a4097310 con 0x7f35a80baed0 2024-05-11T01:01:40.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.137+0000 7f35acd39640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f358c076300 0x7f358c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.138+0000 7f35acd39640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f358c076300 0x7f358c0787c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3598034000 tx=0x7f359802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.141+0000 7f359dffb640 1 -- 172.21.15.16:0/2068626280 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f35a4060b40 con 0x7f35a80baed0 2024-05-11T01:01:40.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.373+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35a80d5f50 con 0x7f35a80baed0 2024-05-11T01:01:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.374+0000 7f359dffb640 1 -- 172.21.15.16:0/2068626280 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5178 (secure 0 0 0) 0x7f35a4060440 con 0x7f35a80baed0 2024-05-11T01:01:40.374 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:40.374 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/3845771643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3845771643},{"type":"v1","addr":"172.21.15.174:6836","nonce":3845771643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/721077154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":721077154},{"type":"v1","addr":"172.21.15.174:6837","nonce":721077154}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3315352517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3315352517},{"type":"v1","addr":"172.21.15.16:6834","nonce":3315352517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:09.046368+0000","modified":"2024-05-11T01:01:12.033345+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6835/2538287470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2538287470},{"type":"v1","addr":"172.21.15.16:6835","nonce":2538287470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4260,"qdb_cluster":[4260]},"id":1}]} 2024-05-11T01:01:40.374 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2024-05-11T01:01:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f358c076300 msgr2=0x7f358c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f358c076300 0x7f358c0787c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3598034000 tx=0x7f359802e000 comp rx=0 tx=0).stop 2024-05-11T01:01:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 msgr2=0x7f35a81e8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a81e8c70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f35a400c450 tx=0x7f35a400c910 comp rx=0 tx=0).stop 2024-05-11T01:01:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 shutdown_connections 2024-05-11T01:01:40.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f358c076300 0x7f358c0787c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f35a80d3bf0 0x7f35a80cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f35a80d0000 0x7f35a81548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 --2- 172.21.15.16:0/2068626280 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f35a80baed0 0x7f35a81e8c70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 >> 172.21.15.16:0/2068626280 conn(0x7f35a8074140 msgr2=0x7f35a80b6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 shutdown_connections 2024-05-11T01:01:40.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.376+0000 7f35af79e640 1 -- 172.21.15.16:0/2068626280 wait complete. 2024-05-11T01:01:40.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:40.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.491+0000 7fd04b119640 1 Processor -- start 2024-05-11T01:01:40.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.491+0000 7fd04b119640 1 -- start start 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd04b119640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd04415f960 0x7fd0441639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd04b119640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04415fde0 con 0x7fd0440b0ec0 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd04b119640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0441600c0 con 0x7fd0440b4ea0 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd04b119640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd0441609f0 con 0x7fd04415f960 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd048eb5640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd0440b0ec0 0x7fd0440b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47182/0 (socket says 172.21.15.16:47182) 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd048eb5640 1 -- 172.21.15.16:0/2421015388 learned_addr learned my addr 172.21.15.16:0/2421015388 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd043fff640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd04415f960 0x7fd0441639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725299509 0 0) 0x7fd04415fde0 con 0x7fd0440b0ec0 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.492+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd030003520 con 0x7fd0440b0ec0 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1269534971 0 0) 0x7fd030003520 con 0x7fd0440b0ec0 2024-05-11T01:01:40.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd04415f960 msgr2=0x7fd0441639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd04415f960 0x7fd0441639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 >> v1:172.21.15.174:6789/0 conn(0x7fd0440b4ea0 legacy=0x7fd04406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0441603a0 con 0x7fd0440b0ec0 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fd034001a70 con 0x7fd0440b0ec0 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 >> v1:172.21.15.16:6789/0 conn(0x7fd0440b0ec0 legacy=0x7fd0440b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0300039e0 0x7fd030003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd04415f960 0x7fd030004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd030004d40 0x7fd0300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0441609f0 con 0x7fd0300039e0 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd03000bb50 con 0x7fd030004d40 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd03000bd20 con 0x7fd04415f960 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd048eb5640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0300039e0 0x7fd030003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd043fff640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd04415f960 0x7fd030004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0496b6640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd030004d40 0x7fd0300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd048eb5640 1 -- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd04415f960 msgr2=0x7fd030004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd048eb5640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd04415f960 0x7fd030004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd048eb5640 1 -- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd030004d40 msgr2=0x7fd0300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd048eb5640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd030004d40 0x7fd0300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd048eb5640 1 -- 172.21.15.16:0/2421015388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd030003520 con 0x7fd0300039e0 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.493+0000 7fd0496b6640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd030004d40 0x7fd0300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.494+0000 7fd048eb5640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0300039e0 0x7fd030003dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd03400a910 tx=0x7fd030005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5376f83a0193d2c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.494+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03400a500 con 0x7fd0300039e0 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.494+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd03402f070 con 0x7fd0300039e0 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.494+0000 7fd0437fe640 1 -- 172.21.15.16:0/2421015388 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03402bc80 con 0x7fd0300039e0 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.495+0000 7fd04b119640 1 -- 172.21.15.16:0/2421015388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0300039e0 msgr2=0x7fd030003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.495+0000 7fd04b119640 1 --2- 172.21.15.16:0/2421015388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0300039e0 0x7fd030003dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd03400a910 tx=0x7fd030005830 comp rx=0 tx=0).stop 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.495+0000 7fd0496b6640 1 -- 172.21.15.16:0/2421015388 reap_dead start 2024-05-11T01:01:40.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.495+0000 7fd04b119640 1 -- 172.21.15.16:0/2421015388 shutdown_connections 2024-05-11T01:01:40.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.495+0000 7fd04b119640 1 -- 172.21.15.16:0/2421015388 >> 172.21.15.16:0/2421015388 conn(0x7fd0440d17a0 msgr2=0x7fd0440d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:40.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.495+0000 7fd04b119640 1 -- 172.21.15.16:0/2421015388 shutdown_connections 2024-05-11T01:01:40.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.495+0000 7fd04b119640 1 -- 172.21.15.16:0/2421015388 wait complete. 2024-05-11T01:01:40.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.496+0000 7fd04b119640 1 Processor -- start 2024-05-11T01:01:40.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.496+0000 7fd04b119640 1 -- start start 2024-05-11T01:01:40.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd04b119640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0300039e0 0x7fd0441428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd04b119640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0441452b0 0x7fd044145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd04b119640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd044161cf0 0x7fd044162170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd04b119640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0441639b0 con 0x7fd0441452b0 2024-05-11T01:01:40.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd04b119640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd0440709b0 con 0x7fd0300039e0 2024-05-11T01:01:40.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd04b119640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd044163b30 con 0x7fd044161cf0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0441452b0 0x7fd044145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0441452b0 0x7fd044145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33634/0 (socket says 172.21.15.16:33634) 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 -- 172.21.15.16:0/1859811111 learned_addr learned my addr 172.21.15.16:0/1859811111 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd048eb5640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0300039e0 0x7fd0441428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd0496b6640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd044161cf0 0x7fd044162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 -- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd044161cf0 msgr2=0x7fd044162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd044161cf0 0x7fd044162170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 -- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0300039e0 msgr2=0x7fd0441428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0300039e0 0x7fd0441428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 -- 172.21.15.16:0/1859811111 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd044145e20 con 0x7fd0441452b0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.497+0000 7fd043fff640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0441452b0 0x7fd044145710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd02c011970 tx=0x7fd02c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.498+0000 7fd0417fa640 1 -- 172.21.15.16:0/1859811111 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c019070 con 0x7fd0441452b0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.498+0000 7fd0417fa640 1 -- 172.21.15.16:0/1859811111 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c004240 con 0x7fd0441452b0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.498+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd044146100 con 0x7fd0441452b0 2024-05-11T01:01:40.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.498+0000 7fd0417fa640 1 -- 172.21.15.16:0/1859811111 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00f880 con 0x7fd0441452b0 2024-05-11T01:01:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.498+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd044143500 con 0x7fd0441452b0 2024-05-11T01:01:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.499+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04406a5b0 con 0x7fd0441452b0 2024-05-11T01:01:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.499+0000 7fd0417fa640 1 -- 172.21.15.16:0/1859811111 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd02c01c070 con 0x7fd0441452b0 2024-05-11T01:01:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.500+0000 7fd0417fa640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd0240762d0 0x7fd024078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.500+0000 7fd0417fa640 1 -- 172.21.15.16:0/1859811111 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd02c097980 con 0x7fd0441452b0 2024-05-11T01:01:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.500+0000 7fd048eb5640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd0240762d0 0x7fd024078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.501+0000 7fd048eb5640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd0240762d0 0x7fd024078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd034033000 tx=0x7fd034038040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.504+0000 7fd0417fa640 1 -- 172.21.15.16:0/1859811111 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd02c0612e0 con 0x7fd0441452b0 2024-05-11T01:01:40.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.700+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd044156880 con 0x7fd0441452b0 2024-05-11T01:01:40.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.701+0000 7fd0417fa640 1 -- 172.21.15.16:0/1859811111 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fd02c060be0 con 0x7fd0441452b0 2024-05-11T01:01:40.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:40.701 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":20,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:10.636137+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:07.219708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:07.972820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:40.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd0240762d0 msgr2=0x7fd024078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd0240762d0 0x7fd024078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd034033000 tx=0x7fd034038040 comp rx=0 tx=0).stop 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0441452b0 msgr2=0x7fd044145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0441452b0 0x7fd044145710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd02c011970 tx=0x7fd02c011e30 comp rx=0 tx=0).stop 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 shutdown_connections 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fd0240762d0 0x7fd024078790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd044161cf0 0x7fd044162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0441452b0 0x7fd044145710 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 --2- 172.21.15.16:0/1859811111 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0300039e0 0x7fd0441428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 >> 172.21.15.16:0/1859811111 conn(0x7fd0440d17a0 msgr2=0x7fd04406ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 shutdown_connections 2024-05-11T01:01:40.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.703+0000 7fd04b119640 1 -- 172.21.15.16:0/1859811111 wait complete. 2024-05-11T01:01:40.715 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-11T01:01:40.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.820+0000 7f64835af640 1 Processor -- start 2024-05-11T01:01:40.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.820+0000 7f64835af640 1 -- start start 2024-05-11T01:01:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f64835af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0bac10 0x7f647c0d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f64835af640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f647c0d3ec0 0x7f647c0d4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f64835af640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647c163e90 con 0x7f647c0b6d70 2024-05-11T01:01:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f64835af640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f647c0cfad0 con 0x7f647c0d3ec0 2024-05-11T01:01:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f64835af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f647c163310 con 0x7f647c0bac10 2024-05-11T01:01:40.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f6481b4c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f647c0d3ec0 0x7f647c0d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f648134b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f647c0b6d70 0x7f647c0b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47198/0 (socket says 172.21.15.16:47198) 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f6481b4c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f647c0d3ec0 0x7f647c0d4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33636/0 (socket says 172.21.15.16:33636) 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f648134b640 1 -- 172.21.15.16:0/4269382584 learned_addr learned my addr 172.21.15.16:0/4269382584 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f6480b4a640 1 --2- 172.21.15.16:0/4269382584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0bac10 0x7f647c0d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f6481b4c640 1 -- 172.21.15.16:0/4269382584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0bac10 msgr2=0x7f647c0d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f6481b4c640 1 --2- 172.21.15.16:0/4269382584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0bac10 0x7f647c0d3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f6481b4c640 1 -- 172.21.15.16:0/4269382584 >> v1:172.21.15.16:6789/0 conn(0x7f647c0b6d70 legacy=0x7f647c0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f6481b4c640 1 -- 172.21.15.16:0/4269382584 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c1635f0 con 0x7f647c0d3ec0 2024-05-11T01:01:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.821+0000 7f6473fff640 1 -- 172.21.15.16:0/4269382584 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4145794897 0 0) 0x7f647c163e90 con 0x7f647c0b6d70 2024-05-11T01:01:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.822+0000 7f6481b4c640 1 --2- 172.21.15.16:0/4269382584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c0d4350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6474009d90 tx=0x7f647402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd75ee603d156afd server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.822+0000 7f6473fff640 1 -- 172.21.15.16:0/4269382584 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474031600 con 0x7f647c0d3ec0 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.822+0000 7f6473fff640 1 -- 172.21.15.16:0/4269382584 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64740317a0 con 0x7f647c0d3ec0 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.822+0000 7f6473fff640 1 -- 172.21.15.16:0/4269382584 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474031b70 con 0x7f647c0d3ec0 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.823+0000 7f64835af640 1 -- 172.21.15.16:0/4269382584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 msgr2=0x7f647c0d4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.823+0000 7f64835af640 1 --2- 172.21.15.16:0/4269382584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c0d4350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6474009d90 tx=0x7f647402a5d0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.823+0000 7f64835af640 1 -- 172.21.15.16:0/4269382584 shutdown_connections 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.823+0000 7f64835af640 1 --2- 172.21.15.16:0/4269382584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c0d4350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.823+0000 7f64835af640 1 --2- 172.21.15.16:0/4269382584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0bac10 0x7f647c0d3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.823+0000 7f64835af640 1 -- 172.21.15.16:0/4269382584 >> 172.21.15.16:0/4269382584 conn(0x7f647c074140 msgr2=0x7f647c0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.823+0000 7f64835af640 1 -- 172.21.15.16:0/4269382584 shutdown_connections 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.823+0000 7f64835af640 1 -- 172.21.15.16:0/4269382584 wait complete. 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.824+0000 7f64835af640 1 Processor -- start 2024-05-11T01:01:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.824+0000 7f64835af640 1 -- start start 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f64835af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0b6d70 0x7f647c0cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f64835af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f647c0bac10 0x7f647c1eb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f64835af640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f64835af640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f647c15f830 con 0x7f647c0d3ec0 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f64835af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f647c163bb0 con 0x7f647c0bac10 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f64835af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f647c162fc0 con 0x7f647c0b6d70 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33644/0 (socket says 172.21.15.16:33644) 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 -- 172.21.15.16:0/4185257971 learned_addr learned my addr 172.21.15.16:0/4185257971 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 -- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0b6d70 msgr2=0x7f647c0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0b6d70 0x7f647c0cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 -- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f647c0bac10 msgr2=0x7f647c1eb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f647c0bac10 0x7f647c1eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 -- 172.21.15.16:0/4185257971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0cb3b0 con 0x7f647c0d3ec0 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6481b4c640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c148070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6474009d90 tx=0x7f6474004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6471ffb640 1 -- 172.21.15.16:0/4185257971 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474040070 con 0x7f647c0d3ec0 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6471ffb640 1 -- 172.21.15.16:0/4185257971 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6474030b60 con 0x7f647c0d3ec0 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c1ebd40 con 0x7f647c0d3ec0 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.825+0000 7f6471ffb640 1 -- 172.21.15.16:0/4185257971 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474009450 con 0x7f647c0d3ec0 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.826+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1eb000 con 0x7f647c0d3ec0 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.827+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c06a5b0 con 0x7f647c0d3ec0 2024-05-11T01:01:40.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.827+0000 7f6471ffb640 1 -- 172.21.15.16:0/4185257971 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6474039040 con 0x7f647c0d3ec0 2024-05-11T01:01:40.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.828+0000 7f6471ffb640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64600762d0 0x7f6460078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:40.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.828+0000 7f6471ffb640 1 -- 172.21.15.16:0/4185257971 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f64740b8930 con 0x7f647c0d3ec0 2024-05-11T01:01:40.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.828+0000 7f648134b640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64600762d0 0x7f6460078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:40.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.828+0000 7f648134b640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64600762d0 0x7f6460078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478007960 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:40.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:40.832+0000 7f6471ffb640 1 -- 172.21.15.16:0/4185257971 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f647c0cb3b0 con 0x7f647c0d3ec0 2024-05-11T01:01:41.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.060+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f647c0b4a30 con 0x7f647c0d3ec0 2024-05-11T01:01:41.061 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-05-11T01:01:41.061+0000 7fb848c8f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-11T01:01:41.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.062+0000 7f6471ffb640 1 -- 172.21.15.16:0/4185257971 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f6474081c40 con 0x7f647c0d3ec0 2024-05-11T01:01:41.062 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-11T01:01:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64600762d0 msgr2=0x7f6460078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64600762d0 0x7f6460078790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478007960 comp rx=0 tx=0).stop 2024-05-11T01:01:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 msgr2=0x7f647c148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c148070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6474009d90 tx=0x7f6474004a40 comp rx=0 tx=0).stop 2024-05-11T01:01:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 shutdown_connections 2024-05-11T01:01:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64600762d0 0x7f6460078790 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0d3ec0 0x7f647c148070 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f647c0bac10 0x7f647c1eb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 --2- 172.21.15.16:0/4185257971 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f647c0b6d70 0x7f647c0cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 >> 172.21.15.16:0/4185257971 conn(0x7f647c074140 msgr2=0x7f647c15d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 shutdown_connections 2024-05-11T01:01:41.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.066+0000 7f64835af640 1 -- 172.21.15.16:0/4185257971 wait complete. 2024-05-11T01:01:41.069 INFO:tasks.ceph.mds.a.smithi016.stderr: -6694> 2024-05-11T01:01:14.931+0000 7f05ccfd8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-11T01:01:41.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-11T01:01:41.103 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-05-11T01:01:41.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.184+0000 7f38ecbf0640 1 Processor -- start 2024-05-11T01:01:41.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.184+0000 7f38ecbf0640 1 -- start start 2024-05-11T01:01:41.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.185+0000 7f38ecbf0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f38e8148ba0 0x7f38e806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:41.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.185+0000 7f38ecbf0640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e81603c0 con 0x7f38e8148f80 2024-05-11T01:01:41.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.185+0000 7f38ecbf0640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e81606a0 con 0x7f38e80b5ff0 2024-05-11T01:01:41.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.185+0000 7f38ecbf0640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f38e8160980 con 0x7f38e8148ba0 2024-05-11T01:01:41.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.186+0000 7f38e659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f38e8148ba0 0x7f38e806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:41.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.186+0000 7f38e5d9b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f38e8148f80 0x7f38e815fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47210/0 (socket says 172.21.15.16:47210) 2024-05-11T01:01:41.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.186+0000 7f38e5d9b640 1 -- 172.21.15.16:0/4039757121 learned_addr learned my addr 172.21.15.16:0/4039757121 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:41.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.186+0000 7f38e659c640 1 -- 172.21.15.16:0/4039757121 >> v1:172.21.15.174:6789/0 conn(0x7f38e80b5ff0 legacy=0x7f38e8161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:41.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.186+0000 7f38e659c640 1 -- 172.21.15.16:0/4039757121 >> v1:172.21.15.16:6789/0 conn(0x7f38e8148f80 legacy=0x7f38e815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:41.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.186+0000 7f38e659c640 1 -- 172.21.15.16:0/4039757121 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e8160c60 con 0x7f38e8148ba0 2024-05-11T01:01:41.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.186+0000 7f38e559a640 1 -- 172.21.15.16:0/4039757121 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064387207 0 0) 0x7f38e81603c0 con 0x7f38e8148f80 2024-05-11T01:01:41.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38e659c640 1 --2- 172.21.15.16:0/4039757121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e806eb70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f38d80097a0 tx=0x7f38d802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc1c26fa084a646 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:41.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38e559a640 1 -- 172.21.15.16:0/4039757121 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8037070 con 0x7f38e8148ba0 2024-05-11T01:01:41.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38e559a640 1 -- 172.21.15.16:0/4039757121 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d802ae50 con 0x7f38e8148ba0 2024-05-11T01:01:41.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38e559a640 1 -- 172.21.15.16:0/4039757121 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8032660 con 0x7f38e8148ba0 2024-05-11T01:01:41.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38ecbf0640 1 -- 172.21.15.16:0/4039757121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 msgr2=0x7f38e806eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:41.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38ecbf0640 1 --2- 172.21.15.16:0/4039757121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e806eb70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f38d80097a0 tx=0x7f38d802a100 comp rx=0 tx=0).stop 2024-05-11T01:01:41.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38ecbf0640 1 -- 172.21.15.16:0/4039757121 shutdown_connections 2024-05-11T01:01:41.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38ecbf0640 1 --2- 172.21.15.16:0/4039757121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e806eb70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:41.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.187+0000 7f38ecbf0640 1 -- 172.21.15.16:0/4039757121 >> 172.21.15.16:0/4039757121 conn(0x7f38e8070780 msgr2=0x7f38e8070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:41.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.188+0000 7f38ecbf0640 1 -- 172.21.15.16:0/4039757121 shutdown_connections 2024-05-11T01:01:41.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.188+0000 7f38ecbf0640 1 -- 172.21.15.16:0/4039757121 wait complete. 2024-05-11T01:01:41.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.189+0000 7f38ecbf0640 1 Processor -- start 2024-05-11T01:01:41.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.189+0000 7f38ecbf0640 1 -- start start 2024-05-11T01:01:41.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38ecbf0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e80b5ff0 0x7f38e80cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:41.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38ecbf0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e8143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:41.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38ecbf0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e81451b0 0x7f38e8145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:41.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38ecbf0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80b6620 con 0x7f38e8148ba0 2024-05-11T01:01:41.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38ecbf0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80b64a0 con 0x7f38e80b5ff0 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38ecbf0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f38e80b67a0 con 0x7f38e81451b0 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e8143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e8143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33664/0 (socket says 172.21.15.16:33664) 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 -- 172.21.15.16:0/1230522114 learned_addr learned my addr 172.21.15.16:0/1230522114 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 -- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e81451b0 msgr2=0x7f38e8145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e81451b0 0x7f38e8145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 -- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e80b5ff0 msgr2=0x7f38e80cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e659c640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e80b5ff0 0x7f38e80cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e80b5ff0 0x7f38e80cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 -- 172.21.15.16:0/1230522114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e8143e70 con 0x7f38e8148ba0 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38e5d9b640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e8143930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c3c0 tx=0x7f38d000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38deffd640 1 -- 172.21.15.16:0/1230522114 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d00074e0 con 0x7f38e8148ba0 2024-05-11T01:01:41.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38deffd640 1 -- 172.21.15.16:0/1230522114 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d00047e0 con 0x7f38e8148ba0 2024-05-11T01:01:41.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e8144110 con 0x7f38e8148ba0 2024-05-11T01:01:41.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.190+0000 7f38deffd640 1 -- 172.21.15.16:0/1230522114 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d0004bd0 con 0x7f38e8148ba0 2024-05-11T01:01:41.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.191+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e81446d0 con 0x7f38e8148ba0 2024-05-11T01:01:41.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.191+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e8070b60 con 0x7f38e8148ba0 2024-05-11T01:01:41.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.192+0000 7f38deffd640 1 -- 172.21.15.16:0/1230522114 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f38d0011070 con 0x7f38e8148ba0 2024-05-11T01:01:41.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.193+0000 7f38deffd640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38c80762d0 0x7f38c8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:41.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.193+0000 7f38deffd640 1 -- 172.21.15.16:0/1230522114 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f38d00972d0 con 0x7f38e8148ba0 2024-05-11T01:01:41.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.193+0000 7f38e659c640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38c80762d0 0x7f38c8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:41.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.194+0000 7f38e659c640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38c80762d0 0x7f38c8078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38d8034000 tx=0x7f38d802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:41.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.197+0000 7f38deffd640 1 -- 172.21.15.16:0/1230522114 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f38e8070b60 con 0x7f38e8148ba0 2024-05-11T01:01:41.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:41.433+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f38e8072e10 con 0x7f38e8148ba0 2024-05-11T01:01:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.067+0000 7f38deffd640 1 -- 172.21.15.16:0/1230522114 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f38e8072e10 con 0x7f38e8148ba0 2024-05-11T01:01:42.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38c80762d0 msgr2=0x7f38c8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:42.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38c80762d0 0x7f38c8078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38d8034000 tx=0x7f38d802e000 comp rx=0 tx=0).stop 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 msgr2=0x7f38e8143930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e8143930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c3c0 tx=0x7f38d000c880 comp rx=0 tx=0).stop 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 shutdown_connections 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38c80762d0 0x7f38c8078790 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38e81451b0 0x7f38e8145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38e8148ba0 0x7f38e8143930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 --2- 172.21.15.16:0/1230522114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38e80b5ff0 0x7f38e80cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 >> 172.21.15.16:0/1230522114 conn(0x7f38e8070780 msgr2=0x7f38e80b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 shutdown_connections 2024-05-11T01:01:42.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.070+0000 7f38ecbf0640 1 -- 172.21.15.16:0/1230522114 wait complete. 2024-05-11T01:01:42.084 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-11T01:01:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.242+0000 7f63dcba4640 1 Processor -- start 2024-05-11T01:01:42.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.242+0000 7f63dcba4640 1 -- start start 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63dcba4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f63d815f470 0x7f63d80baca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63dcba4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d80d3400 con 0x7f63d80b7360 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63dcba4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d80d36e0 con 0x7f63d80d4da0 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63dcba4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f63d80d4010 con 0x7f63d815f470 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63d6d9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f63d80b7360 0x7f63d80b84b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:47216/0 (socket says 172.21.15.16:47216) 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63d6d9d640 1 -- 172.21.15.16:0/847883924 learned_addr learned my addr 172.21.15.16:0/847883924 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63d659c640 1 --2- 172.21.15.16:0/847883924 >> v2:172.21.15.174:3300/0 conn(0x7f63d815f470 0x7f63d80baca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637602504 0 0) 0x7f63d80d3400 con 0x7f63d80b7360 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.243+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c0003520 con 0x7f63d80b7360 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 326571562 0 0) 0x7f63d80d36e0 con 0x7f63d80d4da0 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d80d3400 con 0x7f63d80d4da0 2024-05-11T01:01:42.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3792776409 0 0) 0x7f63c0003520 con 0x7f63d80b7360 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 >> v2:172.21.15.174:3300/0 conn(0x7f63d815f470 msgr2=0x7f63d80baca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 --2- 172.21.15.16:0/847883924 >> v2:172.21.15.174:3300/0 conn(0x7f63d815f470 0x7f63d80baca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 >> v1:172.21.15.174:6789/0 conn(0x7f63d80d4da0 legacy=0x7f63d80d44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d80d39c0 con 0x7f63d80b7360 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f63d0001a70 con 0x7f63d80b7360 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 >> v1:172.21.15.16:6789/0 conn(0x7f63d80b7360 legacy=0x7f63d80b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c0003c30 0x7f63c0004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0004800 0x7f63c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c0005210 0x7f63c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f63d80d4010 con 0x7f63c0003c30 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f63c000c160 con 0x7f63c0004800 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f63c000c360 con 0x7f63c0005210 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d659c640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c0003c30 0x7f63c0004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:42.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d5d9b640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0004800 0x7f63c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d6d9d640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c0005210 0x7f63c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d659c640 1 -- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c0005210 msgr2=0x7f63c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d659c640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c0005210 0x7f63c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d659c640 1 -- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0004800 msgr2=0x7f63c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d659c640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0004800 0x7f63c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d659c640 1 -- 172.21.15.16:0/847883924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c0003520 con 0x7f63c0003c30 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d6d9d640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63c0005210 0x7f63c000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d5d9b640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0004800 0x7f63c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.244+0000 7f63d6d9d640 1 -- 172.21.15.16:0/847883924 reap_dead start 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.245+0000 7f63d659c640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c0003c30 0x7f63c0004050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009a90 tx=0x7f63c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41eedb164928e096 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.245+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8036070 con 0x7f63c0003c30 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.245+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c8031400 con 0x7f63c0003c30 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.245+0000 7f63d559a640 1 -- 172.21.15.16:0/847883924 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c8009690 con 0x7f63c0003c30 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.245+0000 7f63dcba4640 1 -- 172.21.15.16:0/847883924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c0003c30 msgr2=0x7f63c0004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:42.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.245+0000 7f63dcba4640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c0003c30 0x7f63c0004050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f63c8009a90 tx=0x7f63c0005830 comp rx=0 tx=0).stop 2024-05-11T01:01:42.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.246+0000 7f63dcba4640 1 -- 172.21.15.16:0/847883924 shutdown_connections 2024-05-11T01:01:42.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.246+0000 7f63dcba4640 1 --2- 172.21.15.16:0/847883924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c0003c30 0x7f63c0004050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.246+0000 7f63dcba4640 1 -- 172.21.15.16:0/847883924 >> 172.21.15.16:0/847883924 conn(0x7f63d8073f30 msgr2=0x7f63d8074340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:42.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.246+0000 7f63dcba4640 1 -- 172.21.15.16:0/847883924 shutdown_connections 2024-05-11T01:01:42.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.246+0000 7f63dcba4640 1 -- 172.21.15.16:0/847883924 wait complete. 2024-05-11T01:01:42.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.247+0000 7f63dcba4640 1 Processor -- start 2024-05-11T01:01:42.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.247+0000 7f63dcba4640 1 -- start start 2024-05-11T01:01:42.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63dcba4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0003c30 0x7f63d80ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:42.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63dcba4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d8156af0 0x7f63d8154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63dcba4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63d8160fc0 0x7f63d8161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63dcba4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f63d80b7790 con 0x7f63d8160fc0 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63dcba4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f63d815f850 con 0x7f63c0003c30 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63dcba4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f63d80b7910 con 0x7f63d8156af0 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63d8160fc0 0x7f63d8161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63d8160fc0 0x7f63d8161440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33684/0 (socket says 172.21.15.16:33684) 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 -- 172.21.15.16:0/4293967767 learned_addr learned my addr 172.21.15.16:0/4293967767 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d659c640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0003c30 0x7f63d80ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d5d9b640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d8156af0 0x7f63d8154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 -- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d8156af0 msgr2=0x7f63d8154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d8156af0 0x7f63d8154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 -- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0003c30 msgr2=0x7f63d80ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0003c30 0x7f63d80ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:42.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 -- 172.21.15.16:0/4293967767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d80ca730 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.248+0000 7f63d6d9d640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63d8160fc0 0x7f63d8161440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63d80bb4d0 tx=0x7f63d000def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.249+0000 7f63c6ffd640 1 -- 172.21.15.16:0/4293967767 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d000b830 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.249+0000 7f63c6ffd640 1 -- 172.21.15.16:0/4293967767 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d000b9d0 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.249+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d80caa10 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.249+0000 7f63c6ffd640 1 -- 172.21.15.16:0/4293967767 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d000bdc0 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.249+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d80cafd0 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.250+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d806a5b0 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.250+0000 7f63c6ffd640 1 -- 172.21.15.16:0/4293967767 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f63d001b020 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.251+0000 7f63c6ffd640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63b80762d0 0x7f63b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.251+0000 7f63c6ffd640 1 -- 172.21.15.16:0/4293967767 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5795+0+0 (secure 0 0 0) 0x7f63d0097600 con 0x7f63d8160fc0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.251+0000 7f63d659c640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63b80762d0 0x7f63b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:42.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.251+0000 7f63d659c640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63b80762d0 0x7f63b8078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f63c8033000 tx=0x7f63c8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:42.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.255+0000 7f63c6ffd640 1 -- 172.21.15.16:0/4293967767 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f63d0060e80 con 0x7f63d8160fc0 2024-05-11T01:01:42.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:42.444+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f63d80b84b0 con 0x7f63d8160fc0 2024-05-11T01:01:43.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.069+0000 7f63c6ffd640 1 -- 172.21.15.16:0/4293967767 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) ==== 181+0+0 (secure 0 0 0) 0x7f63d0060780 con 0x7f63d8160fc0 2024-05-11T01:01:43.069 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-05-11T01:01:43.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63b80762d0 msgr2=0x7f63b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63b80762d0 0x7f63b8078790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f63c8033000 tx=0x7f63c8008030 comp rx=0 tx=0).stop 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63d8160fc0 msgr2=0x7f63d8161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63d8160fc0 0x7f63d8161440 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63d80bb4d0 tx=0x7f63d000def0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 shutdown_connections 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f63b80762d0 0x7f63b8078790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63d8160fc0 0x7f63d8161440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f63d8156af0 0x7f63d8154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 --2- 172.21.15.16:0/4293967767 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63c0003c30 0x7f63d80ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 >> 172.21.15.16:0/4293967767 conn(0x7f63d8073f30 msgr2=0x7f63d80cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 shutdown_connections 2024-05-11T01:01:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.072+0000 7f63dcba4640 1 -- 172.21.15.16:0/4293967767 wait complete. 2024-05-11T01:01:43.086 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-11T01:01:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.201+0000 7f7499b38640 1 Processor -- start 2024-05-11T01:01:43.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.201+0000 7f7499b38640 1 -- start start 2024-05-11T01:01:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7499b38640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7494140000 0x7f749415e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7499b38640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74941403e0 0x7f7494161580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7499b38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f74940b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7499b38640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7494141570 con 0x7f74941403e0 2024-05-11T01:01:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7499b38640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7494140960 con 0x7f7494140000 2024-05-11T01:01:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7499b38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7494140c40 con 0x7f7494161ac0 2024-05-11T01:01:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7492ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74941403e0 0x7f7494161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:43.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7492ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74941403e0 0x7f7494161580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52094/0 (socket says 172.21.15.16:52094) 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7492ffd640 1 -- 172.21.15.16:0/2853312962 learned_addr learned my addr 172.21.15.16:0/2853312962 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f74937fe640 1 --2- 172.21.15.16:0/2853312962 >> v2:172.21.15.174:3300/0 conn(0x7f7494140000 0x7f749415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7493fff640 1 --2- 172.21.15.16:0/2853312962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f74940b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7492ffd640 1 -- 172.21.15.16:0/2853312962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 msgr2=0x7f74940b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7492ffd640 1 --2- 172.21.15.16:0/2853312962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f74940b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7492ffd640 1 -- 172.21.15.16:0/2853312962 >> v2:172.21.15.174:3300/0 conn(0x7f7494140000 msgr2=0x7f749415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7492ffd640 1 --2- 172.21.15.16:0/2853312962 >> v2:172.21.15.174:3300/0 conn(0x7f7494140000 0x7f749415e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7492ffd640 1 -- 172.21.15.16:0/2853312962 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7494140f20 con 0x7f74941403e0 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f7493fff640 1 --2- 172.21.15.16:0/2853312962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f74940b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.202+0000 7f74937fe640 1 --2- 172.21.15.16:0/2853312962 >> v2:172.21.15.174:3300/0 conn(0x7f7494140000 0x7f749415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.203+0000 7f7492ffd640 1 --2- 172.21.15.16:0/2853312962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f7494161580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7494071a60 tx=0x7f748802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9528790753a43736 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.203+0000 7f74927fc640 1 -- 172.21.15.16:0/2853312962 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488037070 con 0x7f74941403e0 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.203+0000 7f74927fc640 1 -- 172.21.15.16:0/2853312962 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7488032440 con 0x7f74941403e0 2024-05-11T01:01:43.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.203+0000 7f74927fc640 1 -- 172.21.15.16:0/2853312962 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488032810 con 0x7f74941403e0 2024-05-11T01:01:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 -- 172.21.15.16:0/2853312962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 msgr2=0x7f7494161580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:43.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 --2- 172.21.15.16:0/2853312962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f7494161580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7494071a60 tx=0x7f748802a140 comp rx=0 tx=0).stop 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 -- 172.21.15.16:0/2853312962 shutdown_connections 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 --2- 172.21.15.16:0/2853312962 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f74940b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 --2- 172.21.15.16:0/2853312962 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f7494161580 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 --2- 172.21.15.16:0/2853312962 >> v2:172.21.15.174:3300/0 conn(0x7f7494140000 0x7f749415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 -- 172.21.15.16:0/2853312962 >> 172.21.15.16:0/2853312962 conn(0x7f749406c5c0 msgr2=0x7f749406c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 -- 172.21.15.16:0/2853312962 shutdown_connections 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.204+0000 7f7499b38640 1 -- 172.21.15.16:0/2853312962 wait complete. 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.205+0000 7f7499b38640 1 Processor -- start 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.205+0000 7f7499b38640 1 -- start start 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7499b38640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7494140000 0x7f74940cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7499b38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f74941563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7499b38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f749413ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7499b38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7494161070 con 0x7f74941403e0 2024-05-11T01:01:43.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7499b38640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7494160ef0 con 0x7f7494140000 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7499b38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f74940b33e0 con 0x7f7494161ac0 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f74941563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f74941563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52104/0 (socket says 172.21.15.16:52104) 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 -- 172.21.15.16:0/3668886979 learned_addr learned my addr 172.21.15.16:0/3668886979 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f74937fe640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7494140000 0x7f74940cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7493fff640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f749413ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 -- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 msgr2=0x7f749413ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f749413ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 -- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7494140000 msgr2=0x7f74940cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7494140000 0x7f74940cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 -- 172.21.15.16:0/3668886979 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7494138f90 con 0x7f74941403e0 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.206+0000 7f7492ffd640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f74941563c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7488000c00 tx=0x7f74880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.207+0000 7f747bfff640 1 -- 172.21.15.16:0/3668886979 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488037040 con 0x7f74941403e0 2024-05-11T01:01:43.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.207+0000 7f747bfff640 1 -- 172.21.15.16:0/3668886979 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7488042070 con 0x7f74941403e0 2024-05-11T01:01:43.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.207+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7494139270 con 0x7f74941403e0 2024-05-11T01:01:43.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.207+0000 7f747bfff640 1 -- 172.21.15.16:0/3668886979 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488030bb0 con 0x7f74941403e0 2024-05-11T01:01:43.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.207+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f749413af30 con 0x7f74941403e0 2024-05-11T01:01:43.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.208+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f749406a5b0 con 0x7f74941403e0 2024-05-11T01:01:43.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.208+0000 7f747bfff640 1 -- 172.21.15.16:0/3668886979 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7488047460 con 0x7f74941403e0 2024-05-11T01:01:43.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.209+0000 7f747bfff640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f74800762d0 0x7f7480078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:43.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.209+0000 7f747bfff640 1 -- 172.21.15.16:0/3668886979 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5357+0+0 (secure 0 0 0) 0x7f74880b8180 con 0x7f74941403e0 2024-05-11T01:01:43.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.209+0000 7f74937fe640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f74800762d0 0x7f7480078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:43.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.210+0000 7f74937fe640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f74800762d0 0x7f7480078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f748400a950 tx=0x7f7484008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:43.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.213+0000 7f747bfff640 1 -- 172.21.15.16:0/3668886979 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7488081bc0 con 0x7f74941403e0 2024-05-11T01:01:43.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:43.412+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f74940b4990 con 0x7f74941403e0 2024-05-11T01:01:44.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.074+0000 7f747bfff640 1 -- 172.21.15.16:0/3668886979 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) ==== 169+0+0 (secure 0 0 0) 0x7f74880814c0 con 0x7f74941403e0 2024-05-11T01:01:44.074 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.078+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f74800762d0 msgr2=0x7f7480078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.078+0000 7f7499b38640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f74800762d0 0x7f7480078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f748400a950 tx=0x7f7484008040 comp rx=0 tx=0).stop 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.078+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 msgr2=0x7f74941563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.078+0000 7f7499b38640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f74941563c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7488000c00 tx=0x7f74880046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.079+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 shutdown_connections 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.079+0000 7f7499b38640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f74800762d0 0x7f7480078790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.079+0000 7f7499b38640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7494161ac0 0x7f749413ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.079+0000 7f7499b38640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74941403e0 0x7f74941563c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.079+0000 7f7499b38640 1 --2- 172.21.15.16:0/3668886979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7494140000 0x7f74940cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.079+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 >> 172.21.15.16:0/3668886979 conn(0x7f749406c5c0 msgr2=0x7f749406c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:44.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.079+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 shutdown_connections 2024-05-11T01:01:44.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.079+0000 7f7499b38640 1 -- 172.21.15.16:0/3668886979 wait complete. 2024-05-11T01:01:44.095 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-11T01:01:44.095 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-11T01:01:44.095 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-11T01:01:44.095 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:01:44.095 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-11T01:01:44.096 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-11T01:01:44.096 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-11T01:01:44.096 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:01:44.096 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-11T01:01:44.096 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-11T01:01:44.096 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-11T01:01:44.096 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:01:44.097 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-11T01:01:44.097 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-11T01:01:44.097 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-11T01:01:44.097 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:01:44.107 INFO:tasks.ceph.mds.a:Stopped 2024-05-11T01:01:44.107 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-11T01:01:44.108 INFO:tasks.ceph.mds.c:Stopped 2024-05-11T01:01:44.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-11T01:01:44.109 INFO:tasks.ceph.mds.b:Stopped 2024-05-11T01:01:44.109 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-11T01:01:44.110 INFO:tasks.ceph.mds.d:Stopped 2024-05-11T01:01:44.110 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-11T01:01:44.149 INFO:tasks.ceph.mds.a:Started 2024-05-11T01:01:44.150 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:44.151 INFO:tasks.ceph.mds.c:Started 2024-05-11T01:01:44.151 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:44.152 INFO:tasks.ceph.mds.b:Started 2024-05-11T01:01:44.153 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:44.154 INFO:tasks.ceph.mds.d:Started 2024-05-11T01:01:44.154 DEBUG:teuthology.parallel:result is None 2024-05-11T01:01:44.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-11T01:01:44.234 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-05-11T01:01:44.234 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-05-11T01:01:44.235 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2024-05-11T01:01:44.235 INFO:tasks.ceph.mds.c.smithi016.stderr:2024-05-11T01:01:44.235+0000 7f07654cb640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-05-11T01:01:44.235 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-05-11T01:01:44.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.268+0000 7f38a5a1c640 1 Processor -- start 2024-05-11T01:01:44.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.268+0000 7f38a5a1c640 1 -- start start 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f38a5a1c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38a00baf60 0x7f38a00b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f38a5a1c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a00b7360 0x7f38a00d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f38a5a1c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a01639f0 con 0x7f38a0162d30 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f38a5a1c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f38a00bb3c0 con 0x7f38a00baf60 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f38a5a1c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f38a00d3700 con 0x7f38a00b7360 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f3897fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38a00baf60 0x7f38a00b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a00b7360 0x7f38a00d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f3897fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f38a00baf60 0x7f38a00b6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:47886/0 (socket says 172.21.15.16:47886) 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a00b7360 0x7f38a00d3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:50912/0 (socket says 172.21.15.16:50912) 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.269+0000 7f3897fff640 1 -- 172.21.15.16:0/1791434078 learned_addr learned my addr 172.21.15.16:0/1791434078 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:44.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.270+0000 7f3897fff640 1 -- 172.21.15.16:0/1791434078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a00b7360 msgr2=0x7f38a00d3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.270+0000 7f3897fff640 1 --2- 172.21.15.16:0/1791434078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a00b7360 0x7f38a00d3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.270+0000 7f3897fff640 1 -- 172.21.15.16:0/1791434078 >> v1:172.21.15.174:6789/0 conn(0x7f38a0162d30 legacy=0x7f38a0163210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:44.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.270+0000 7f3897fff640 1 -- 172.21.15.16:0/1791434078 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a0163cd0 con 0x7f38a00baf60 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f3897fff640 1 --2- 172.21.15.16:0/1791434078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 0x7f38a00b6e20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3888009870 tx=0x7f388802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=510c6a58480360d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f389e7fc640 1 -- 172.21.15.16:0/1791434078 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888037070 con 0x7f38a00baf60 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f389e7fc640 1 -- 172.21.15.16:0/1791434078 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3888032440 con 0x7f38a00baf60 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f389e7fc640 1 -- 172.21.15.16:0/1791434078 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3888032810 con 0x7f38a00baf60 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f38a5a1c640 1 -- 172.21.15.16:0/1791434078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 msgr2=0x7f38a00b6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/1791434078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 0x7f38a00b6e20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3888009870 tx=0x7f388802a130 comp rx=0 tx=0).stop 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f38a5a1c640 1 -- 172.21.15.16:0/1791434078 shutdown_connections 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/1791434078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a00b7360 0x7f38a00d3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/1791434078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 0x7f38a00b6e20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.271+0000 7f38a5a1c640 1 -- 172.21.15.16:0/1791434078 >> 172.21.15.16:0/1791434078 conn(0x7f38a00d1e20 msgr2=0x7f38a00d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:44.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.272+0000 7f38a5a1c640 1 -- 172.21.15.16:0/1791434078 shutdown_connections 2024-05-11T01:01:44.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.272+0000 7f38a5a1c640 1 -- 172.21.15.16:0/1791434078 wait complete. 2024-05-11T01:01:44.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.273+0000 7f38a5a1c640 1 Processor -- start 2024-05-11T01:01:44.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.273+0000 7f38a5a1c640 1 -- start start 2024-05-11T01:01:44.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.273+0000 7f38a5a1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a00b7360 0x7f38a0155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:44.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.273+0000 7f38a5a1c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 0x7f38a00b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:44.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.273+0000 7f38a5a1c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a0162d30 0x7f38a00b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:44.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.273+0000 7f38a5a1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00d43b0 con 0x7f38a00b7360 2024-05-11T01:01:44.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.273+0000 7f38a5a1c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00d3950 con 0x7f38a00baf60 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.273+0000 7f38a5a1c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f38a00d4530 con 0x7f38a0162d30 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a0162d30 0x7f38a00b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a00b7360 0x7f38a0155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a0162d30 0x7f38a00b94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:50914/0 (socket says 172.21.15.16:50914) 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 -- 172.21.15.16:0/2929752792 learned_addr learned my addr 172.21.15.16:0/2929752792 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f3897fff640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 0x7f38a00b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 -- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 msgr2=0x7f38a00b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 0x7f38a00b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 -- 172.21.15.16:0/2929752792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a00b7360 msgr2=0x7f38a0155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a00b7360 0x7f38a0155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 -- 172.21.15.16:0/2929752792 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a00b5630 con 0x7f38a0162d30 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389effd640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a00b7360 0x7f38a0155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389f7fe640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a0162d30 0x7f38a00b94a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3898013e80 tx=0x7f3898004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:44.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389cff9640 1 -- 172.21.15.16:0/2929752792 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898020020 con 0x7f38a0162d30 2024-05-11T01:01:44.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389cff9640 1 -- 172.21.15.16:0/2929752792 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389801c810 con 0x7f38a0162d30 2024-05-11T01:01:44.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a00b5910 con 0x7f38a0162d30 2024-05-11T01:01:44.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f389cff9640 1 -- 172.21.15.16:0/2929752792 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389801cbe0 con 0x7f38a0162d30 2024-05-11T01:01:44.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.274+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a00b5ed0 con 0x7f38a0162d30 2024-05-11T01:01:44.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.275+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a006a5b0 con 0x7f38a0162d30 2024-05-11T01:01:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.276+0000 7f389cff9640 1 -- 172.21.15.16:0/2929752792 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3898005d10 con 0x7f38a0162d30 2024-05-11T01:01:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.276+0000 7f389cff9640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38800762d0 0x7f3880078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.277+0000 7f389cff9640 1 -- 172.21.15.16:0/2929752792 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 4943+0+0 (secure 0 0 0) 0x7f38980a0480 con 0x7f38a0162d30 2024-05-11T01:01:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.277+0000 7f389effd640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38800762d0 0x7f3880078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:44.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.277+0000 7f389effd640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38800762d0 0x7f3880078790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38a00b4b10 tx=0x7f3890009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:44.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.281+0000 7f389cff9640 1 -- 172.21.15.16:0/2929752792 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f389802a030 con 0x7f38a0162d30 2024-05-11T01:01:44.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:44.485+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f38a00ba3d0 con 0x7f38a0162d30 2024-05-11T01:01:45.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.097+0000 7f389cff9640 1 -- 172.21.15.16:0/2929752792 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) ==== 97+0+0 (secure 0 0 0) 0x7f3898072040 con 0x7f38a0162d30 2024-05-11T01:01:45.097 INFO:teuthology.orchestra.run.smithi016.stderr: removed all blocklist entries 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.099+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38800762d0 msgr2=0x7f3880078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.099+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38800762d0 0x7f3880078790 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38a00b4b10 tx=0x7f3890009040 comp rx=0 tx=0).stop 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.099+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a0162d30 msgr2=0x7f38a00b94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.099+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a0162d30 0x7f38a00b94a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3898013e80 tx=0x7f3898004410 comp rx=0 tx=0).stop 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.100+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 shutdown_connections 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.100+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f38800762d0 0x7f3880078790 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.100+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f38a0162d30 0x7f38a00b94a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.100+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f38a00baf60 0x7f38a00b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.100+0000 7f38a5a1c640 1 --2- 172.21.15.16:0/2929752792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38a00b7360 0x7f38a0155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.100+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 >> 172.21.15.16:0/2929752792 conn(0x7f38a00d1e20 msgr2=0x7f38a01594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.100+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 shutdown_connections 2024-05-11T01:01:45.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.100+0000 7f38a5a1c640 1 -- 172.21.15.16:0/2929752792 wait complete. 2024-05-11T01:01:45.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-11T01:01:45.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.229+0000 7ff399904640 1 Processor -- start 2024-05-11T01:01:45.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.229+0000 7ff399904640 1 -- start start 2024-05-11T01:01:45.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.230+0000 7ff399904640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff3940d0d40 0x7ff3940b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.230+0000 7ff399904640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff3940d11f0 0x7ff3940b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.230+0000 7ff399904640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3940d1770 con 0x7ff394160360 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.230+0000 7ff399904640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff394163300 con 0x7ff3940d11f0 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.230+0000 7ff399904640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff3941635e0 con 0x7ff3940d0d40 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.230+0000 7ff3937fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff3940d11f0 0x7ff3940b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.230+0000 7ff3937fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff3940d11f0 0x7ff3940b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52144/0 (socket says 172.21.15.16:52144) 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.230+0000 7ff3937fe640 1 -- 172.21.15.16:0/483312755 learned_addr learned my addr 172.21.15.16:0/483312755 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.231+0000 7ff38bfff640 1 --2- 172.21.15.16:0/483312755 >> v2:172.21.15.174:3300/0 conn(0x7ff3940d0d40 0x7ff3940b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.231+0000 7ff3937fe640 1 -- 172.21.15.16:0/483312755 >> v2:172.21.15.174:3300/0 conn(0x7ff3940d0d40 msgr2=0x7ff3940b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.231+0000 7ff3937fe640 1 --2- 172.21.15.16:0/483312755 >> v2:172.21.15.174:3300/0 conn(0x7ff3940d0d40 0x7ff3940b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.231+0000 7ff3937fe640 1 -- 172.21.15.16:0/483312755 >> v1:172.21.15.16:6789/0 conn(0x7ff394160360 legacy=0x7ff394160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.231+0000 7ff3937fe640 1 -- 172.21.15.16:0/483312755 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3941638c0 con 0x7ff3940d11f0 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.231+0000 7ff3937fe640 1 --2- 172.21.15.16:0/483312755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3940d11f0 0x7ff3940b5230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff39415fd10 tx=0x7ff38c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79661b5e57c204c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.231+0000 7ff3927fc640 1 -- 172.21.15.16:0/483312755 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c036070 con 0x7ff3940d11f0 2024-05-11T01:01:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.231+0000 7ff3927fc640 1 -- 172.21.15.16:0/483312755 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c031600 con 0x7ff3940d11f0 2024-05-11T01:01:45.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff3927fc640 1 -- 172.21.15.16:0/483312755 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c0319d0 con 0x7ff3940d11f0 2024-05-11T01:01:45.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff399904640 1 -- 172.21.15.16:0/483312755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3940d11f0 msgr2=0x7ff3940b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff399904640 1 --2- 172.21.15.16:0/483312755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3940d11f0 0x7ff3940b5230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff39415fd10 tx=0x7ff38c02a730 comp rx=0 tx=0).stop 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff399904640 1 -- 172.21.15.16:0/483312755 shutdown_connections 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff399904640 1 --2- 172.21.15.16:0/483312755 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3940d11f0 0x7ff3940b5230 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff399904640 1 --2- 172.21.15.16:0/483312755 >> v2:172.21.15.174:3300/0 conn(0x7ff3940d0d40 0x7ff3940b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff399904640 1 -- 172.21.15.16:0/483312755 >> 172.21.15.16:0/483312755 conn(0x7ff3940681c0 msgr2=0x7ff3940685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff399904640 1 -- 172.21.15.16:0/483312755 shutdown_connections 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.232+0000 7ff399904640 1 -- 172.21.15.16:0/483312755 wait complete. 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.233+0000 7ff399904640 1 Processor -- start 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.233+0000 7ff399904640 1 -- start start 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff399904640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3940d0d40 0x7ff39406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff399904640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3940d11f0 0x7ff3940b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff399904640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff394160360 0x7ff3941f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff399904640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3941640c0 con 0x7ff394160360 2024-05-11T01:01:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff399904640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940d2d70 con 0x7ff3940d11f0 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff399904640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff39406ea10 con 0x7ff3940d0d40 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff3937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff394160360 0x7ff3941f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff3937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff394160360 0x7ff3941f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52148/0 (socket says 172.21.15.16:52148) 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.234+0000 7ff3937fe640 1 -- 172.21.15.16:0/969660843 learned_addr learned my addr 172.21.15.16:0/969660843 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff38bfff640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3940d11f0 0x7ff3940b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff392ffd640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3940d0d40 0x7ff39406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff3937fe640 1 -- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3940d0d40 msgr2=0x7ff39406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff3937fe640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3940d0d40 0x7ff39406eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff3937fe640 1 -- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3940d11f0 msgr2=0x7ff3940b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff3937fe640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3940d11f0 0x7ff3940b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff3937fe640 1 -- 172.21.15.16:0/969660843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3940ccfe0 con 0x7ff394160360 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff38bfff640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3940d11f0 0x7ff3940b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff3937fe640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff394160360 0x7ff3941f6bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff38c034040 tx=0x7ff38c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff390ff9640 1 -- 172.21.15.16:0/969660843 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c036050 con 0x7ff394160360 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff390ff9640 1 -- 172.21.15.16:0/969660843 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c042070 con 0x7ff394160360 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39406de00 con 0x7ff394160360 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff390ff9640 1 -- 172.21.15.16:0/969660843 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c009510 con 0x7ff394160360 2024-05-11T01:01:45.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.235+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39406e3c0 con 0x7ff394160360 2024-05-11T01:01:45.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.236+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39406a5b0 con 0x7ff394160360 2024-05-11T01:01:45.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.237+0000 7ff390ff9640 1 -- 172.21.15.16:0/969660843 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff38c007bf0 con 0x7ff394160360 2024-05-11T01:01:45.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.237+0000 7ff390ff9640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff3740762d0 0x7ff374078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.237+0000 7ff390ff9640 1 -- 172.21.15.16:0/969660843 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ff38c0b8090 con 0x7ff394160360 2024-05-11T01:01:45.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.237+0000 7ff392ffd640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff3740762d0 0x7ff374078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.238+0000 7ff392ffd640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff3740762d0 0x7ff374078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff39415b430 tx=0x7ff384009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:45.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.242+0000 7ff390ff9640 1 -- 172.21.15.16:0/969660843 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff38c081d40 con 0x7ff394160360 2024-05-11T01:01:45.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.503+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff394164240 con 0x7ff394160360 2024-05-11T01:01:45.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.503+0000 7ff390ff9640 1 -- 172.21.15.16:0/969660843 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7ff38c081640 con 0x7ff394160360 2024-05-11T01:01:45.503 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_dump": [ 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.a", 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5m18ZJIBAA7zAsyHoQQooYHziHMr9fUQ==", 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.504 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.b", 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5mrUExLBAAN/gCmP67f9XLzKifNRagiw==", 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.c", 2024-05-11T01:01:45.505 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5m6hODJxAAK9XmxeYzlY0MvVdtQD2bxQ==", 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.d", 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5mn2dBMxAA38Wxx8t36Kww9TwJ+FFW8Q==", 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:01:45.506 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.0", 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAnwz5m3HlEHRAA6Z8NONh+ZQzXoAjwLX+3xQ==", 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.507 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.1", 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAqwz5m55iZGxAA3NTF614jMZhlpM4tYEBKkQ==", 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.2", 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAtwz5m6VowGhAAmCPoZK5bb0bPWvTNHBRykQ==", 2024-05-11T01:01:45.508 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.3", 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAwwz5mbn/5GBAAFmx+UKt4TOsDDLu1NvO/xg==", 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.509 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.4", 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQA2wz5mHW6LIRAAoJJJ04swD7SsPX1eEyWtwA==", 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.5", 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQA5wz5mlZlNIBAArpMYv4k/n2pfGYRpao6y9g==", 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.510 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.6", 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQA8wz5m2QWbHhAAkG756Er+q0gg17SPmGEzeA==", 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.511 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.7", 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQA/wz5m3v3aHBAAoeD297XRIx25RQY6XMd4vA==", 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.0", 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5mBE92NxAAwjJJ4BDqTpd7qQZiD1YlYA==", 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:01:45.512 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.1", 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAmwz5mpmDeBBAAoDYEIl6yNYSP6cecHiuAOA==", 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2024-05-11T01:01:45.513 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.2", 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAmwz5mTECQARAAW1u1LX01lSAH9D0IFc52CA==", 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.3", 2024-05-11T01:01:45.514 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAmwz5mVXd+ChAAPBYtXP8NrccAP8qppA3JnA==", 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.admin", 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5m1eQwBBAAmqwFxl4DamxEWHidDzKgrA==", 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:01:45.515 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-mds", 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQBFwz5mX7GgFBAAGy+udj0y9IGF3HMudXgD0g==", 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-mds" 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-mgr", 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQBFwz5mjbmgFBAAPozz+ZzlAANwaGy3T71CcA==", 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.516 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-osd", 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQBFwz5mwsCgFBAALjhwvLTGVc1YlUrkFBIPkA==", 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-osd" 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rbd", 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQBFwz5mHMigFBAASXYsKtHdmvxiaHRbVBzmgg==", 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-11T01:01:45.517 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQBFwz5mm8+gFBAAotALKh1WXaq7QsaEbt8XAw==", 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rgw", 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQBFwz5mRNegFBAAOXIhamXy9ZQIFDH5j6N3TQ==", 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-11T01:01:45.518 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.x", 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5mbhnwHBAAwY5+kkQlvHmV7umsy3EEFw==", 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.y", 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5m45Y3GRAAxdsBni25ybahhd/vsNP/1A==", 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:01:45.519 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-05-11T01:01:45.520 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2024-05-11T01:01:45.520 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:01:45.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.520 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:45.520 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-11T01:01:45.520 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:01:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff3740762d0 msgr2=0x7ff374078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff3740762d0 0x7ff374078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff39415b430 tx=0x7ff384009040 comp rx=0 tx=0).stop 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff394160360 msgr2=0x7ff3941f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff394160360 0x7ff3941f6bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff38c034040 tx=0x7ff38c004a40 comp rx=0 tx=0).stop 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 shutdown_connections 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff3740762d0 0x7ff374078790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff394160360 0x7ff3941f6bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3940d11f0 0x7ff3940b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 --2- 172.21.15.16:0/969660843 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff3940d0d40 0x7ff39406eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 >> 172.21.15.16:0/969660843 conn(0x7ff3940681c0 msgr2=0x7ff394159580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 shutdown_connections 2024-05-11T01:01:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.505+0000 7ff399904640 1 -- 172.21.15.16:0/969660843 wait complete. 2024-05-11T01:01:45.523 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-11T01:01:45.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.628+0000 7f189b1c8640 1 Processor -- start 2024-05-11T01:01:45.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.628+0000 7f189b1c8640 1 -- start start 2024-05-11T01:01:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.628+0000 7f189b1c8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f18940b6d70 0x7f18940b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.628+0000 7f189b1c8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1894163e90 con 0x7f18940bac10 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f189b1c8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189406e230 con 0x7f18940d4990 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f189b1c8640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f18940cfad0 con 0x7f18940b6d70 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f1893fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f18940bac10 0x7f189406d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57914/0 (socket says 172.21.15.16:57914) 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f1893fff640 1 -- 172.21.15.16:0/3180411929 learned_addr learned my addr 172.21.15.16:0/3180411929 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f1898f64640 1 --2- 172.21.15.16:0/3180411929 >> v2:172.21.15.174:3300/0 conn(0x7f18940b6d70 0x7f18940b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947757884 0 0) 0x7f1894163e90 con 0x7f18940bac10 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1884003520 con 0x7f18940bac10 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 266969390 0 0) 0x7f1884003520 con 0x7f18940bac10 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 >> v2:172.21.15.174:3300/0 conn(0x7f18940b6d70 msgr2=0x7f18940b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 --2- 172.21.15.16:0/3180411929 >> v2:172.21.15.174:3300/0 conn(0x7f18940b6d70 0x7f18940b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 >> v1:172.21.15.174:6789/0 conn(0x7f18940d4990 legacy=0x7f189406db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18940b7690 con 0x7f18940bac10 2024-05-11T01:01:45.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f18800016f0 con 0x7f18940bac10 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 >> v1:172.21.15.16:6789/0 conn(0x7f18940bac10 legacy=0x7f189406d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f1884003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1884004800 0x7f1884004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18840052e0 0x7f188400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18940cfad0 con 0x7f1884003a50 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f188400c1b0 con 0x7f1884004800 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f188400c3b0 con 0x7f18840052e0 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.629+0000 7f1898f64640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f1884003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.630+0000 7f1893fff640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1884004800 0x7f1884004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.630+0000 7f1899765640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18840052e0 0x7f188400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.630+0000 7f1898f64640 1 -- 172.21.15.16:0/3180411929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18840052e0 msgr2=0x7f188400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.630+0000 7f1898f64640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18840052e0 0x7f188400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.630+0000 7f1898f64640 1 -- 172.21.15.16:0/3180411929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1884004800 msgr2=0x7f1884004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.630+0000 7f1898f64640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1884004800 0x7f1884004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.630+0000 7f1898f64640 1 -- 172.21.15.16:0/3180411929 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1884003520 con 0x7f1884003a50 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.630+0000 7f1899765640 1 -- 172.21.15.16:0/3180411929 reap_dead start 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f1898f64640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f1884003e70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1888009a90 tx=0x7f1884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db179cd66a188aba server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888036070 con 0x7f1884003a50 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888031400 con 0x7f1884003a50 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f18937fe640 1 -- 172.21.15.16:0/3180411929 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888009690 con 0x7f1884003a50 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f189b1c8640 1 -- 172.21.15.16:0/3180411929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 msgr2=0x7f1884003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f189b1c8640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f1884003e70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1888009a90 tx=0x7f1884005830 comp rx=0 tx=0).stop 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f189b1c8640 1 -- 172.21.15.16:0/3180411929 shutdown_connections 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f189b1c8640 1 --2- 172.21.15.16:0/3180411929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f1884003e70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f189b1c8640 1 -- 172.21.15.16:0/3180411929 >> 172.21.15.16:0/3180411929 conn(0x7f1894074140 msgr2=0x7f18940d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f189b1c8640 1 -- 172.21.15.16:0/3180411929 shutdown_connections 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.631+0000 7f189b1c8640 1 -- 172.21.15.16:0/3180411929 wait complete. 2024-05-11T01:01:45.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.632+0000 7f189b1c8640 1 Processor -- start 2024-05-11T01:01:45.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.633+0000 7f189b1c8640 1 -- start start 2024-05-11T01:01:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.633+0000 7f189b1c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f189415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.633+0000 7f189b1c8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18940abcf0 0x7f1894160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.633+0000 7f189b1c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18940ac150 0x7f1894160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.633+0000 7f189b1c8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f18941638d0 con 0x7f1884003a50 2024-05-11T01:01:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.633+0000 7f189b1c8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18941635f0 con 0x7f18940abcf0 2024-05-11T01:01:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.633+0000 7f189b1c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1894163bb0 con 0x7f18940ac150 2024-05-11T01:01:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f189415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f189415ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52168/0 (socket says 172.21.15.16:52168) 2024-05-11T01:01:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 -- 172.21.15.16:0/553424310 learned_addr learned my addr 172.21.15.16:0/553424310 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:45.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1893fff640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18940abcf0 0x7f1894160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1899765640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18940ac150 0x7f1894160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 -- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18940ac150 msgr2=0x7f1894160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18940ac150 0x7f1894160b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 -- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18940abcf0 msgr2=0x7f1894160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18940abcf0 0x7f1894160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 -- 172.21.15.16:0/553424310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1894161410 con 0x7f1884003a50 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1899765640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18940ac150 0x7f1894160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f1898f64640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f189415ea90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1888034040 tx=0x7f1888004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f18917fa640 1 -- 172.21.15.16:0/553424310 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188803f020 con 0x7f1884003a50 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f18917fa640 1 -- 172.21.15.16:0/553424310 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888037040 con 0x7f1884003a50 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18941616f0 con 0x7f1884003a50 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f18917fa640 1 -- 172.21.15.16:0/553424310 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888036070 con 0x7f1884003a50 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.634+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1894161cb0 con 0x7f1884003a50 2024-05-11T01:01:45.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.635+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f189406a5b0 con 0x7f1884003a50 2024-05-11T01:01:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.636+0000 7f18917fa640 1 -- 172.21.15.16:0/553424310 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1888042020 con 0x7f1884003a50 2024-05-11T01:01:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.637+0000 7f18917fa640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18780762d0 0x7f1878078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.637+0000 7f18917fa640 1 -- 172.21.15.16:0/553424310 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f18880b6ff0 con 0x7f1884003a50 2024-05-11T01:01:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.637+0000 7f1893fff640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18780762d0 0x7f1878078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.637+0000 7f1893fff640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18780762d0 0x7f1878078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18941603b0 tx=0x7f1880001e70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:45.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.641+0000 7f18917fa640 1 -- 172.21.15.16:0/553424310 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1888049070 con 0x7f1884003a50 2024-05-11T01:01:45.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.904+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f189414ef40 con 0x7f1884003a50 2024-05-11T01:01:45.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.906+0000 7f18917fa640 1 -- 172.21.15.16:0/553424310 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f1888080580 con 0x7f1884003a50 2024-05-11T01:01:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18780762d0 msgr2=0x7f1878078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18780762d0 0x7f1878078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18941603b0 tx=0x7f1880001e70 comp rx=0 tx=0).stop 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 msgr2=0x7f189415ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f189415ea90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1888034040 tx=0x7f1888004730 comp rx=0 tx=0).stop 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 shutdown_connections 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f18780762d0 0x7f1878078790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f18940ac150 0x7f1894160b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18940abcf0 0x7f1894160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 --2- 172.21.15.16:0/553424310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1884003a50 0x7f189415ea90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.908+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 >> 172.21.15.16:0/553424310 conn(0x7f1894074140 msgr2=0x7f18940b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.909+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 shutdown_connections 2024-05-11T01:01:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:45.909+0000 7f189b1c8640 1 -- 172.21.15.16:0/553424310 wait complete. 2024-05-11T01:01:45.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-11T01:01:46.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.024+0000 7f7758645640 1 Processor -- start 2024-05-11T01:01:46.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.024+0000 7f7758645640 1 -- start start 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.024+0000 7f7758645640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77500b6d70 0x7f77500b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f7758645640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750163e90 con 0x7f77500bac10 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f7758645640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775006e230 con 0x7f77500d4990 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f7758645640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f77500cfad0 con 0x7f77500b6d70 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f77563e1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77500b6d70 0x7f77500b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f77563e1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77500b6d70 0x7f77500b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52172/0 (socket says 172.21.15.16:52172) 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f77563e1640 1 -- 172.21.15.16:0/3761196220 learned_addr learned my addr 172.21.15.16:0/3761196220 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f77563e1640 1 -- 172.21.15.16:0/3761196220 >> v1:172.21.15.174:6789/0 conn(0x7f77500d4990 legacy=0x7f775006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f77563e1640 1 -- 172.21.15.16:0/3761196220 >> v1:172.21.15.16:6789/0 conn(0x7f77500bac10 legacy=0x7f775006d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.025+0000 7f77563e1640 1 -- 172.21.15.16:0/3761196220 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77500b7690 con 0x7f77500b6d70 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.026+0000 7f77563e1640 1 --2- 172.21.15.16:0/3761196220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77500b7150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f774c0098a0 tx=0x7f774c02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781c478130c7c0a server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.026+0000 7f77553df640 1 -- 172.21.15.16:0/3761196220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c037070 con 0x7f77500b6d70 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.026+0000 7f77553df640 1 -- 172.21.15.16:0/3761196220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c032440 con 0x7f77500b6d70 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.026+0000 7f77553df640 1 -- 172.21.15.16:0/3761196220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c032810 con 0x7f77500b6d70 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.026+0000 7f7758645640 1 -- 172.21.15.16:0/3761196220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 msgr2=0x7f77500b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.026+0000 7f7758645640 1 --2- 172.21.15.16:0/3761196220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77500b7150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f774c0098a0 tx=0x7f774c02a290 comp rx=0 tx=0).stop 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.027+0000 7f7758645640 1 -- 172.21.15.16:0/3761196220 shutdown_connections 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.027+0000 7f7758645640 1 --2- 172.21.15.16:0/3761196220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77500b7150 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.027+0000 7f7758645640 1 -- 172.21.15.16:0/3761196220 >> 172.21.15.16:0/3761196220 conn(0x7f7750074140 msgr2=0x7f77500d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.027+0000 7f7758645640 1 -- 172.21.15.16:0/3761196220 shutdown_connections 2024-05-11T01:01:46.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.027+0000 7f7758645640 1 -- 172.21.15.16:0/3761196220 wait complete. 2024-05-11T01:01:46.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.028+0000 7f7758645640 1 Processor -- start 2024-05-11T01:01:46.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.028+0000 7f7758645640 1 -- start start 2024-05-11T01:01:46.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7758645640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77501f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7758645640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77500bac10 0x7f7750161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7758645640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77500d4990 0x7f7750161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7758645640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f77501638d0 con 0x7f77500b6d70 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7758645640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f77501635f0 con 0x7f77500d4990 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7758645640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7750163bb0 con 0x7f77500bac10 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77501f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77501f8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52174/0 (socket says 172.21.15.16:52174) 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 -- 172.21.15.16:0/2086509478 learned_addr learned my addr 172.21.15.16:0/2086509478 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7755be0640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77500bac10 0x7f7750161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7756be2640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77500d4990 0x7f7750161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 -- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77500bac10 msgr2=0x7f7750161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77500bac10 0x7f7750161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 -- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77500d4990 msgr2=0x7f7750161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77500d4990 0x7f7750161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 -- 172.21.15.16:0/2086509478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77500cd1f0 con 0x7f77500b6d70 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7755be0640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77500bac10 0x7f7750161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:46.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f7756be2640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77500d4990 0x7f7750161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:46.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.029+0000 7f77563e1640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77501f8830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f774c000c00 tx=0x7f774c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.030+0000 7f7746ffd640 1 -- 172.21.15.16:0/2086509478 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c037040 con 0x7f77500b6d70 2024-05-11T01:01:46.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.030+0000 7f7746ffd640 1 -- 172.21.15.16:0/2086509478 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c042070 con 0x7f77500b6d70 2024-05-11T01:01:46.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.030+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77500cd4d0 con 0x7f77500b6d70 2024-05-11T01:01:46.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.030+0000 7f7746ffd640 1 -- 172.21.15.16:0/2086509478 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c030bd0 con 0x7f77500b6d70 2024-05-11T01:01:46.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.030+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77500cda90 con 0x7f77500b6d70 2024-05-11T01:01:46.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.031+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775006a5b0 con 0x7f77500b6d70 2024-05-11T01:01:46.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.031+0000 7f7746ffd640 1 -- 172.21.15.16:0/2086509478 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f774c047460 con 0x7f77500b6d70 2024-05-11T01:01:46.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.032+0000 7f7746ffd640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f77340762d0 0x7f7734078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.032+0000 7f7746ffd640 1 -- 172.21.15.16:0/2086509478 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f774c0b7ee0 con 0x7f77500b6d70 2024-05-11T01:01:46.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.032+0000 7f7755be0640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f77340762d0 0x7f7734078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.032+0000 7f7755be0640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f77340762d0 0x7f7734078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7740007fd0 tx=0x7f7740009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.036+0000 7f7746ffd640 1 -- 172.21.15.16:0/2086509478 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f774c081b90 con 0x7f77500b6d70 2024-05-11T01:01:46.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.301+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f77500ba9f0 con 0x7f77500b6d70 2024-05-11T01:01:46.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.303+0000 7f7746ffd640 1 -- 172.21.15.16:0/2086509478 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f774c081490 con 0x7f77500b6d70 2024-05-11T01:01:46.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f77340762d0 msgr2=0x7f7734078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f77340762d0 0x7f7734078790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7740007fd0 tx=0x7f7740009040 comp rx=0 tx=0).stop 2024-05-11T01:01:46.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 msgr2=0x7f77501f8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77501f8830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f774c000c00 tx=0x7f774c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 shutdown_connections 2024-05-11T01:01:46.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f77340762d0 0x7f7734078790 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77500d4990 0x7f7750161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f77500bac10 0x7f7750161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 --2- 172.21.15.16:0/2086509478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77500b6d70 0x7f77501f8830 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 >> 172.21.15.16:0/2086509478 conn(0x7f7750074140 msgr2=0x7f77500b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:46.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 shutdown_connections 2024-05-11T01:01:46.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.305+0000 7f7758645640 1 -- 172.21.15.16:0/2086509478 wait complete. 2024-05-11T01:01:46.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-11T01:01:46.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.421+0000 7f825b093640 1 Processor -- start 2024-05-11T01:01:46.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.421+0000 7f825b093640 1 -- start start 2024-05-11T01:01:46.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.422+0000 7f825b093640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f825415b030 0x7f825415da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.422+0000 7f825b093640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 0x7f82540cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.422+0000 7f825b093640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825415b410 con 0x7f82540cd7e0 2024-05-11T01:01:46.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.422+0000 7f825b093640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f82540d3dd0 con 0x7f825415b030 2024-05-11T01:01:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.422+0000 7f825b093640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f82540d31c0 con 0x7f82540b5400 2024-05-11T01:01:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.422+0000 7f8258e2f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f825415b030 0x7f825415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.422+0000 7f8258e2f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f825415b030 0x7f825415da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52190/0 (socket says 172.21.15.16:52190) 2024-05-11T01:01:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.422+0000 7f8258e2f640 1 -- 172.21.15.16:0/1088566997 learned_addr learned my addr 172.21.15.16:0/1088566997 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.423+0000 7f8259630640 1 --2- 172.21.15.16:0/1088566997 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 0x7f82540cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.423+0000 7f8258e2f640 1 -- 172.21.15.16:0/1088566997 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 msgr2=0x7f82540cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.423+0000 7f8258e2f640 1 --2- 172.21.15.16:0/1088566997 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 0x7f82540cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.423+0000 7f8258e2f640 1 -- 172.21.15.16:0/1088566997 >> v1:172.21.15.16:6789/0 conn(0x7f82540cd7e0 legacy=0x7f82540b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.423+0000 7f8258e2f640 1 -- 172.21.15.16:0/1088566997 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82540d34a0 con 0x7f825415b030 2024-05-11T01:01:46.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.423+0000 7f8258e2f640 1 --2- 172.21.15.16:0/1088566997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f825415da00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f824c0098a0 tx=0x7f824c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0320c6f0aea62b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f82537fe640 1 -- 172.21.15.16:0/1088566997 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c037070 con 0x7f825415b030 2024-05-11T01:01:46.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f82537fe640 1 -- 172.21.15.16:0/1088566997 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c032440 con 0x7f825415b030 2024-05-11T01:01:46.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f82537fe640 1 -- 172.21.15.16:0/1088566997 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c032810 con 0x7f825415b030 2024-05-11T01:01:46.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f825b093640 1 -- 172.21.15.16:0/1088566997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 msgr2=0x7f825415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f825b093640 1 --2- 172.21.15.16:0/1088566997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f825415da00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f824c0098a0 tx=0x7f824c02a160 comp rx=0 tx=0).stop 2024-05-11T01:01:46.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f825b093640 1 -- 172.21.15.16:0/1088566997 shutdown_connections 2024-05-11T01:01:46.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f825b093640 1 --2- 172.21.15.16:0/1088566997 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 0x7f82540cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f825b093640 1 --2- 172.21.15.16:0/1088566997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f825415da00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f825b093640 1 -- 172.21.15.16:0/1088566997 >> 172.21.15.16:0/1088566997 conn(0x7f8254072850 msgr2=0x7f82540681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f825b093640 1 -- 172.21.15.16:0/1088566997 shutdown_connections 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.424+0000 7f825b093640 1 -- 172.21.15.16:0/1088566997 wait complete. 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.425+0000 7f825b093640 1 Processor -- start 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.425+0000 7f825b093640 1 -- start start 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.426+0000 7f825b093640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 0x7f82541592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.426+0000 7f825b093640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540cd7e0 0x7f82541597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.426+0000 7f825b093640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f82540cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.426+0000 7f825b093640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f82540cf810 con 0x7f825415b030 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.426+0000 7f825b093640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f82540d3a60 con 0x7f82540cd7e0 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.426+0000 7f825b093640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f82541610f0 con 0x7f82540b5400 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.426+0000 7f8259630640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f82540cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8259630640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f82540cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52192/0 (socket says 172.21.15.16:52192) 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8259630640 1 -- 172.21.15.16:0/1596567017 learned_addr learned my addr 172.21.15.16:0/1596567017 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8258e2f640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 0x7f82541592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8253fff640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540cd7e0 0x7f82541597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8259630640 1 -- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 msgr2=0x7f82541592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8259630640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 0x7f82541592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8259630640 1 -- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540cd7e0 msgr2=0x7f82541597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8259630640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540cd7e0 0x7f82541597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8259630640 1 -- 172.21.15.16:0/1596567017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82540c8bb0 con 0x7f825415b030 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f8259630640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f82540cc6e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8244007e60 tx=0x7f824400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f82517fa640 1 -- 172.21.15.16:0/1596567017 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244014620 con 0x7f825415b030 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f82517fa640 1 -- 172.21.15.16:0/1596567017 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8244019070 con 0x7f825415b030 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82540c8e90 con 0x7f825415b030 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f82517fa640 1 -- 172.21.15.16:0/1596567017 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244014a00 con 0x7f825415b030 2024-05-11T01:01:46.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.427+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82540c9450 con 0x7f825415b030 2024-05-11T01:01:46.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.428+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825406a5b0 con 0x7f825415b030 2024-05-11T01:01:46.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.429+0000 7f82517fa640 1 -- 172.21.15.16:0/1596567017 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8244014ba0 con 0x7f825415b030 2024-05-11T01:01:46.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.429+0000 7f82517fa640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f82340762d0 0x7f8234078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.429+0000 7f82517fa640 1 -- 172.21.15.16:0/1596567017 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f8244097be0 con 0x7f825415b030 2024-05-11T01:01:46.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.430+0000 7f8258e2f640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f82340762d0 0x7f8234078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.430+0000 7f8258e2f640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f82340762d0 0x7f8234078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f824c034000 tx=0x7f824c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.434+0000 7f82517fa640 1 -- 172.21.15.16:0/1596567017 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8244061890 con 0x7f825415b030 2024-05-11T01:01:46.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.702+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f82540d0240 con 0x7f825415b030 2024-05-11T01:01:46.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.703+0000 7f82517fa640 1 -- 172.21.15.16:0/1596567017 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f8244061190 con 0x7f825415b030 2024-05-11T01:01:46.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.705+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f82340762d0 msgr2=0x7f8234078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.705+0000 7f825b093640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f82340762d0 0x7f8234078790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f824c034000 tx=0x7f824c02e000 comp rx=0 tx=0).stop 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.705+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 msgr2=0x7f82540cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.705+0000 7f825b093640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f82540cc6e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8244007e60 tx=0x7f824400e4b0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.706+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 shutdown_connections 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.706+0000 7f825b093640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f82340762d0 0x7f8234078790 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.706+0000 7f825b093640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f825415b030 0x7f82540cc6e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.706+0000 7f825b093640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f82540cd7e0 0x7f82541597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.706+0000 7f825b093640 1 --2- 172.21.15.16:0/1596567017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f82540b5400 0x7f82541592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.706+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 >> 172.21.15.16:0/1596567017 conn(0x7f8254072850 msgr2=0x7f825415d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.706+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 shutdown_connections 2024-05-11T01:01:46.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.706+0000 7f825b093640 1 -- 172.21.15.16:0/1596567017 wait complete. 2024-05-11T01:01:46.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-11T01:01:46.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.821+0000 7ffb836da640 1 Processor -- start 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.822+0000 7ffb836da640 1 -- start start 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb836da640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffb7c0d0f20 0x7ffb7c15fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb836da640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb7c0709d0 con 0x7ffb7c06e8e0 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb836da640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb7c06ef70 con 0x7ffb7c0b51d0 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb836da640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ffb7c06ed40 con 0x7ffb7c0d0f20 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb80c75640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ffb7c06e8e0 0x7ffb7c0b4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57952/0 (socket says 172.21.15.16:57952) 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb80c75640 1 -- 172.21.15.16:0/348477143 learned_addr learned my addr 172.21.15.16:0/348477143 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb81476640 1 --2- 172.21.15.16:0/348477143 >> v2:172.21.15.174:3300/0 conn(0x7ffb7c0d0f20 0x7ffb7c15fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881718471 0 0) 0x7ffb7c0709d0 con 0x7ffb7c06e8e0 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb64003520 con 0x7ffb7c06e8e0 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 454221267 0 0) 0x7ffb64003520 con 0x7ffb7c06e8e0 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 >> v2:172.21.15.174:3300/0 conn(0x7ffb7c0d0f20 msgr2=0x7ffb7c15fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:46.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 --2- 172.21.15.16:0/348477143 >> v2:172.21.15.174:3300/0 conn(0x7ffb7c0d0f20 0x7ffb7c15fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 >> v1:172.21.15.174:6789/0 conn(0x7ffb7c0b51d0 legacy=0x7ffb7c06c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c06f250 con 0x7ffb7c06e8e0 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7ffb700016f0 con 0x7ffb7c06e8e0 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 >> v1:172.21.15.16:6789/0 conn(0x7ffb7c06e8e0 legacy=0x7ffb7c0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb64003a50 0x7ffb64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb64004800 0x7ffb64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb640051c0 0x7ffb6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6400c130 con 0x7ffb640051c0 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6400c2e0 con 0x7ffb64003a50 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6400c4e0 con 0x7ffb64004800 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.823+0000 7ffb81c77640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb640051c0 0x7ffb6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb81476640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb64003a50 0x7ffb64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb80c75640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb64004800 0x7ffb64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb81c77640 1 -- 172.21.15.16:0/348477143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb64004800 msgr2=0x7ffb64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb81c77640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb64004800 0x7ffb64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb81c77640 1 -- 172.21.15.16:0/348477143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb64003a50 msgr2=0x7ffb64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb81c77640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb64003a50 0x7ffb64003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb81c77640 1 -- 172.21.15.16:0/348477143 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb64003520 con 0x7ffb640051c0 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb81c77640 1 -- 172.21.15.16:0/348477143 reap_dead start 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.824+0000 7ffb81c77640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb640051c0 0x7ffb6400b9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb74001790 tx=0x7ffb64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a949dad4ba56b9c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb740013b0 con 0x7ffb640051c0 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb740052d0 con 0x7ffb640051c0 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb7bfff640 1 -- 172.21.15.16:0/348477143 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7402ab20 con 0x7ffb640051c0 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb836da640 1 -- 172.21.15.16:0/348477143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb640051c0 msgr2=0x7ffb6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb836da640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb640051c0 0x7ffb6400b9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb74001790 tx=0x7ffb64005830 comp rx=0 tx=0).stop 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb836da640 1 -- 172.21.15.16:0/348477143 shutdown_connections 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb836da640 1 --2- 172.21.15.16:0/348477143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb640051c0 0x7ffb6400b9c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb836da640 1 -- 172.21.15.16:0/348477143 >> 172.21.15.16:0/348477143 conn(0x7ffb7c0b3d60 msgr2=0x7ffb7c0d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb836da640 1 -- 172.21.15.16:0/348477143 shutdown_connections 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.825+0000 7ffb836da640 1 -- 172.21.15.16:0/348477143 wait complete. 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.826+0000 7ffb836da640 1 Processor -- start 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.826+0000 7ffb836da640 1 -- start start 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb836da640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb640051c0 0x7ffb7c1f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb836da640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb7c14e9c0 0x7ffb7c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb836da640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb7c0b2470 0x7ffb7c0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb836da640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c06f810 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb836da640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c06fb80 con 0x7ffb640051c0 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb836da640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffb7c0d1300 con 0x7ffb7c0b2470 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb80c75640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb7c14e9c0 0x7ffb7c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb80c75640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb7c14e9c0 0x7ffb7c150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52198/0 (socket says 172.21.15.16:52198) 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb80c75640 1 -- 172.21.15.16:0/865240553 learned_addr learned my addr 172.21.15.16:0/865240553 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb81c77640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb7c0b2470 0x7ffb7c0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.827+0000 7ffb81476640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb640051c0 0x7ffb7c1f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb80c75640 1 -- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb7c0b2470 msgr2=0x7ffb7c0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb80c75640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb7c0b2470 0x7ffb7c0b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb80c75640 1 -- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb640051c0 msgr2=0x7ffb7c1f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb80c75640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb640051c0 0x7ffb7c1f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb80c75640 1 -- 172.21.15.16:0/865240553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c1508b0 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb81c77640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb7c0b2470 0x7ffb7c0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb81476640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb640051c0 0x7ffb7c1f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb80c75640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb7c14e9c0 0x7ffb7c150370 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb70007fd0 tx=0x7ffb700077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb79ffb640 1 -- 172.21.15.16:0/865240553 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7001a070 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb79ffb640 1 -- 172.21.15.16:0/865240553 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7000f9c0 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c14bfc0 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb79ffb640 1 -- 172.21.15.16:0/865240553 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000fdd0 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.828+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c150b50 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.829+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c06a5b0 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.830+0000 7ffb79ffb640 1 -- 172.21.15.16:0/865240553 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb7001d070 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.830+0000 7ffb79ffb640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffb680762d0 0x7ffb68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.831+0000 7ffb79ffb640 1 -- 172.21.15.16:0/865240553 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7ffb70096d10 con 0x7ffb7c14e9c0 2024-05-11T01:01:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.831+0000 7ffb81476640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffb680762d0 0x7ffb68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.831+0000 7ffb81476640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffb680762d0 0x7ffb68078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c007520 tx=0x7ffb6c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:46.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:46.835+0000 7ffb79ffb640 1 -- 172.21.15.16:0/865240553 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffb7009c020 con 0x7ffb7c14e9c0 2024-05-11T01:01:47.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.103+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ffb7c0d0a90 con 0x7ffb7c14e9c0 2024-05-11T01:01:47.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.105+0000 7ffb79ffb640 1 -- 172.21.15.16:0/865240553 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7ffb700609b0 con 0x7ffb7c14e9c0 2024-05-11T01:01:47.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffb680762d0 msgr2=0x7ffb68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffb680762d0 0x7ffb68078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c007520 tx=0x7ffb6c00b040 comp rx=0 tx=0).stop 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb7c14e9c0 msgr2=0x7ffb7c150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb7c14e9c0 0x7ffb7c150370 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffb70007fd0 tx=0x7ffb700077a0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 shutdown_connections 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ffb680762d0 0x7ffb68078790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffb7c0b2470 0x7ffb7c0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb7c14e9c0 0x7ffb7c150370 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 --2- 172.21.15.16:0/865240553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb640051c0 0x7ffb7c1f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.107+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 >> 172.21.15.16:0/865240553 conn(0x7ffb7c0b3d60 msgr2=0x7ffb7c1610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.108+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 shutdown_connections 2024-05-11T01:01:47.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.108+0000 7ffb836da640 1 -- 172.21.15.16:0/865240553 wait complete. 2024-05-11T01:01:47.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-11T01:01:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.223+0000 7f64cdd19640 1 Processor -- start 2024-05-11T01:01:47.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.223+0000 7f64cdd19640 1 -- start start 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64cdd19640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c815da00 0x7f64c80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64cdd19640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c815b410 con 0x7f64c80b5230 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64cdd19640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64c80d31c0 con 0x7f64c815b030 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64cdd19640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f64c80b5680 con 0x7f64c815da00 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c7fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f64c80b5230 0x7f64c81610f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57964/0 (socket says 172.21.15.16:57964) 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c7fff640 1 -- 172.21.15.16:0/4168095300 learned_addr learned my addr 172.21.15.16:0/4168095300 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181690941 0 0) 0x7f64c815b410 con 0x7f64c80b5230 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c6ffd640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c815da00 0x7f64c80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64b0003520 con 0x7f64c80b5230 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 522639922 0 0) 0x7f64b0003520 con 0x7f64c80b5230 2024-05-11T01:01:47.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c815da00 msgr2=0x7f64c80b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c815da00 0x7f64c80b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 >> v1:172.21.15.174:6789/0 conn(0x7f64c815b030 legacy=0x7f64c80cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c80d34a0 con 0x7f64c80b5230 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f64c0001a70 con 0x7f64c80b5230 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 >> v1:172.21.15.16:6789/0 conn(0x7f64c80b5230 legacy=0x7f64c81610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64b0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c815da00 0x7f64b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64b0004d90 0x7f64b00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80b5680 con 0x7f64b0003a30 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f64b000bc50 con 0x7f64b0004d90 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.224+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f64b000be50 con 0x7f64c815da00 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.225+0000 7f64c77fe640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64b0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.225+0000 7f64c7fff640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64b0004d90 0x7f64b00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.225+0000 7f64c6ffd640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c815da00 0x7f64b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.225+0000 7f64c77fe640 1 -- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c815da00 msgr2=0x7f64b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.225+0000 7f64c77fe640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c815da00 0x7f64b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.225+0000 7f64c77fe640 1 -- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64b0004d90 msgr2=0x7f64b00051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.225+0000 7f64c77fe640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64b0004d90 0x7f64b00051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.225+0000 7f64c77fe640 1 -- 172.21.15.16:0/4168095300 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b0003520 con 0x7f64b0003a30 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64c77fe640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64b0003e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64b8001790 tx=0x7f64b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee41d6628fc5478 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b80013b0 con 0x7f64b0003a30 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b80052d0 con 0x7f64b0003a30 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64c67fc640 1 -- 172.21.15.16:0/4168095300 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b802aae0 con 0x7f64b0003a30 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64cdd19640 1 -- 172.21.15.16:0/4168095300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 msgr2=0x7f64b0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64cdd19640 1 --2- 172.21.15.16:0/4168095300 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64b0003e50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64b8001790 tx=0x7f64b0005830 comp rx=0 tx=0).stop 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64c7fff640 1 -- 172.21.15.16:0/4168095300 reap_dead start 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64cdd19640 1 -- 172.21.15.16:0/4168095300 shutdown_connections 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64cdd19640 1 -- 172.21.15.16:0/4168095300 >> 172.21.15.16:0/4168095300 conn(0x7f64c8072850 msgr2=0x7f64c80681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64cdd19640 1 -- 172.21.15.16:0/4168095300 shutdown_connections 2024-05-11T01:01:47.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.226+0000 7f64cdd19640 1 -- 172.21.15.16:0/4168095300 wait complete. 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.228+0000 7f64cdd19640 1 Processor -- start 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.228+0000 7f64cdd19640 1 -- start start 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.228+0000 7f64cdd19640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64c8141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.228+0000 7f64cdd19640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80c9890 0x7f64c8147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.228+0000 7f64cdd19640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c8147780 0x7f64c8153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.228+0000 7f64cdd19640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80d3a60 con 0x7f64b0003a30 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.228+0000 7f64cdd19640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f64c80d3dd0 con 0x7f64c8147780 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.228+0000 7f64cdd19640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f64c80cf810 con 0x7f64c80c9890 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64c8141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64c8141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52208/0 (socket says 172.21.15.16:52208) 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 -- 172.21.15.16:0/3550531317 learned_addr learned my addr 172.21.15.16:0/3550531317 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:47.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c7fff640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c8147780 0x7f64c8153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c6ffd640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80c9890 0x7f64c8147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 -- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80c9890 msgr2=0x7f64c8147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80c9890 0x7f64c8147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 -- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c8147780 msgr2=0x7f64c8153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c8147780 0x7f64c8153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 -- 172.21.15.16:0/3550531317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c8152b60 con 0x7f64b0003a30 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c7fff640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c8147780 0x7f64c8153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c6ffd640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80c9890 0x7f64c8147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64c77fe640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64c8141d30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f64b8005040 tx=0x7f64b8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64affff640 1 -- 172.21.15.16:0/3550531317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8040020 con 0x7f64b0003a30 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64affff640 1 -- 172.21.15.16:0/3550531317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b80050d0 con 0x7f64b0003a30 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64affff640 1 -- 172.21.15.16:0/3550531317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b8006c00 con 0x7f64b0003a30 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.229+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c8152e40 con 0x7f64b0003a30 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.230+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c8153400 con 0x7f64b0003a30 2024-05-11T01:01:47.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.231+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c806a5b0 con 0x7f64b0003a30 2024-05-11T01:01:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.231+0000 7f64affff640 1 -- 172.21.15.16:0/3550531317 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f64b8043020 con 0x7f64b0003a30 2024-05-11T01:01:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.232+0000 7f64affff640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64b40762d0 0x7f64b4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.232+0000 7f64affff640 1 -- 172.21.15.16:0/3550531317 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f64b80b7160 con 0x7f64b0003a30 2024-05-11T01:01:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.232+0000 7f64c6ffd640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64b40762d0 0x7f64b4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.233+0000 7f64c6ffd640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64b40762d0 0x7f64b4078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64c80c6e20 tx=0x7f64bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:47.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.236+0000 7f64affff640 1 -- 172.21.15.16:0/3550531317 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f64b804a030 con 0x7f64b0003a30 2024-05-11T01:01:47.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.499+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f64c80c9c70 con 0x7f64b0003a30 2024-05-11T01:01:47.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.501+0000 7f64affff640 1 -- 172.21.15.16:0/3550531317 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f64b8080e10 con 0x7f64b0003a30 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64b40762d0 msgr2=0x7f64b4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64b40762d0 0x7f64b4078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64c80c6e20 tx=0x7f64bc008040 comp rx=0 tx=0).stop 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 msgr2=0x7f64c8141d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64c8141d30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f64b8005040 tx=0x7f64b8001120 comp rx=0 tx=0).stop 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 shutdown_connections 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f64b40762d0 0x7f64b4078790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64c8147780 0x7f64c8153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f64c80c9890 0x7f64c8147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 --2- 172.21.15.16:0/3550531317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64b0003a30 0x7f64c8141d30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 >> 172.21.15.16:0/3550531317 conn(0x7f64c8072850 msgr2=0x7f64c80d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.503+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 shutdown_connections 2024-05-11T01:01:47.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.504+0000 7f64cdd19640 1 -- 172.21.15.16:0/3550531317 wait complete. 2024-05-11T01:01:47.515 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-11T01:01:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.620+0000 7fbe01fa4640 1 Processor -- start 2024-05-11T01:01:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.620+0000 7fbe01fa4640 1 -- start start 2024-05-11T01:01:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbe01fa4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbdfc15cde0 0x7fbdfc0d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbe01fa4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fbdfc0d30f0 0x7fbdfc15fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbe01fa4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdfc0d3670 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbe01fa4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbdfc0d3950 con 0x7fbdfc15cde0 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbe01fa4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fbdfc0d3c30 con 0x7fbdfc0d30f0 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbdfb7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbdfc15cde0 0x7fbdfc0d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbdfb7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbdfc15cde0 0x7fbdfc0d28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52210/0 (socket says 172.21.15.16:52210) 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbdfb7fe640 1 -- 172.21.15.16:0/3557287993 learned_addr learned my addr 172.21.15.16:0/3557287993 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbdfaffd640 1 --2- 172.21.15.16:0/3557287993 >> v2:172.21.15.174:3300/0 conn(0x7fbdfc0d30f0 0x7fbdfc15fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbdfb7fe640 1 -- 172.21.15.16:0/3557287993 >> v2:172.21.15.174:3300/0 conn(0x7fbdfc0d30f0 msgr2=0x7fbdfc15fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbdfb7fe640 1 --2- 172.21.15.16:0/3557287993 >> v2:172.21.15.174:3300/0 conn(0x7fbdfc0d30f0 0x7fbdfc15fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbdfb7fe640 1 -- 172.21.15.16:0/3557287993 >> v1:172.21.15.174:6789/0 conn(0x7fbdfc15d1c0 legacy=0x7fbdfc1636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.621+0000 7fbdfb7fe640 1 -- 172.21.15.16:0/3557287993 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc0d3f10 con 0x7fbdfc15cde0 2024-05-11T01:01:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.622+0000 7fbdfb7fe640 1 --2- 172.21.15.16:0/3557287993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15cde0 0x7fbdfc0d28c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc160c10 tx=0x7fbdec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3e93ede5caf0fd server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.622+0000 7fbdfa7fc640 1 -- 172.21.15.16:0/3557287993 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec037070 con 0x7fbdfc15cde0 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.622+0000 7fbdfa7fc640 1 -- 172.21.15.16:0/3557287993 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdec032440 con 0x7fbdfc15cde0 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.622+0000 7fbdfa7fc640 1 -- 172.21.15.16:0/3557287993 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec032810 con 0x7fbdfc15cde0 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.623+0000 7fbe01fa4640 1 -- 172.21.15.16:0/3557287993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15cde0 msgr2=0x7fbdfc0d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.623+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/3557287993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15cde0 0x7fbdfc0d28c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc160c10 tx=0x7fbdec02a270 comp rx=0 tx=0).stop 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.623+0000 7fbe01fa4640 1 -- 172.21.15.16:0/3557287993 shutdown_connections 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.623+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/3557287993 >> v2:172.21.15.174:3300/0 conn(0x7fbdfc0d30f0 0x7fbdfc15fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.623+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/3557287993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15cde0 0x7fbdfc0d28c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.623+0000 7fbe01fa4640 1 -- 172.21.15.16:0/3557287993 >> 172.21.15.16:0/3557287993 conn(0x7fbdfc072850 msgr2=0x7fbdfc0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.623+0000 7fbe01fa4640 1 -- 172.21.15.16:0/3557287993 shutdown_connections 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.623+0000 7fbe01fa4640 1 -- 172.21.15.16:0/3557287993 wait complete. 2024-05-11T01:01:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.624+0000 7fbe01fa4640 1 Processor -- start 2024-05-11T01:01:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.624+0000 7fbe01fa4640 1 -- start start 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbe01fa4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdfc0d30f0 0x7fbdfc157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbe01fa4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdfc15cde0 0x7fbdfc0b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbe01fa4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15d1c0 0x7fbdfc0b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbe01fa4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc163df0 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbe01fa4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc0d2e00 con 0x7fbdfc0d30f0 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbe01fa4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fbdfc163f70 con 0x7fbdfc15cde0 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15d1c0 0x7fbdfc0b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15d1c0 0x7fbdfc0b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52218/0 (socket says 172.21.15.16:52218) 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfbfff640 1 -- 172.21.15.16:0/1722391083 learned_addr learned my addr 172.21.15.16:0/1722391083 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfb7fe640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdfc0d30f0 0x7fbdfc157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfaffd640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdfc15cde0 0x7fbdfc0b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfbfff640 1 -- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdfc15cde0 msgr2=0x7fbdfc0b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfbfff640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdfc15cde0 0x7fbdfc0b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfbfff640 1 -- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdfc0d30f0 msgr2=0x7fbdfc157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfbfff640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdfc0d30f0 0x7fbdfc157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.625+0000 7fbdfbfff640 1 -- 172.21.15.16:0/1722391083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc1582d0 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.626+0000 7fbdfbfff640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15d1c0 0x7fbdfc0b73a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c7d0 tx=0x7fbdf400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.626+0000 7fbde3fff640 1 -- 172.21.15.16:0/1722391083 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4003b70 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.626+0000 7fbde3fff640 1 -- 172.21.15.16:0/1722391083 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf4003d10 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.626+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdfc0b2410 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.626+0000 7fbde3fff640 1 -- 172.21.15.16:0/1722391083 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400aa70 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.626+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdfc0c75b0 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.627+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdfc06a5b0 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.627+0000 7fbde3fff640 1 -- 172.21.15.16:0/1722391083 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbdf400ac10 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.628+0000 7fbde3fff640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbde8076300 0x7fbde80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:47.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.628+0000 7fbde3fff640 1 -- 172.21.15.16:0/1722391083 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fbdf4096fa0 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.628+0000 7fbdfb7fe640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbde8076300 0x7fbde80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:47.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.629+0000 7fbdfb7fe640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbde8076300 0x7fbde80787c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbdec034000 tx=0x7fbdec02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:47.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.632+0000 7fbde3fff640 1 -- 172.21.15.16:0/1722391083 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbdf4060690 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.898+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fbdfc0d0260 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.900+0000 7fbde3fff640 1 -- 172.21.15.16:0/1722391083 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fbdf4064990 con 0x7fbdfc15d1c0 2024-05-11T01:01:47.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbde8076300 msgr2=0x7fbde80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbde8076300 0x7fbde80787c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbdec034000 tx=0x7fbdec02e000 comp rx=0 tx=0).stop 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15d1c0 msgr2=0x7fbdfc0b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15d1c0 0x7fbdfc0b73a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400c7d0 tx=0x7fbdf400cc90 comp rx=0 tx=0).stop 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 shutdown_connections 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fbde8076300 0x7fbde80787c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdfc15d1c0 0x7fbdfc0b73a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fbdfc15cde0 0x7fbdfc0b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 --2- 172.21.15.16:0/1722391083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbdfc0d30f0 0x7fbdfc157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.902+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 >> 172.21.15.16:0/1722391083 conn(0x7fbdfc072850 msgr2=0x7fbdfc0b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.903+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 shutdown_connections 2024-05-11T01:01:47.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:47.903+0000 7fbe01fa4640 1 -- 172.21.15.16:0/1722391083 wait complete. 2024-05-11T01:01:47.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-11T01:01:48.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.018+0000 7fa381b51640 1 Processor -- start 2024-05-11T01:01:48.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.018+0000 7fa381b51640 1 -- start start 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa381b51640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa37c0d37a0 0x7fa37c0d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa381b51640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37c162fb0 con 0x7fa37c15f530 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa381b51640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37c163290 con 0x7fa37c06f140 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa381b51640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa37c163ea0 con 0x7fa37c0d37a0 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa37b7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa37c15f530 0x7fa37c0cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57976/0 (socket says 172.21.15.16:57976) 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa37b7fe640 1 -- 172.21.15.16:0/2214055095 learned_addr learned my addr 172.21.15.16:0/2214055095 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa37bfff640 1 --2- 172.21.15.16:0/2214055095 >> v2:172.21.15.174:3300/0 conn(0x7fa37c0d37a0 0x7fa37c0d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1993704989 0 0) 0x7fa37c162fb0 con 0x7fa37c15f530 2024-05-11T01:01:48.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.019+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa364003520 con 0x7fa37c15f530 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1344608317 0 0) 0x7fa364003520 con 0x7fa37c15f530 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 >> v2:172.21.15.174:3300/0 conn(0x7fa37c0d37a0 msgr2=0x7fa37c0d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 --2- 172.21.15.16:0/2214055095 >> v2:172.21.15.174:3300/0 conn(0x7fa37c0d37a0 0x7fa37c0d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 >> v1:172.21.15.174:6789/0 conn(0x7fa37c06f140 legacy=0x7fa37c0d3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c163570 con 0x7fa37c15f530 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fa36c0016f0 con 0x7fa37c15f530 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 >> v1:172.21.15.16:6789/0 conn(0x7fa37c15f530 legacy=0x7fa37c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa364003a00 0x7fa364003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa364004800 0x7fa364004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3640051c0 0x7fa36400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c163ea0 con 0x7fa3640051c0 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa36400c060 con 0x7fa364003a00 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa36400c260 con 0x7fa364004800 2024-05-11T01:01:48.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37bfff640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3640051c0 0x7fa36400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37b7fe640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa364003a00 0x7fa364003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37affd640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa364004800 0x7fa364004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37bfff640 1 -- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa364004800 msgr2=0x7fa364004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37bfff640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa364004800 0x7fa364004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37bfff640 1 -- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa364003a00 msgr2=0x7fa364003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37bfff640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa364003a00 0x7fa364003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37bfff640 1 -- 172.21.15.16:0/2214055095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa364003520 con 0x7fa3640051c0 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.020+0000 7fa37affd640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa364004800 0x7fa364004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.021+0000 7fa37bfff640 1 -- 172.21.15.16:0/2214055095 reap_dead start 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.021+0000 7fa37bfff640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3640051c0 0x7fa36400b9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa374009f90 tx=0x7fa364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7aebb4e0271972 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.021+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374035020 con 0x7fa3640051c0 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.021+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa374003b90 con 0x7fa3640051c0 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.021+0000 7fa37a7fc640 1 -- 172.21.15.16:0/2214055095 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374009c10 con 0x7fa3640051c0 2024-05-11T01:01:48.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.022+0000 7fa381b51640 1 -- 172.21.15.16:0/2214055095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3640051c0 msgr2=0x7fa36400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.022+0000 7fa381b51640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3640051c0 0x7fa36400b9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa374009f90 tx=0x7fa364005830 comp rx=0 tx=0).stop 2024-05-11T01:01:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.022+0000 7fa381b51640 1 -- 172.21.15.16:0/2214055095 shutdown_connections 2024-05-11T01:01:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.022+0000 7fa381b51640 1 --2- 172.21.15.16:0/2214055095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3640051c0 0x7fa36400b9c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.022+0000 7fa381b51640 1 -- 172.21.15.16:0/2214055095 >> 172.21.15.16:0/2214055095 conn(0x7fa37c0681c0 msgr2=0x7fa37c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.022+0000 7fa381b51640 1 -- 172.21.15.16:0/2214055095 shutdown_connections 2024-05-11T01:01:48.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.022+0000 7fa381b51640 1 -- 172.21.15.16:0/2214055095 wait complete. 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.023+0000 7fa381b51640 1 Processor -- start 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.023+0000 7fa381b51640 1 -- start start 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa381b51640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3640051c0 0x7fa37c14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa381b51640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa37c1565e0 0x7fa37c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa381b51640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa37c0ce890 0x7fa37c0ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa381b51640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c0d2a20 con 0x7fa37c0ce890 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa381b51640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c163b30 con 0x7fa37c1565e0 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa381b51640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c0d2ba0 con 0x7fa3640051c0 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa37c0ce890 0x7fa37c0ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa37c0ce890 0x7fa37c0ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52234/0 (socket says 172.21.15.16:52234) 2024-05-11T01:01:48.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 -- 172.21.15.16:0/221988299 learned_addr learned my addr 172.21.15.16:0/221988299 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37b7fe640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3640051c0 0x7fa37c14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37affd640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa37c1565e0 0x7fa37c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 -- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3640051c0 msgr2=0x7fa37c14c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3640051c0 0x7fa37c14c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 -- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa37c1565e0 msgr2=0x7fa37c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa37c1565e0 0x7fa37c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 -- 172.21.15.16:0/221988299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c0cbf10 con 0x7fa37c0ce890 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.024+0000 7fa37bfff640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa37c0ce890 0x7fa37c0ced40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa37400e230 tx=0x7fa374009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.025+0000 7fa363fff640 1 -- 172.21.15.16:0/221988299 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374035070 con 0x7fa37c0ce890 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.025+0000 7fa363fff640 1 -- 172.21.15.16:0/221988299 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa374041070 con 0x7fa37c0ce890 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.025+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c0cc1f0 con 0x7fa37c0ce890 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.025+0000 7fa363fff640 1 -- 172.21.15.16:0/221988299 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374009c10 con 0x7fa37c0ce890 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.025+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c0cc7b0 con 0x7fa37c0ce890 2024-05-11T01:01:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.026+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37c06a5b0 con 0x7fa37c0ce890 2024-05-11T01:01:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.026+0000 7fa363fff640 1 -- 172.21.15.16:0/221988299 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa374005d10 con 0x7fa37c0ce890 2024-05-11T01:01:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.027+0000 7fa363fff640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa3680762d0 0x7fa368078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.027+0000 7fa363fff640 1 -- 172.21.15.16:0/221988299 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fa3740b7d90 con 0x7fa37c0ce890 2024-05-11T01:01:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.027+0000 7fa37b7fe640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa3680762d0 0x7fa368078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.027+0000 7fa37b7fe640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa3680762d0 0x7fa368078790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0b8350 tx=0x7fa36c0011e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:48.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.031+0000 7fa363fff640 1 -- 172.21.15.16:0/221988299 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa3740813f0 con 0x7fa37c0ce890 2024-05-11T01:01:48.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.226+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa37c0710c0 con 0x7fa37c0ce890 2024-05-11T01:01:48.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.226+0000 7fa363fff640 1 -- 172.21.15.16:0/221988299 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7fa3740856f0 con 0x7fa37c0ce890 2024-05-11T01:01:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:48.226 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-05-11T01:01:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:48.226 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-05-11T01:01:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-05-11T01:01:48.227 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:48.227 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-05-11T01:01:48.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa3680762d0 msgr2=0x7fa368078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa3680762d0 0x7fa368078790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0b8350 tx=0x7fa36c0011e0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa37c0ce890 msgr2=0x7fa37c0ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa37c0ce890 0x7fa37c0ced40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa37400e230 tx=0x7fa374009750 comp rx=0 tx=0).stop 2024-05-11T01:01:48.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 shutdown_connections 2024-05-11T01:01:48.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa3680762d0 0x7fa368078790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa37c0ce890 0x7fa37c0ced40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa37c1565e0 0x7fa37c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 --2- 172.21.15.16:0/221988299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa3640051c0 0x7fa37c14c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 >> 172.21.15.16:0/221988299 conn(0x7fa37c0681c0 msgr2=0x7fa37c06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:48.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 shutdown_connections 2024-05-11T01:01:48.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.228+0000 7fa381b51640 1 -- 172.21.15.16:0/221988299 wait complete. 2024-05-11T01:01:48.239 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-11T01:01:48.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-11T01:01:48.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.347+0000 7f0fcfa1d640 1 Processor -- start 2024-05-11T01:01:48.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.347+0000 7f0fcfa1d640 1 -- start start 2024-05-11T01:01:48.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.348+0000 7f0fcfa1d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0fc81628c0 0x7f0fc80744c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.348+0000 7f0fcfa1d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc80b5940 con 0x7f0fc80b5280 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.348+0000 7f0fcfa1d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc80b5c20 con 0x7f0fc806c3e0 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.348+0000 7f0fcfa1d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80b5700 con 0x7f0fc81628c0 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.348+0000 7f0fcd7b9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0fc81628c0 0x7f0fc80744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.349+0000 7f0fcd7b9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0fc81628c0 0x7f0fc80744c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52248/0 (socket says 172.21.15.16:52248) 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.349+0000 7f0fcd7b9640 1 -- 172.21.15.16:0/2787143369 learned_addr learned my addr 172.21.15.16:0/2787143369 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.349+0000 7f0fcd7b9640 1 -- 172.21.15.16:0/2787143369 >> v1:172.21.15.174:6789/0 conn(0x7f0fc806c3e0 legacy=0x7f0fc80707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.349+0000 7f0fcd7b9640 1 -- 172.21.15.16:0/2787143369 >> v1:172.21.15.16:6789/0 conn(0x7f0fc80b5280 legacy=0x7f0fc81638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.349+0000 7f0fcd7b9640 1 -- 172.21.15.16:0/2787143369 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc81630e0 con 0x7f0fc81628c0 2024-05-11T01:01:48.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.349+0000 7f0fcd7b9640 1 --2- 172.21.15.16:0/2787143369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc81628c0 0x7f0fc80744c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009870 tx=0x7f0fc002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9272d8651a26b9d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:48.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fc7fff640 1 -- 172.21.15.16:0/2787143369 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0037070 con 0x7f0fc81628c0 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fc7fff640 1 -- 172.21.15.16:0/2787143369 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc0032440 con 0x7f0fc81628c0 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fc7fff640 1 -- 172.21.15.16:0/2787143369 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0032810 con 0x7f0fc81628c0 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/2787143369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc81628c0 msgr2=0x7f0fc80744c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fcfa1d640 1 --2- 172.21.15.16:0/2787143369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc81628c0 0x7f0fc80744c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0009870 tx=0x7f0fc002a1c0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/2787143369 shutdown_connections 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fcfa1d640 1 --2- 172.21.15.16:0/2787143369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc81628c0 0x7f0fc80744c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/2787143369 >> 172.21.15.16:0/2787143369 conn(0x7f0fc80d21c0 msgr2=0x7f0fc80d25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/2787143369 shutdown_connections 2024-05-11T01:01:48.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.350+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/2787143369 wait complete. 2024-05-11T01:01:48.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.351+0000 7f0fcfa1d640 1 Processor -- start 2024-05-11T01:01:48.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.351+0000 7f0fcfa1d640 1 -- start start 2024-05-11T01:01:48.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fcfa1d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fc806c3e0 0x7f0fc8156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fcfa1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc80b5280 0x7f0fc815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fcfa1d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc81628c0 0x7f0fc80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fcfa1d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8162ca0 con 0x7f0fc80b5280 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fcfa1d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8163450 con 0x7f0fc81628c0 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fcfa1d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc8070ed0 con 0x7f0fc806c3e0 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fccfb8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc80b5280 0x7f0fc815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fccfb8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc80b5280 0x7f0fc815e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52258/0 (socket says 172.21.15.16:52258) 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.352+0000 7f0fccfb8640 1 -- 172.21.15.16:0/3872693531 learned_addr learned my addr 172.21.15.16:0/3872693531 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fcd7b9640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fc806c3e0 0x7f0fc8156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fcdfba640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc81628c0 0x7f0fc80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fccfb8640 1 -- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fc806c3e0 msgr2=0x7f0fc8156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fccfb8640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fc806c3e0 0x7f0fc8156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fccfb8640 1 -- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc81628c0 msgr2=0x7f0fc80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:48.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fccfb8640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc81628c0 0x7f0fc80cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:48.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fccfb8640 1 -- 172.21.15.16:0/3872693531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc8161650 con 0x7f0fc80b5280 2024-05-11T01:01:48.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fccfb8640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc80b5280 0x7f0fc815e5e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c450 tx=0x7f0fbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fc5ffb640 1 -- 172.21.15.16:0/3872693531 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc0052d0 con 0x7f0fc80b5280 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fc5ffb640 1 -- 172.21.15.16:0/3872693531 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fbc005470 con 0x7f0fc80b5280 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc8161370 con 0x7f0fc80b5280 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fc5ffb640 1 -- 172.21.15.16:0/3872693531 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc012870 con 0x7f0fc80b5280 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.353+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc80ce750 con 0x7f0fc80b5280 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.354+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc806a5b0 con 0x7f0fc80b5280 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.355+0000 7f0fc5ffb640 1 -- 172.21.15.16:0/3872693531 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fbc012a10 con 0x7f0fc80b5280 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.355+0000 7f0fc5ffb640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fb40762d0 0x7f0fb4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.355+0000 7f0fc5ffb640 1 -- 172.21.15.16:0/3872693531 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f0fbc096e60 con 0x7f0fc80b5280 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.356+0000 7f0fcd7b9640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fb40762d0 0x7f0fb4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:48.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.356+0000 7f0fcd7b9640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fb40762d0 0x7f0fb4078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0034000 tx=0x7f0fc002e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.360+0000 7f0fc5ffb640 1 -- 172.21.15.16:0/3872693531 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0fbc060b10 con 0x7f0fc80b5280 2024-05-11T01:01:48.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:48.552+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0fc806e500 con 0x7f0fc80b5280 2024-05-11T01:01:49.101 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:01:49.104 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:01:49.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.504+0000 7f0fc5ffb640 1 -- 172.21.15.16:0/3872693531 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7f0fbc060410 con 0x7f0fc80b5280 2024-05-11T01:01:49.504 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-05-11T01:01:49.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fb40762d0 msgr2=0x7f0fb4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:49.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fb40762d0 0x7f0fb4078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0034000 tx=0x7f0fc002e000 comp rx=0 tx=0).stop 2024-05-11T01:01:49.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc80b5280 msgr2=0x7f0fc815e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:49.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc80b5280 0x7f0fc815e5e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c450 tx=0x7f0fbc00c910 comp rx=0 tx=0).stop 2024-05-11T01:01:49.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 shutdown_connections 2024-05-11T01:01:49.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f0fb40762d0 0x7f0fb4078790 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0034000 tx=0x7f0fc002e000 comp rx=0 tx=0).stop 2024-05-11T01:01:49.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0fc81628c0 0x7f0fc80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:49.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0fc80b5280 0x7f0fc815e5e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:49.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 --2- 172.21.15.16:0/3872693531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0fc806c3e0 0x7f0fc8156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:49.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.509+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 >> 172.21.15.16:0/3872693531 conn(0x7f0fc80d21c0 msgr2=0x7f0fc80affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:49.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.510+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 shutdown_connections 2024-05-11T01:01:49.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.510+0000 7f0fcfa1d640 1 -- 172.21.15.16:0/3872693531 wait complete. 2024-05-11T01:01:49.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-11T01:01:49.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.644+0000 7f22c369b640 1 Processor -- start 2024-05-11T01:01:49.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.644+0000 7f22c369b640 1 -- start start 2024-05-11T01:01:49.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c369b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22bc0d23c0 0x7f22bc0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:49.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c369b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:49.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c369b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22bc0d2ce0 con 0x7f22bc0d3f80 2024-05-11T01:01:49.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c369b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc0d0bb0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c369b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc0d4410 con 0x7f22bc0b8770 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c1437640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f22bc0d23c0 0x7f22bc0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c1c38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c0c36640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f22bc0d3f80 0x7f22bc0d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:39282/0 (socket says 172.21.15.16:39282) 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.645+0000 7f22c0c36640 1 -- 172.21.15.16:0/2890795853 learned_addr learned my addr 172.21.15.16:0/2890795853 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.646+0000 7f22c1437640 1 -- 172.21.15.16:0/2890795853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 msgr2=0x7f22bc0b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.646+0000 7f22c1437640 1 --2- 172.21.15.16:0/2890795853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.646+0000 7f22c1437640 1 -- 172.21.15.16:0/2890795853 >> v1:172.21.15.174:6789/0 conn(0x7f22bc0d3f80 legacy=0x7f22bc0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.646+0000 7f22c1437640 1 -- 172.21.15.16:0/2890795853 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc0d46f0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.646+0000 7f22b3fff640 1 -- 172.21.15.16:0/2890795853 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351370942 0 0) 0x7f22bc0d2ce0 con 0x7f22bc0d3f80 2024-05-11T01:01:49.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.646+0000 7f22c1c38640 1 --2- 172.21.15.16:0/2890795853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c1437640 1 --2- 172.21.15.16:0/2890795853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc0d23c0 0x7f22bc0d27a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009d90 tx=0x7f22b802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f757bf76e65b0d3f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22b3fff640 1 -- 172.21.15.16:0/2890795853 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8007740 con 0x7f22bc0d23c0 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22b3fff640 1 -- 172.21.15.16:0/2890795853 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b80078e0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22b3fff640 1 -- 172.21.15.16:0/2890795853 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8007cb0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c369b640 1 -- 172.21.15.16:0/2890795853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc0d23c0 msgr2=0x7f22bc0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c369b640 1 --2- 172.21.15.16:0/2890795853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc0d23c0 0x7f22bc0d27a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009d90 tx=0x7f22b802a660 comp rx=0 tx=0).stop 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c369b640 1 -- 172.21.15.16:0/2890795853 shutdown_connections 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c369b640 1 --2- 172.21.15.16:0/2890795853 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c369b640 1 --2- 172.21.15.16:0/2890795853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc0d23c0 0x7f22bc0d27a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:49.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c369b640 1 -- 172.21.15.16:0/2890795853 >> 172.21.15.16:0/2890795853 conn(0x7f22bc073f00 msgr2=0x7f22bc074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:49.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c369b640 1 -- 172.21.15.16:0/2890795853 shutdown_connections 2024-05-11T01:01:49.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.647+0000 7f22c369b640 1 -- 172.21.15.16:0/2890795853 wait complete. 2024-05-11T01:01:49.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c369b640 1 Processor -- start 2024-05-11T01:01:49.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c369b640 1 -- start start 2024-05-11T01:01:49.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c369b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:49.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c369b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22bc0d23c0 0x7f22bc1f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:49.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c369b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc1f8920 0x7f22bc156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:49.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c369b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0d4f90 con 0x7f22bc0d23c0 2024-05-11T01:01:49.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c369b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0d4cb0 con 0x7f22bc1f8920 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c369b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc15f980 con 0x7f22bc0b8770 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.649+0000 7f22c0c36640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22bc0d23c0 0x7f22bc1f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c0c36640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22bc0d23c0 0x7f22bc1f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52264/0 (socket says 172.21.15.16:52264) 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c0c36640 1 -- 172.21.15.16:0/1372918389 learned_addr learned my addr 172.21.15.16:0/1372918389 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c1437640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c1c38640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc1f8920 0x7f22bc156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c0c36640 1 -- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 msgr2=0x7f22bc0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c0c36640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c0c36640 1 -- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc1f8920 msgr2=0x7f22bc156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c0c36640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc1f8920 0x7f22bc156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c0c36640 1 -- 172.21.15.16:0/1372918389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc0b4da0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c1c38640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc1f8920 0x7f22bc156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c0c36640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22bc0d23c0 0x7f22bc1f83e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00c4f0 tx=0x7f22ac00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22b1ffb640 1 -- 172.21.15.16:0/1372918389 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac018070 con 0x7f22bc0d23c0 2024-05-11T01:01:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22b1ffb640 1 -- 172.21.15.16:0/1372918389 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ac0074e0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc0b5060 con 0x7f22bc0d23c0 2024-05-11T01:01:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.650+0000 7f22b1ffb640 1 -- 172.21.15.16:0/1372918389 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac004a20 con 0x7f22bc0d23c0 2024-05-11T01:01:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.651+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc0b5620 con 0x7f22bc0d23c0 2024-05-11T01:01:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.652+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc15f1e0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.652+0000 7f22b1ffb640 1 -- 172.21.15.16:0/1372918389 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f22ac01b070 con 0x7f22bc0d23c0 2024-05-11T01:01:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.653+0000 7f22b1ffb640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f22a00762d0 0x7f22a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.653+0000 7f22b1ffb640 1 -- 172.21.15.16:0/1372918389 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7f22ac0965c0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.653+0000 7f22c1437640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f22a00762d0 0x7f22a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.654+0000 7f22c1437640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f22a00762d0 0x7f22a0078790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f22b8034000 tx=0x7f22b802f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:49.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.658+0000 7f22b1ffb640 1 -- 172.21.15.16:0/1372918389 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f22bc15f1e0 con 0x7f22bc0d23c0 2024-05-11T01:01:49.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:49.849+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f22bc06a5b0 con 0x7f22bc0d23c0 2024-05-11T01:01:50.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.509+0000 7f22b1ffb640 1 -- 172.21.15.16:0/1372918389 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7f22ac05fab0 con 0x7f22bc0d23c0 2024-05-11T01:01:50.510 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-05-11T01:01:50.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f22a00762d0 msgr2=0x7f22a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:50.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f22a00762d0 0x7f22a0078790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f22b8034000 tx=0x7f22b802f000 comp rx=0 tx=0).stop 2024-05-11T01:01:50.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22bc0d23c0 msgr2=0x7f22bc1f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:50.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22bc0d23c0 0x7f22bc1f83e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00c4f0 tx=0x7f22ac00c9b0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 shutdown_connections 2024-05-11T01:01:50.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f22a00762d0 0x7f22a0078790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22bc1f8920 0x7f22bc156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22bc0d23c0 0x7f22bc1f83e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 --2- 172.21.15.16:0/1372918389 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22bc0b8770 0x7f22bc0cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.512+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 >> 172.21.15.16:0/1372918389 conn(0x7f22bc073f00 msgr2=0x7f22bc0b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:50.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.513+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 shutdown_connections 2024-05-11T01:01:50.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.513+0000 7f22c369b640 1 -- 172.21.15.16:0/1372918389 wait complete. 2024-05-11T01:01:50.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-11T01:01:50.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.650+0000 7f8adf15f640 1 Processor -- start 2024-05-11T01:01:50.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.650+0000 7f8adf15f640 1 -- start start 2024-05-11T01:01:50.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.650+0000 7f8adf15f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80b7490 0x7f8ad80b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:50.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.650+0000 7f8adf15f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad81635d0 con 0x7f8ad80bae40 2024-05-11T01:01:50.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.650+0000 7f8adf15f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad81638b0 con 0x7f8ad8163010 2024-05-11T01:01:50.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.650+0000 7f8adf15f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad8163b90 con 0x7f8ad80b7490 2024-05-11T01:01:50.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8adcefb640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8ad80bae40 0x7f8ad81604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58000/0 (socket says 172.21.15.16:58000) 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8adcefb640 1 -- 172.21.15.16:0/255089967 learned_addr learned my addr 172.21.15.16:0/255089967 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8add6fc640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80b7490 0x7f8ad80b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590835683 0 0) 0x7f8ad81635d0 con 0x7f8ad80bae40 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac4003520 con 0x7f8ad80bae40 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 341934598 0 0) 0x7f8ac4003520 con 0x7f8ad80bae40 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80b7490 msgr2=0x7f8ad80b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80b7490 0x7f8ad80b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 >> v1:172.21.15.174:6789/0 conn(0x7f8ad8163010 legacy=0x7f8ad80b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad8163e70 con 0x7f8ad80bae40 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f8ad00016f0 con 0x7f8ad80bae40 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 >> v1:172.21.15.16:6789/0 conn(0x7f8ad80bae40 legacy=0x7f8ad81604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:50.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003a30 0x7f8ac4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80b7490 0x7f8ac4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4004d40 0x7f8ac40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad8163b90 con 0x7f8ac4004d40 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac400bc00 con 0x7f8ac4003a30 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac400be00 con 0x7f8ad80b7490 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8add6fc640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4004d40 0x7f8ac40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8adcefb640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003a30 0x7f8ac4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.651+0000 7f8ad7fff640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80b7490 0x7f8ac4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.652+0000 7f8add6fc640 1 -- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80b7490 msgr2=0x7f8ac4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.652+0000 7f8add6fc640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80b7490 0x7f8ac4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.652+0000 7f8add6fc640 1 -- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003a30 msgr2=0x7f8ac4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:50.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.652+0000 7f8add6fc640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003a30 0x7f8ac4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.652+0000 7f8add6fc640 1 -- 172.21.15.16:0/255089967 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac4003520 con 0x7f8ac4004d40 2024-05-11T01:01:50.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.652+0000 7f8add6fc640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4004d40 0x7f8ac40051c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009ac0 tx=0x7f8ac4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc997add0e3fab2d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:50.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0036070 con 0x7f8ac4004d40 2024-05-11T01:01:50.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac0031400 con 0x7f8ac4004d40 2024-05-11T01:01:50.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8ad77fe640 1 -- 172.21.15.16:0/255089967 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0009690 con 0x7f8ac4004d40 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8adf15f640 1 -- 172.21.15.16:0/255089967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4004d40 msgr2=0x7f8ac40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8adf15f640 1 --2- 172.21.15.16:0/255089967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4004d40 0x7f8ac40051c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009ac0 tx=0x7f8ac4005830 comp rx=0 tx=0).stop 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8add6fc640 1 -- 172.21.15.16:0/255089967 reap_dead start 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8adf15f640 1 -- 172.21.15.16:0/255089967 shutdown_connections 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8adf15f640 1 -- 172.21.15.16:0/255089967 >> 172.21.15.16:0/255089967 conn(0x7f8ad8074140 msgr2=0x7f8ad80d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8adf15f640 1 -- 172.21.15.16:0/255089967 shutdown_connections 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.653+0000 7f8adf15f640 1 -- 172.21.15.16:0/255089967 wait complete. 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.654+0000 7f8adf15f640 1 Processor -- start 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.654+0000 7f8adf15f640 1 -- start start 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8adf15f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ac4004d40 0x7f8ad814d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8adf15f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad815cc10 0x7f8ad815a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8adf15f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad815d090 0x7f8ad815add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:50.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8adf15f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80d4870 con 0x7f8ad815cc10 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8adf15f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80d46f0 con 0x7f8ad815d090 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8adf15f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad80d49f0 con 0x7f8ac4004d40 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8ad7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad815cc10 0x7f8ad815a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8ad7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad815cc10 0x7f8ad815a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52272/0 (socket says 172.21.15.16:52272) 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.655+0000 7f8ad7fff640 1 -- 172.21.15.16:0/4176033083 learned_addr learned my addr 172.21.15.16:0/4176033083 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8add6fc640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad815d090 0x7f8ad815add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8adcefb640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ac4004d40 0x7f8ad814d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad7fff640 1 -- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ac4004d40 msgr2=0x7f8ad814d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad7fff640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ac4004d40 0x7f8ad814d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad7fff640 1 -- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad815d090 msgr2=0x7f8ad815add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad7fff640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad815d090 0x7f8ad815add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad7fff640 1 -- 172.21.15.16:0/4176033083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad80ce5f0 con 0x7f8ad815cc10 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad7fff640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad815cc10 0x7f8ad815a890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800fb90 tx=0x7f8ac800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad57fa640 1 -- 172.21.15.16:0/4176033083 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800fe90 con 0x7f8ad815cc10 2024-05-11T01:01:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad57fa640 1 -- 172.21.15.16:0/4176033083 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac8018070 con 0x7f8ad815cc10 2024-05-11T01:01:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad80ce8d0 con 0x7f8ad815cc10 2024-05-11T01:01:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8ad57fa640 1 -- 172.21.15.16:0/4176033083 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac800de70 con 0x7f8ad815cc10 2024-05-11T01:01:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.656+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad80cee90 con 0x7f8ad815cc10 2024-05-11T01:01:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.657+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad806a5b0 con 0x7f8ad815cc10 2024-05-11T01:01:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.658+0000 7f8ad57fa640 1 -- 172.21.15.16:0/4176033083 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8ac8003970 con 0x7f8ad815cc10 2024-05-11T01:01:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.658+0000 7f8ad57fa640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8ab8076470 0x7f8ab8078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.658+0000 7f8ad57fa640 1 -- 172.21.15.16:0/4176033083 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7f8ac8097660 con 0x7f8ad815cc10 2024-05-11T01:01:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.659+0000 7f8adcefb640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8ab8076470 0x7f8ab8078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.659+0000 7f8adcefb640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8ab8076470 0x7f8ab8078930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0001240 tx=0x7f8ad00078f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:50.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.663+0000 7f8ad57fa640 1 -- 172.21.15.16:0/4176033083 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ac80609d0 con 0x7f8ad815cc10 2024-05-11T01:01:50.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:50.891+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8ad8158fc0 con 0x7f8ad815cc10 2024-05-11T01:01:51.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.511+0000 7f8ad57fa640 1 -- 172.21.15.16:0/4176033083 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f8ac8064cd0 con 0x7f8ad815cc10 2024-05-11T01:01:51.511 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 4 and data pool 5 2024-05-11T01:01:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.518+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8ab8076470 msgr2=0x7f8ab8078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.518+0000 7f8adf15f640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8ab8076470 0x7f8ab8078930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0001240 tx=0x7f8ad00078f0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.518+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad815cc10 msgr2=0x7f8ad815a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.518+0000 7f8adf15f640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad815cc10 0x7f8ad815a890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800fb90 tx=0x7f8ac800d520 comp rx=0 tx=0).stop 2024-05-11T01:01:51.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.521+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 shutdown_connections 2024-05-11T01:01:51.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.521+0000 7f8adf15f640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f8ab8076470 0x7f8ab8078930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.521+0000 7f8adf15f640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ad815d090 0x7f8ad815add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.521+0000 7f8adf15f640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad815cc10 0x7f8ad815a890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.521+0000 7f8adf15f640 1 --2- 172.21.15.16:0/4176033083 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ac4004d40 0x7f8ad814d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.521+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 >> 172.21.15.16:0/4176033083 conn(0x7f8ad8074140 msgr2=0x7f8ad81583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:51.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.524+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 shutdown_connections 2024-05-11T01:01:51.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.526+0000 7f8adf15f640 1 -- 172.21.15.16:0/4176033083 wait complete. 2024-05-11T01:01:51.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:51.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.665+0000 7fe9209dd640 1 Processor -- start 2024-05-11T01:01:51.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.665+0000 7fe9209dd640 1 -- start start 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe9209dd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe91c0cdcf0 0x7fe91c06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe9209dd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c06e7d0 0x7fe91c06ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe9209dd640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91c070860 con 0x7fe91c163aa0 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe9209dd640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe91c163f30 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe9209dd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c070580 con 0x7fe91c06e7d0 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe91a59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe91c0cdcf0 0x7fe91c06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe91a59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe91c0cdcf0 0x7fe91c06fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52278/0 (socket says 172.21.15.16:52278) 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe91a59c640 1 -- 172.21.15.16:0/3840262777 learned_addr learned my addr 172.21.15.16:0/3840262777 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.666+0000 7fe91ad9d640 1 --2- 172.21.15.16:0/3840262777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c06e7d0 0x7fe91c06ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.667+0000 7fe91a59c640 1 -- 172.21.15.16:0/3840262777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c06e7d0 msgr2=0x7fe91c06ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.667+0000 7fe91a59c640 1 --2- 172.21.15.16:0/3840262777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c06e7d0 0x7fe91c06ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.667+0000 7fe91a59c640 1 -- 172.21.15.16:0/3840262777 >> v1:172.21.15.174:6789/0 conn(0x7fe91c163aa0 legacy=0x7fe91c0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.667+0000 7fe91a59c640 1 -- 172.21.15.16:0/3840262777 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c0d0b40 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.667+0000 7fe91a59c640 1 --2- 172.21.15.16:0/3840262777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c06fba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009870 tx=0x7fe90c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5222653d57fdddd server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:51.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe91959a640 1 -- 172.21.15.16:0/3840262777 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c037070 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe91959a640 1 -- 172.21.15.16:0/3840262777 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe90c032440 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe91959a640 1 -- 172.21.15.16:0/3840262777 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c032810 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe9209dd640 1 -- 172.21.15.16:0/3840262777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 msgr2=0x7fe91c06fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe9209dd640 1 --2- 172.21.15.16:0/3840262777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c06fba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe90c009870 tx=0x7fe90c02a270 comp rx=0 tx=0).stop 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe9209dd640 1 -- 172.21.15.16:0/3840262777 shutdown_connections 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe9209dd640 1 --2- 172.21.15.16:0/3840262777 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c06e7d0 0x7fe91c06ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe9209dd640 1 --2- 172.21.15.16:0/3840262777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c06fba0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe9209dd640 1 -- 172.21.15.16:0/3840262777 >> 172.21.15.16:0/3840262777 conn(0x7fe91c072c70 msgr2=0x7fe91c0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe9209dd640 1 -- 172.21.15.16:0/3840262777 shutdown_connections 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.668+0000 7fe9209dd640 1 -- 172.21.15.16:0/3840262777 wait complete. 2024-05-11T01:01:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe9209dd640 1 Processor -- start 2024-05-11T01:01:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe9209dd640 1 -- start start 2024-05-11T01:01:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe9209dd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe91c06e7d0 0x7fe91c0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe9209dd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe9209dd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c163aa0 0x7fe91c0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe9209dd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0cb9e0 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe9209dd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c070230 con 0x7fe91c06e7d0 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe9209dd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c0b2a70 con 0x7fe91c163aa0 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe919d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe919d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c0cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52286/0 (socket says 172.21.15.16:52286) 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.670+0000 7fe919d9b640 1 -- 172.21.15.16:0/1276889932 learned_addr learned my addr 172.21.15.16:0/1276889932 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe91ad9d640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c163aa0 0x7fe91c0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe91a59c640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe91c06e7d0 0x7fe91c0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe919d9b640 1 -- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c163aa0 msgr2=0x7fe91c0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe919d9b640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c163aa0 0x7fe91c0c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe919d9b640 1 -- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe91c06e7d0 msgr2=0x7fe91c0c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe919d9b640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe91c06e7d0 0x7fe91c0c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe919d9b640 1 -- 172.21.15.16:0/1276889932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c0b2d10 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe91a59c640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe91c06e7d0 0x7fe91c0c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe919d9b640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c0cac70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe91000c530 tx=0x7fe91000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe90affd640 1 -- 172.21.15.16:0/1276889932 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9100052d0 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe90affd640 1 -- 172.21.15.16:0/1276889932 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe910005470 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c0b2ff0 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe90affd640 1 -- 172.21.15.16:0/1276889932 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910012870 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.671+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c0c7be0 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.672+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91c06a5b0 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.673+0000 7fe90affd640 1 -- 172.21.15.16:0/1276889932 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe910012a10 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.673+0000 7fe90affd640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe8fc0762d0 0x7fe8fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.673+0000 7fe90affd640 1 -- 172.21.15.16:0/1276889932 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fe910097180 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.674+0000 7fe91a59c640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe8fc0762d0 0x7fe8fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.674+0000 7fe91a59c640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe8fc0762d0 0x7fe8fc078790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe90c034000 tx=0x7fe90c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:51.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.678+0000 7fe90affd640 1 -- 172.21.15.16:0/1276889932 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe910060b70 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.874+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe91c161390 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.875+0000 7fe90affd640 1 -- 172.21.15.16:0/1276889932 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16658 (secure 0 0 0) 0x7fe910060470 con 0x7fe91c0cdcf0 2024-05-11T01:01:51.875 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:51.875 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":30,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:50.892334+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:48.556825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:49.853034+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:51.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe8fc0762d0 msgr2=0x7fe8fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe8fc0762d0 0x7fe8fc078790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe90c034000 tx=0x7fe90c02e000 comp rx=0 tx=0).stop 2024-05-11T01:01:51.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 msgr2=0x7fe91c0cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c0cac70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe91000c530 tx=0x7fe91000c9f0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 shutdown_connections 2024-05-11T01:01:51.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fe8fc0762d0 0x7fe8fc078790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe91c163aa0 0x7fe91c0c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe91c0cdcf0 0x7fe91c0cac70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 --2- 172.21.15.16:0/1276889932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe91c06e7d0 0x7fe91c0c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 >> 172.21.15.16:0/1276889932 conn(0x7fe91c072c70 msgr2=0x7fe91c0ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:51.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 shutdown_connections 2024-05-11T01:01:51.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.877+0000 7fe9209dd640 1 -- 172.21.15.16:0/1276889932 wait complete. 2024-05-11T01:01:51.888 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.992+0000 7f6cd38e3640 1 Processor -- start 2024-05-11T01:01:51.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.992+0000 7f6cd38e3640 1 -- start start 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cd38e3640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6ccc15ba90 0x7f6ccc0723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cd38e3640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ccc072b10 con 0x7f6ccc0b4a30 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cd38e3640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ccc072df0 con 0x7f6ccc15b6b0 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cd38e3640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f6ccc0728e0 con 0x7f6ccc15ba90 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cd1e80640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6ccc0b4a30 0x7f6ccc06e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58006/0 (socket says 172.21.15.16:58006) 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cd1e80640 1 -- 172.21.15.16:0/148595265 learned_addr learned my addr 172.21.15.16:0/148595265 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cd0e7e640 1 --2- 172.21.15.16:0/148595265 >> v2:172.21.15.174:3300/0 conn(0x7f6ccc15ba90 0x7f6ccc0723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941653183 0 0) 0x7f6ccc072b10 con 0x7f6ccc0b4a30 2024-05-11T01:01:51.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.993+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cb8004630 con 0x7f6ccc0b4a30 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 774060819 0 0) 0x7f6cb8004630 con 0x7f6ccc0b4a30 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 >> v2:172.21.15.174:3300/0 conn(0x7f6ccc15ba90 msgr2=0x7f6ccc0723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 --2- 172.21.15.16:0/148595265 >> v2:172.21.15.174:3300/0 conn(0x7f6ccc15ba90 0x7f6ccc0723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 >> v1:172.21.15.174:6789/0 conn(0x7f6ccc15b6b0 legacy=0x7f6ccc073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc0730d0 con 0x7f6ccc0b4a30 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f6cc8001a70 con 0x7f6ccc0b4a30 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 >> v1:172.21.15.16:6789/0 conn(0x7f6ccc0b4a30 legacy=0x7f6ccc06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cb8004b10 0x7f6cb8004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb8005910 0x7f6cb8005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cb80062d0 0x7f6cb800cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb800d140 con 0x7f6cb80062d0 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb800d2f0 con 0x7f6cb8004b10 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb800d4f0 con 0x7f6cb8005910 2024-05-11T01:01:51.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd1e80640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cb80062d0 0x7f6cb800cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd167f640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cb8004b10 0x7f6cb8004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd0e7e640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb8005910 0x7f6cb8005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd1e80640 1 -- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb8005910 msgr2=0x7f6cb8005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd1e80640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb8005910 0x7f6cb8005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd1e80640 1 -- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cb8004b10 msgr2=0x7f6cb8004ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd1e80640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cb8004b10 0x7f6cb8004ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd1e80640 1 -- 172.21.15.16:0/148595265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb8004630 con 0x7f6cb80062d0 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.994+0000 7f6cd0e7e640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb8005910 0x7f6cb8005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.995+0000 7f6cd1e80640 1 -- 172.21.15.16:0/148595265 reap_dead start 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.995+0000 7f6cd1e80640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cb80062d0 0x7f6cb800cad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800a830 tx=0x7f6cb8006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd98ac67ee974f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.995+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc800a480 con 0x7f6cb80062d0 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.995+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc8031070 con 0x7f6cb80062d0 2024-05-11T01:01:51.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.995+0000 7f6cc3fff640 1 -- 172.21.15.16:0/148595265 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc802dde0 con 0x7f6cb80062d0 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.996+0000 7f6cd38e3640 1 -- 172.21.15.16:0/148595265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cb80062d0 msgr2=0x7f6cb800cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.996+0000 7f6cd38e3640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cb80062d0 0x7f6cb800cad0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800a830 tx=0x7f6cb8006940 comp rx=0 tx=0).stop 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.996+0000 7f6cd38e3640 1 -- 172.21.15.16:0/148595265 shutdown_connections 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.996+0000 7f6cd38e3640 1 --2- 172.21.15.16:0/148595265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cb80062d0 0x7f6cb800cad0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.996+0000 7f6cd38e3640 1 -- 172.21.15.16:0/148595265 >> 172.21.15.16:0/148595265 conn(0x7f6ccc06fd90 msgr2=0x7f6ccc06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.996+0000 7f6cd38e3640 1 -- 172.21.15.16:0/148595265 shutdown_connections 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.996+0000 7f6cd38e3640 1 -- 172.21.15.16:0/148595265 wait complete. 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.997+0000 7f6cd38e3640 1 Processor -- start 2024-05-11T01:01:52.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.997+0000 7f6cd38e3640 1 -- start start 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd38e3640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb80062d0 0x7f6ccc14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd38e3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ccc0ccdb0 0x7f6ccc0cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd38e3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ccc14d380 0x7f6ccc0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd38e3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0723a0 con 0x7f6ccc14d380 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd38e3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc073690 con 0x7f6ccc0ccdb0 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd38e3640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc072520 con 0x7f6cb80062d0 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ccc14d380 0x7f6ccc0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ccc14d380 0x7f6ccc0ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52304/0 (socket says 172.21.15.16:52304) 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 -- 172.21.15.16:0/2810958886 learned_addr learned my addr 172.21.15.16:0/2810958886 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd167f640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb80062d0 0x7f6ccc14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd0e7e640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ccc0ccdb0 0x7f6ccc0cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 -- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb80062d0 msgr2=0x7f6ccc14b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb80062d0 0x7f6ccc14b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 -- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ccc0ccdb0 msgr2=0x7f6ccc0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ccc0ccdb0 0x7f6ccc0cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 -- 172.21.15.16:0/2810958886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc152d70 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd0e7e640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ccc0ccdb0 0x7f6ccc0cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cd1e80640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ccc14d380 0x7f6ccc0ce140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800a830 tx=0x7f6ccc072fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cc1ffb640 1 -- 172.21.15.16:0/2810958886 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8001fc0 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cc1ffb640 1 -- 172.21.15.16:0/2810958886 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc800a460 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.998+0000 7f6cc1ffb640 1 -- 172.21.15.16:0/2810958886 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8004d60 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.999+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc14c600 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:51.999+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc14cb80 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.000+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ccc06a5b0 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.000+0000 7f6cc1ffb640 1 -- 172.21.15.16:0/2810958886 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6cc803e030 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.001+0000 7f6cc1ffb640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6cb00762d0 0x7f6cb0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.001+0000 7f6cc1ffb640 1 -- 172.21.15.16:0/2810958886 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f6cc80b7010 con 0x7f6ccc14d380 2024-05-11T01:01:52.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.001+0000 7f6cd167f640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6cb00762d0 0x7f6cb0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.002+0000 7f6cd167f640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6cb00762d0 0x7f6cb0078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4000c00 tx=0x7f6cc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:52.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.005+0000 7f6cc1ffb640 1 -- 172.21.15.16:0/2810958886 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6cc8080320 con 0x7f6ccc14d380 2024-05-11T01:01:52.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.199+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ccc0b36a0 con 0x7f6ccc14d380 2024-05-11T01:01:52.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.200+0000 7f6cc1ffb640 1 -- 172.21.15.16:0/2810958886 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16658 (secure 0 0 0) 0x7f6cc8084620 con 0x7f6ccc14d380 2024-05-11T01:01:52.200 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:52.200 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":30,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:50.892334+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:48.556825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:49.853034+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.202+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6cb00762d0 msgr2=0x7f6cb0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.202+0000 7f6cd38e3640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6cb00762d0 0x7f6cb0078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4000c00 tx=0x7f6cc4009040 comp rx=0 tx=0).stop 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.202+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ccc14d380 msgr2=0x7f6ccc0ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.202+0000 7f6cd38e3640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ccc14d380 0x7f6ccc0ce140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800a830 tx=0x7f6ccc072fc0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.203+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 shutdown_connections 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.203+0000 7f6cd38e3640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f6cb00762d0 0x7f6cb0078790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.203+0000 7f6cd38e3640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ccc14d380 0x7f6ccc0ce140 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.203+0000 7f6cd38e3640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ccc0ccdb0 0x7f6ccc0cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.203+0000 7f6cd38e3640 1 --2- 172.21.15.16:0/2810958886 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cb80062d0 0x7f6ccc14b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.203+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 >> 172.21.15.16:0/2810958886 conn(0x7f6ccc06fd90 msgr2=0x7f6ccc06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.203+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 shutdown_connections 2024-05-11T01:01:52.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.203+0000 7f6cd38e3640 1 -- 172.21.15.16:0/2810958886 wait complete. 2024-05-11T01:01:52.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-11T01:01:52.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.322+0000 7fcc7ff89640 1 Processor -- start 2024-05-11T01:01:52.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.322+0000 7fcc7ff89640 1 -- start start 2024-05-11T01:01:52.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7ff89640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcc78145ba0 0x7fcc78160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7ff89640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcc780b2bf0 0x7fcc780b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7ff89640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc78073ca0 con 0x7fcc780b3f60 2024-05-11T01:01:52.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7ff89640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcc780b3590 con 0x7fcc78145ba0 2024-05-11T01:01:52.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7ff89640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fcc780b4e20 con 0x7fcc780b2bf0 2024-05-11T01:01:52.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7dd25640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcc78145ba0 0x7fcc78160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7dd25640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcc78145ba0 0x7fcc78160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52318/0 (socket says 172.21.15.16:52318) 2024-05-11T01:01:52.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7dd25640 1 -- 172.21.15.16:0/2833980617 learned_addr learned my addr 172.21.15.16:0/2833980617 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:52.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7d524640 1 --2- 172.21.15.16:0/2833980617 >> v2:172.21.15.174:3300/0 conn(0x7fcc780b2bf0 0x7fcc780b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7dd25640 1 -- 172.21.15.16:0/2833980617 >> v2:172.21.15.174:3300/0 conn(0x7fcc780b2bf0 msgr2=0x7fcc780b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:52.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7dd25640 1 --2- 172.21.15.16:0/2833980617 >> v2:172.21.15.174:3300/0 conn(0x7fcc780b2bf0 0x7fcc780b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7dd25640 1 -- 172.21.15.16:0/2833980617 >> v1:172.21.15.174:6789/0 conn(0x7fcc780b3f60 legacy=0x7fcc780b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.323+0000 7fcc7dd25640 1 -- 172.21.15.16:0/2833980617 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc780b4b40 con 0x7fcc78145ba0 2024-05-11T01:01:52.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.324+0000 7fcc7dd25640 1 --2- 172.21.15.16:0/2833980617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc78145ba0 0x7fcc78160920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcc78069060 tx=0x7fcc7402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298d04672c04a8b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:52.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.324+0000 7fcc7cd23640 1 -- 172.21.15.16:0/2833980617 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74037070 con 0x7fcc78145ba0 2024-05-11T01:01:52.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.324+0000 7fcc7cd23640 1 -- 172.21.15.16:0/2833980617 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc74032440 con 0x7fcc78145ba0 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.324+0000 7fcc7cd23640 1 -- 172.21.15.16:0/2833980617 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74032810 con 0x7fcc78145ba0 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.325+0000 7fcc7ff89640 1 -- 172.21.15.16:0/2833980617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc78145ba0 msgr2=0x7fcc78160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.325+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/2833980617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc78145ba0 0x7fcc78160920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcc78069060 tx=0x7fcc7402a1e0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.325+0000 7fcc7ff89640 1 -- 172.21.15.16:0/2833980617 shutdown_connections 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.325+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/2833980617 >> v2:172.21.15.174:3300/0 conn(0x7fcc780b2bf0 0x7fcc780b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.325+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/2833980617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc78145ba0 0x7fcc78160920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.325+0000 7fcc7ff89640 1 -- 172.21.15.16:0/2833980617 >> 172.21.15.16:0/2833980617 conn(0x7fcc7806c3e0 msgr2=0x7fcc7806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.325+0000 7fcc7ff89640 1 -- 172.21.15.16:0/2833980617 shutdown_connections 2024-05-11T01:01:52.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.325+0000 7fcc7ff89640 1 -- 172.21.15.16:0/2833980617 wait complete. 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.326+0000 7fcc7ff89640 1 Processor -- start 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.326+0000 7fcc7ff89640 1 -- start start 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7ff89640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc780b2bf0 0x7fcc7815b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7ff89640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc780b3f60 0x7fcc780d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7ff89640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc78145ba0 0x7fcc780d1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7ff89640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc78160400 con 0x7fcc780b2bf0 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7ff89640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcc78160120 con 0x7fcc78145ba0 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7ff89640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fcc780ce810 con 0x7fcc780b3f60 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7dd25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc780b2bf0 0x7fcc7815b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7dd25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc780b2bf0 0x7fcc7815b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52326/0 (socket says 172.21.15.16:52326) 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7dd25640 1 -- 172.21.15.16:0/4157416883 learned_addr learned my addr 172.21.15.16:0/4157416883 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:52.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7d524640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc780b3f60 0x7fcc780d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7e526640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc78145ba0 0x7fcc780d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7dd25640 1 -- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc780b3f60 msgr2=0x7fcc780d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7dd25640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc780b3f60 0x7fcc780d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7dd25640 1 -- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc78145ba0 msgr2=0x7fcc780d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7dd25640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc78145ba0 0x7fcc780d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7dd25640 1 -- 172.21.15.16:0/4157416883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7815bf40 con 0x7fcc780b2bf0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.327+0000 7fcc7d524640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc780b3f60 0x7fcc780d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.328+0000 7fcc7dd25640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc780b2bf0 0x7fcc7815b5d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc7402a220 tx=0x7fcc740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.328+0000 7fcc6e7fc640 1 -- 172.21.15.16:0/4157416883 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74041020 con 0x7fcc780b2bf0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.328+0000 7fcc6e7fc640 1 -- 172.21.15.16:0/4157416883 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc740306c0 con 0x7fcc780b2bf0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.328+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc780d0770 con 0x7fcc780b2bf0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.328+0000 7fcc6e7fc640 1 -- 172.21.15.16:0/4157416883 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74037040 con 0x7fcc780b2bf0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.328+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc781f36b0 con 0x7fcc780b2bf0 2024-05-11T01:01:52.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.329+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7806a5b0 con 0x7fcc780b2bf0 2024-05-11T01:01:52.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.330+0000 7fcc6e7fc640 1 -- 172.21.15.16:0/4157416883 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc74044020 con 0x7fcc780b2bf0 2024-05-11T01:01:52.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.330+0000 7fcc6e7fc640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcc5c0762d0 0x7fcc5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:52.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.330+0000 7fcc6e7fc640 1 -- 172.21.15.16:0/4157416883 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fcc740b7d70 con 0x7fcc780b2bf0 2024-05-11T01:01:52.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.330+0000 7fcc7d524640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcc5c0762d0 0x7fcc5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:52.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.331+0000 7fcc7d524640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcc5c0762d0 0x7fcc5c078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcc7815c160 tx=0x7fcc68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:52.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.334+0000 7fcc6e7fc640 1 -- 172.21.15.16:0/4157416883 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc7404b030 con 0x7fcc780b2bf0 2024-05-11T01:01:52.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:52.564+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcc78073490 con 0x7fcc780b2bf0 2024-05-11T01:01:53.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.535+0000 7fcc6e7fc640 1 -- 172.21.15.16:0/4157416883 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fcc740816d0 con 0x7fcc780b2bf0 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcc5c0762d0 msgr2=0x7fcc5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcc5c0762d0 0x7fcc5c078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcc7815c160 tx=0x7fcc68008040 comp rx=0 tx=0).stop 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc780b2bf0 msgr2=0x7fcc7815b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc780b2bf0 0x7fcc7815b5d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcc7402a220 tx=0x7fcc740046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 shutdown_connections 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fcc5c0762d0 0x7fcc5c078790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc78145ba0 0x7fcc780d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc780b3f60 0x7fcc780d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 --2- 172.21.15.16:0/4157416883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc780b2bf0 0x7fcc7815b5d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 >> 172.21.15.16:0/4157416883 conn(0x7fcc7806c3e0 msgr2=0x7fcc780b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 shutdown_connections 2024-05-11T01:01:53.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.539+0000 7fcc7ff89640 1 -- 172.21.15.16:0/4157416883 wait complete. 2024-05-11T01:01:53.552 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-11T01:01:53.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-11T01:01:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.666+0000 7fc33f654640 1 Processor -- start 2024-05-11T01:01:53.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.666+0000 7fc33f654640 1 -- start start 2024-05-11T01:01:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33f654640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc33815f6b0 0x7fc3380d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:53.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33f654640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3380bac80 0x7fc3380d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33f654640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33815fa90 con 0x7fc3380d00e0 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33f654640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc3380d3750 con 0x7fc33815f6b0 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33f654640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc3380d39f0 con 0x7fc3380bac80 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33d3f0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc33815f6b0 0x7fc3380d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33d3f0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc33815f6b0 0x7fc3380d3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52034/0 (socket says 172.21.15.16:52034) 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33d3f0640 1 -- 172.21.15.16:0/3295553454 learned_addr learned my addr 172.21.15.16:0/3295553454 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.667+0000 7fc33cbef640 1 --2- 172.21.15.16:0/3295553454 >> v2:172.21.15.174:3300/0 conn(0x7fc3380bac80 0x7fc3380d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.668+0000 7fc33d3f0640 1 -- 172.21.15.16:0/3295553454 >> v2:172.21.15.174:3300/0 conn(0x7fc3380bac80 msgr2=0x7fc3380d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.668+0000 7fc33d3f0640 1 --2- 172.21.15.16:0/3295553454 >> v2:172.21.15.174:3300/0 conn(0x7fc3380bac80 0x7fc3380d4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.668+0000 7fc33d3f0640 1 -- 172.21.15.16:0/3295553454 >> v1:172.21.15.174:6789/0 conn(0x7fc3380d00e0 legacy=0x7fc3380b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.668+0000 7fc33d3f0640 1 -- 172.21.15.16:0/3295553454 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3380d3cd0 con 0x7fc33815f6b0 2024-05-11T01:01:53.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.668+0000 7fc33cbef640 1 --2- 172.21.15.16:0/3295553454 >> v2:172.21.15.174:3300/0 conn(0x7fc3380bac80 0x7fc3380d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:53.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.668+0000 7fc33d3f0640 1 --2- 172.21.15.16:0/3295553454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc3380d3210 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc3380d63a0 tx=0x7fc33402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b858ca9ebb9baa server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:53.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.668+0000 7fc32ffff640 1 -- 172.21.15.16:0/3295553454 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334037070 con 0x7fc33815f6b0 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc32ffff640 1 -- 172.21.15.16:0/3295553454 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33402ae50 con 0x7fc33815f6b0 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc32ffff640 1 -- 172.21.15.16:0/3295553454 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334032860 con 0x7fc33815f6b0 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc33f654640 1 -- 172.21.15.16:0/3295553454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 msgr2=0x7fc3380d3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc33f654640 1 --2- 172.21.15.16:0/3295553454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc3380d3210 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc3380d63a0 tx=0x7fc33402a300 comp rx=0 tx=0).stop 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc33f654640 1 -- 172.21.15.16:0/3295553454 shutdown_connections 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc33f654640 1 --2- 172.21.15.16:0/3295553454 >> v2:172.21.15.174:3300/0 conn(0x7fc3380bac80 0x7fc3380d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc33f654640 1 --2- 172.21.15.16:0/3295553454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc3380d3210 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc33f654640 1 -- 172.21.15.16:0/3295553454 >> 172.21.15.16:0/3295553454 conn(0x7fc338073f00 msgr2=0x7fc338074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc33f654640 1 -- 172.21.15.16:0/3295553454 shutdown_connections 2024-05-11T01:01:53.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.669+0000 7fc33f654640 1 -- 172.21.15.16:0/3295553454 wait complete. 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.670+0000 7fc33f654640 1 Processor -- start 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.670+0000 7fc33f654640 1 -- start start 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33f654640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3380bac80 0x7fc33815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33f654640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3380d00e0 0x7fc3380ba160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33f654640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc33815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33f654640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc3380d4570 con 0x7fc33815f6b0 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33f654640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc3380d4290 con 0x7fc3380d00e0 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33f654640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc3380d4fd0 con 0x7fc3380bac80 2024-05-11T01:01:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33dbf1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc33815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33dbf1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc33815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52046/0 (socket says 172.21.15.16:52046) 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33dbf1640 1 -- 172.21.15.16:0/185853502 learned_addr learned my addr 172.21.15.16:0/185853502 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33cbef640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3380d00e0 0x7fc3380ba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.671+0000 7fc33d3f0640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3380bac80 0x7fc33815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33dbf1640 1 -- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3380bac80 msgr2=0x7fc33815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33dbf1640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3380bac80 0x7fc33815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33dbf1640 1 -- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3380d00e0 msgr2=0x7fc3380ba160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33dbf1640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3380d00e0 0x7fc3380ba160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33dbf1640 1 -- 172.21.15.16:0/185853502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3380ba6a0 con 0x7fc33815f6b0 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33d3f0640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3380bac80 0x7fc33815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33dbf1640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc33815da00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc33000c7a0 tx=0x7fc33000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc32dffb640 1 -- 172.21.15.16:0/185853502 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330003b70 con 0x7fc33815f6b0 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc32dffb640 1 -- 172.21.15.16:0/185853502 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc330003d10 con 0x7fc33815f6b0 2024-05-11T01:01:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3380abd20 con 0x7fc33815f6b0 2024-05-11T01:01:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc32dffb640 1 -- 172.21.15.16:0/185853502 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33000aa70 con 0x7fc33815f6b0 2024-05-11T01:01:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.672+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3380ac2e0 con 0x7fc33815f6b0 2024-05-11T01:01:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.673+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33806a5b0 con 0x7fc33815f6b0 2024-05-11T01:01:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.674+0000 7fc32dffb640 1 -- 172.21.15.16:0/185853502 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc33000ac10 con 0x7fc33815f6b0 2024-05-11T01:01:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.674+0000 7fc32dffb640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc31c076300 0x7fc31c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.675+0000 7fc32dffb640 1 -- 172.21.15.16:0/185853502 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc330097480 con 0x7fc33815f6b0 2024-05-11T01:01:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.675+0000 7fc33d3f0640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc31c076300 0x7fc31c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.675+0000 7fc33d3f0640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc31c076300 0x7fc31c0787c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc334034000 tx=0x7fc33402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.679+0000 7fc32dffb640 1 -- 172.21.15.16:0/185853502 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc330060dd0 con 0x7fc33815f6b0 2024-05-11T01:01:53.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:53.908+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc3380b91e0 con 0x7fc33815f6b0 2024-05-11T01:01:54.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.540+0000 7fc32dffb640 1 -- 172.21.15.16:0/185853502 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fc3300606d0 con 0x7fc33815f6b0 2024-05-11T01:01:54.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc31c076300 msgr2=0x7fc31c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:54.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc31c076300 0x7fc31c0787c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc334034000 tx=0x7fc33402e000 comp rx=0 tx=0).stop 2024-05-11T01:01:54.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 msgr2=0x7fc33815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:54.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc33815da00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc33000c7a0 tx=0x7fc33000cc60 comp rx=0 tx=0).stop 2024-05-11T01:01:54.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 shutdown_connections 2024-05-11T01:01:54.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fc31c076300 0x7fc31c0787c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc33815f6b0 0x7fc33815da00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3380d00e0 0x7fc3380ba160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 --2- 172.21.15.16:0/185853502 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc3380bac80 0x7fc33815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 >> 172.21.15.16:0/185853502 conn(0x7fc338073f00 msgr2=0x7fc3380d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:54.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 shutdown_connections 2024-05-11T01:01:54.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.543+0000 7fc33f654640 1 -- 172.21.15.16:0/185853502 wait complete. 2024-05-11T01:01:54.556 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-11T01:01:54.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:54.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.667+0000 7f69c8ff2640 1 Processor -- start 2024-05-11T01:01:54.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.667+0000 7f69c8ff2640 1 -- start start 2024-05-11T01:01:54.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c8ff2640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f69c40b33e0 0x7f69c40b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:54.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c8ff2640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c415c6e0 con 0x7f69c4145ae0 2024-05-11T01:01:54.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c8ff2640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c4145ec0 con 0x7f69c40b4040 2024-05-11T01:01:54.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c8ff2640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f69c415ccc0 con 0x7f69c40b33e0 2024-05-11T01:01:54.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c2d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f69c40b33e0 0x7f69c40b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:54.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c2d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f69c40b33e0 0x7f69c40b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52048/0 (socket says 172.21.15.16:52048) 2024-05-11T01:01:54.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c2d9d640 1 -- 172.21.15.16:0/265150948 learned_addr learned my addr 172.21.15.16:0/265150948 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:54.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c2d9d640 1 -- 172.21.15.16:0/265150948 >> v1:172.21.15.174:6789/0 conn(0x7f69c40b4040 legacy=0x7f69c40b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:54.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c2d9d640 1 -- 172.21.15.16:0/265150948 >> v1:172.21.15.16:6789/0 conn(0x7f69c4145ae0 legacy=0x7f69c415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:54.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.668+0000 7f69c2d9d640 1 -- 172.21.15.16:0/265150948 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c40b4a90 con 0x7f69c40b33e0 2024-05-11T01:01:54.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.669+0000 7f69c2d9d640 1 --2- 172.21.15.16:0/265150948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b33e0 0x7f69c40b44a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009e50 tx=0x7f69bc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4daa6270a3db928 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:54.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.669+0000 7f69c159a640 1 -- 172.21.15.16:0/265150948 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc036070 con 0x7f69c40b33e0 2024-05-11T01:01:54.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.669+0000 7f69c159a640 1 -- 172.21.15.16:0/265150948 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc031600 con 0x7f69c40b33e0 2024-05-11T01:01:54.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.669+0000 7f69c159a640 1 -- 172.21.15.16:0/265150948 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc0319d0 con 0x7f69c40b33e0 2024-05-11T01:01:54.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.670+0000 7f69c8ff2640 1 -- 172.21.15.16:0/265150948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b33e0 msgr2=0x7f69c40b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:54.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.670+0000 7f69c8ff2640 1 --2- 172.21.15.16:0/265150948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b33e0 0x7f69c40b44a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009e50 tx=0x7f69bc02a710 comp rx=0 tx=0).stop 2024-05-11T01:01:54.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.670+0000 7f69c8ff2640 1 -- 172.21.15.16:0/265150948 shutdown_connections 2024-05-11T01:01:54.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.670+0000 7f69c8ff2640 1 --2- 172.21.15.16:0/265150948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b33e0 0x7f69c40b44a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.670+0000 7f69c8ff2640 1 -- 172.21.15.16:0/265150948 >> 172.21.15.16:0/265150948 conn(0x7f69c406fd90 msgr2=0x7f69c406c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:54.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.670+0000 7f69c8ff2640 1 -- 172.21.15.16:0/265150948 shutdown_connections 2024-05-11T01:01:54.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.670+0000 7f69c8ff2640 1 -- 172.21.15.16:0/265150948 wait complete. 2024-05-11T01:01:54.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.671+0000 7f69c8ff2640 1 Processor -- start 2024-05-11T01:01:54.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.671+0000 7f69c8ff2640 1 -- start start 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c8ff2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69c40b33e0 0x7f69c4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c8ff2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b4040 0x7f69c4142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c8ff2640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69c4145ae0 0x7f69c4142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c8ff2640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69c4073b70 con 0x7f69c40b4040 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c8ff2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f69c415c950 con 0x7f69c40b33e0 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c8ff2640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f69c4073cf0 con 0x7f69c4145ae0 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b4040 0x7f69c4142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c1d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b4040 0x7f69c4142040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52050/0 (socket says 172.21.15.16:52050) 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c1d9b640 1 -- 172.21.15.16:0/3636571584 learned_addr learned my addr 172.21.15.16:0/3636571584 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c259c640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69c40b33e0 0x7f69c4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.672+0000 7f69c2d9d640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69c4145ae0 0x7f69c4142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69c1d9b640 1 -- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69c4145ae0 msgr2=0x7f69c4142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69c1d9b640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69c4145ae0 0x7f69c4142580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69c1d9b640 1 -- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69c40b33e0 msgr2=0x7f69c4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69c1d9b640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69c40b33e0 0x7f69c4143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69c1d9b640 1 -- 172.21.15.16:0/3636571584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c415f1f0 con 0x7f69c40b4040 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69c1d9b640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b4040 0x7f69c4142040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69b800c430 tx=0x7f69b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69b2ffd640 1 -- 172.21.15.16:0/3636571584 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8011790 con 0x7f69c40b4040 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69b2ffd640 1 -- 172.21.15.16:0/3636571584 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b8017070 con 0x7f69c40b4040 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c4142c90 con 0x7f69c40b4040 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69b2ffd640 1 -- 172.21.15.16:0/3636571584 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8011bb0 con 0x7f69c40b4040 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.673+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c4143250 con 0x7f69c40b4040 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.674+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c406a5b0 con 0x7f69c40b4040 2024-05-11T01:01:54.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.675+0000 7f69b2ffd640 1 -- 172.21.15.16:0/3636571584 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f69b801c460 con 0x7f69c40b4040 2024-05-11T01:01:54.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.675+0000 7f69b2ffd640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f69a40762d0 0x7f69a4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:54.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.675+0000 7f69b2ffd640 1 -- 172.21.15.16:0/3636571584 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f69b8097380 con 0x7f69c40b4040 2024-05-11T01:01:54.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.676+0000 7f69c259c640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f69a40762d0 0x7f69a4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:54.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.676+0000 7f69c259c640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f69a40762d0 0x7f69a4078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69b4001720 tx=0x7f69b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:54.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.680+0000 7f69b2ffd640 1 -- 172.21.15.16:0/3636571584 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f69b8060690 con 0x7f69c40b4040 2024-05-11T01:01:54.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.914+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69c4141310 con 0x7f69c40b4040 2024-05-11T01:01:54.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.915+0000 7f69b2ffd640 1 -- 172.21.15.16:0/3636571584 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f69b8064990 con 0x7f69c40b4040 2024-05-11T01:01:54.915 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:54.915 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/325711019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":325711019},{"type":"v1","addr":"172.21.15.174:6836","nonce":325711019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2354391599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2354391599},{"type":"v1","addr":"172.21.15.16:6835","nonce":2354391599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4809,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2932760959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2932760959},{"type":"v1","addr":"172.21.15.174:6837","nonce":2932760959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:50.892297+0000","modified":"2024-05-11T01:01:53.909794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4812},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4812":{"gid":4812,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/2086463820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2086463820},{"type":"v1","addr":"172.21.15.16:6834","nonce":2086463820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4812,"qdb_cluster":[4812]},"id":2}]} 2024-05-11T01:01:54.915 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-05-11T01:01:54.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f69a40762d0 msgr2=0x7f69a4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:54.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f69a40762d0 0x7f69a4078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f69b4001720 tx=0x7f69b4009040 comp rx=0 tx=0).stop 2024-05-11T01:01:54.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b4040 msgr2=0x7f69c4142040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:54.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b4040 0x7f69c4142040 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f69b800c430 tx=0x7f69b800c8f0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 shutdown_connections 2024-05-11T01:01:54.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f69a40762d0 0x7f69a4078790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f69c4145ae0 0x7f69c4142580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69c40b4040 0x7f69c4142040 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 --2- 172.21.15.16:0/3636571584 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f69c40b33e0 0x7f69c4143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:54.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 >> 172.21.15.16:0/3636571584 conn(0x7f69c406fd90 msgr2=0x7f69c40cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:54.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 shutdown_connections 2024-05-11T01:01:54.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:54.917+0000 7f69c8ff2640 1 -- 172.21.15.16:0/3636571584 wait complete. 2024-05-11T01:01:54.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:01:55.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.031+0000 7fac99b38640 1 Processor -- start 2024-05-11T01:01:55.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.031+0000 7fac99b38640 1 -- start start 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac99b38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 0x7fac940d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac99b38640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac94162fb0 con 0x7fac940d3090 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac99b38640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac94163290 con 0x7fac9415f530 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac99b38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fac94163ea0 con 0x7fac9406f140 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac93fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fac940d3090 0x7fac940cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53504/0 (socket says 172.21.15.16:53504) 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac93fff640 1 -- 172.21.15.16:0/1952150185 learned_addr learned my addr 172.21.15.16:0/1952150185 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114348699 0 0) 0x7fac94162fb0 con 0x7fac940d3090 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac92ffd640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 0x7fac940d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.032+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac7c003520 con 0x7fac940d3090 2024-05-11T01:01:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1209743602 0 0) 0x7fac7c003520 con 0x7fac940d3090 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 msgr2=0x7fac940d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 0x7fac940d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 >> v1:172.21.15.174:6789/0 conn(0x7fac9415f530 legacy=0x7fac940cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac94163570 con 0x7fac940d3090 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fac8c001a70 con 0x7fac940d3090 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 >> v1:172.21.15.16:6789/0 conn(0x7fac940d3090 legacy=0x7fac940cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac7c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 0x7fac7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac7c004d40 0x7fac7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac94163ea0 con 0x7fac7c0039e0 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c00ba70 con 0x7fac7c004d40 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fac7c00bc70 con 0x7fac9406f140 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac937fe640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac7c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac93fff640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac7c004d40 0x7fac7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac92ffd640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 0x7fac7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac937fe640 1 -- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 msgr2=0x7fac7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac937fe640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 0x7fac7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac937fe640 1 -- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac7c004d40 msgr2=0x7fac7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac937fe640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac7c004d40 0x7fac7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac937fe640 1 -- 172.21.15.16:0/1952150185 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c003520 con 0x7fac7c0039e0 2024-05-11T01:01:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac93fff640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac7c004d40 0x7fac7c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.033+0000 7fac92ffd640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac9406f140 0x7fac7c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.034+0000 7fac937fe640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac7c003dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac840017e0 tx=0x7fac7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb7e948678a3cb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.034+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84037070 con 0x7fac7c0039e0 2024-05-11T01:01:55.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.034+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8402ac30 con 0x7fac7c0039e0 2024-05-11T01:01:55.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.034+0000 7fac927fc640 1 -- 172.21.15.16:0/1952150185 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84001430 con 0x7fac7c0039e0 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.034+0000 7fac99b38640 1 -- 172.21.15.16:0/1952150185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 msgr2=0x7fac7c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.034+0000 7fac99b38640 1 --2- 172.21.15.16:0/1952150185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac7c003dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac840017e0 tx=0x7fac7c005830 comp rx=0 tx=0).stop 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.035+0000 7fac93fff640 1 -- 172.21.15.16:0/1952150185 reap_dead start 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.035+0000 7fac99b38640 1 -- 172.21.15.16:0/1952150185 shutdown_connections 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.035+0000 7fac99b38640 1 -- 172.21.15.16:0/1952150185 >> 172.21.15.16:0/1952150185 conn(0x7fac940681c0 msgr2=0x7fac940685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.035+0000 7fac99b38640 1 -- 172.21.15.16:0/1952150185 shutdown_connections 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.035+0000 7fac99b38640 1 -- 172.21.15.16:0/1952150185 wait complete. 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.036+0000 7fac99b38640 1 Processor -- start 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.036+0000 7fac99b38640 1 -- start start 2024-05-11T01:01:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac99b38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac940ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac99b38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac941f9260 0x7fac94158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac99b38640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac94161340 0x7fac9415d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac99b38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fac940d2a20 con 0x7fac7c0039e0 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac99b38640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fac94163b30 con 0x7fac94161340 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac99b38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fac940d2ba0 con 0x7fac941f9260 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac940ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac940ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52068/0 (socket says 172.21.15.16:52068) 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 -- 172.21.15.16:0/1523791736 learned_addr learned my addr 172.21.15.16:0/1523791736 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 -- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac941f9260 msgr2=0x7fac94158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac941f9260 0x7fac94158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 -- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac94161340 msgr2=0x7fac9415d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac94161340 0x7fac9415d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 -- 172.21.15.16:0/1523791736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac94158ec0 con 0x7fac7c0039e0 2024-05-11T01:01:55.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac937fe640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac940ca420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac84035040 tx=0x7fac84001110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac7bfff640 1 -- 172.21.15.16:0/1523791736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84040020 con 0x7fac7c0039e0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac7bfff640 1 -- 172.21.15.16:0/1523791736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac84005070 con 0x7fac7c0039e0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.037+0000 7fac7bfff640 1 -- 172.21.15.16:0/1523791736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84037040 con 0x7fac7c0039e0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.038+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac940c6d90 con 0x7fac7c0039e0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.038+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac940c7350 con 0x7fac7c0039e0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.039+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac9406a5b0 con 0x7fac7c0039e0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.039+0000 7fac7bfff640 1 -- 172.21.15.16:0/1523791736 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fac84043020 con 0x7fac7c0039e0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.040+0000 7fac7bfff640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fac80076300 0x7fac800787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.040+0000 7fac7bfff640 1 -- 172.21.15.16:0/1523791736 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fac840b74a0 con 0x7fac7c0039e0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.040+0000 7fac92ffd640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fac80076300 0x7fac800787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.041+0000 7fac92ffd640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fac80076300 0x7fac800787c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac940cd6b0 tx=0x7fac88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.044+0000 7fac7bfff640 1 -- 172.21.15.16:0/1523791736 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fac8404a030 con 0x7fac7c0039e0 2024-05-11T01:01:55.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.233+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac940710c0 con 0x7fac7c0039e0 2024-05-11T01:01:55.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.235+0000 7fac7bfff640 1 -- 172.21.15.16:0/1523791736 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16645 (secure 0 0 0) 0x7fac84080e00 con 0x7fac7c0039e0 2024-05-11T01:01:55.235 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:55.235 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:01:52.511999+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:48.556825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:49.853034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fac80076300 msgr2=0x7fac800787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fac80076300 0x7fac800787c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fac940cd6b0 tx=0x7fac88008040 comp rx=0 tx=0).stop 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 msgr2=0x7fac940ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac940ca420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fac84035040 tx=0x7fac84001110 comp rx=0 tx=0).stop 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 shutdown_connections 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fac80076300 0x7fac800787c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac94161340 0x7fac9415d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fac941f9260 0x7fac94158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 --2- 172.21.15.16:0/1523791736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac7c0039e0 0x7fac940ca420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 >> 172.21.15.16:0/1523791736 conn(0x7fac940681c0 msgr2=0x7fac9415e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:55.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 shutdown_connections 2024-05-11T01:01:55.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.237+0000 7fac99b38640 1 -- 172.21.15.16:0/1523791736 wait complete. 2024-05-11T01:01:55.248 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-11T01:01:55.248 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:55.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.353+0000 7fa9c5fc9640 1 Processor -- start 2024-05-11T01:01:55.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.353+0000 7fa9c5fc9640 1 -- start start 2024-05-11T01:01:55.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9c5fc9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa9c00d2ec0 0x7fa9c00bab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9c5fc9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9c00b8380 0x7fa9c00d45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9c5fc9640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c00d3800 con 0x7fa9c00b6d70 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9c5fc9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c00d35b0 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9c5fc9640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c00bb0b0 con 0x7fa9c00b8380 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9beffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa9c00d2ec0 0x7fa9c00bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9beffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa9c00d2ec0 0x7fa9c00bab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52076/0 (socket says 172.21.15.16:52076) 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9beffd640 1 -- 172.21.15.16:0/2392409392 learned_addr learned my addr 172.21.15.16:0/2392409392 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9bffff640 1 --2- 172.21.15.16:0/2392409392 >> v2:172.21.15.174:3300/0 conn(0x7fa9c00b8380 0x7fa9c00d45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9beffd640 1 -- 172.21.15.16:0/2392409392 >> v2:172.21.15.174:3300/0 conn(0x7fa9c00b8380 msgr2=0x7fa9c00d45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9beffd640 1 --2- 172.21.15.16:0/2392409392 >> v2:172.21.15.174:3300/0 conn(0x7fa9c00b8380 0x7fa9c00d45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9beffd640 1 -- 172.21.15.16:0/2392409392 >> v1:172.21.15.174:6789/0 conn(0x7fa9c00b6d70 legacy=0x7fa9c00b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9beffd640 1 -- 172.21.15.16:0/2392409392 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c00d3ae0 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.354+0000 7fa9bffff640 1 --2- 172.21.15.16:0/2392409392 >> v2:172.21.15.174:3300/0 conn(0x7fa9c00b8380 0x7fa9c00d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:55.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.355+0000 7fa9beffd640 1 --2- 172.21.15.16:0/2392409392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00bab70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00b81d0 tx=0x7fa9b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee50b4e4afe8fe23 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.355+0000 7fa9be7fc640 1 -- 172.21.15.16:0/2392409392 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4037070 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.355+0000 7fa9be7fc640 1 -- 172.21.15.16:0/2392409392 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4032440 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.355+0000 7fa9be7fc640 1 -- 172.21.15.16:0/2392409392 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4032810 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.355+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2392409392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 msgr2=0x7fa9c00bab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.355+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2392409392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00bab70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00b81d0 tx=0x7fa9b402a270 comp rx=0 tx=0).stop 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.356+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2392409392 shutdown_connections 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.356+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2392409392 >> v2:172.21.15.174:3300/0 conn(0x7fa9c00b8380 0x7fa9c00d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.356+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2392409392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00bab70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.356+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2392409392 >> 172.21.15.16:0/2392409392 conn(0x7fa9c0074140 msgr2=0x7fa9c00d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.356+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2392409392 shutdown_connections 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.356+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2392409392 wait complete. 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.357+0000 7fa9c5fc9640 1 Processor -- start 2024-05-11T01:01:55.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.357+0000 7fa9c5fc9640 1 -- start start 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9c5fc9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c00b6d70 0x7fa9c015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9c5fc9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9c00b8380 0x7fa9c014e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9c5fc9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9c5fc9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00b8810 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9c5fc9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c00d40a0 con 0x7fa9c00b6d70 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9c5fc9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c00b8990 con 0x7fa9c00b8380 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52086/0 (socket says 172.21.15.16:52086) 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 -- 172.21.15.16:0/2572186310 learned_addr learned my addr 172.21.15.16:0/2572186310 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bf7fe640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c00b6d70 0x7fa9c015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9beffd640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9c00b8380 0x7fa9c014e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 -- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9c00b8380 msgr2=0x7fa9c014e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9c00b8380 0x7fa9c014e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 -- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c00b6d70 msgr2=0x7fa9c015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c00b6d70 0x7fa9c015b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 -- 172.21.15.16:0/2572186310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c015b7d0 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.358+0000 7fa9bffff640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00b4eb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8007ea0 tx=0x7fa9b8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.359+0000 7fa9a7fff640 1 -- 172.21.15.16:0/2572186310 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b801a070 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.359+0000 7fa9a7fff640 1 -- 172.21.15.16:0/2572186310 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b8003bb0 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.359+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c0159750 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.359+0000 7fa9a7fff640 1 -- 172.21.15.16:0/2572186310 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b800de70 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.359+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c0159f90 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.360+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c00b93a0 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.360+0000 7fa9a7fff640 1 -- 172.21.15.16:0/2572186310 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa9b801d070 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.361+0000 7fa9a7fff640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9ac0762d0 0x7fa9ac078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.361+0000 7fa9a7fff640 1 -- 172.21.15.16:0/2572186310 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa9b8097820 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.361+0000 7fa9bf7fe640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9ac0762d0 0x7fa9ac078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.361+0000 7fa9bf7fe640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9ac0762d0 0x7fa9ac078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0001720 tx=0x7fa9b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.365+0000 7fa9a7fff640 1 -- 172.21.15.16:0/2572186310 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa9c00b93a0 con 0x7fa9c00d2ec0 2024-05-11T01:01:55.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.554+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9c006a5b0 con 0x7fa9ac0762d0 2024-05-11T01:01:55.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.560+0000 7fa9a7fff640 1 -- 172.21.15.16:0/2572186310 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240281 (secure 0 0 0) 0x7fa9c006a5b0 con 0x7fa9ac0762d0 2024-05-11T01:01:55.562 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:55.564 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:55.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9ac0762d0 msgr2=0x7fa9ac078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9ac0762d0 0x7fa9ac078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0001720 tx=0x7fa9b0009040 comp rx=0 tx=0).stop 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 msgr2=0x7fa9c00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00b4eb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8007ea0 tx=0x7fa9b8007f90 comp rx=0 tx=0).stop 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 shutdown_connections 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fa9ac0762d0 0x7fa9ac078790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9c00d2ec0 0x7fa9c00b4eb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9c00b8380 0x7fa9c014e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 --2- 172.21.15.16:0/2572186310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9c00b6d70 0x7fa9c015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 >> 172.21.15.16:0/2572186310 conn(0x7fa9c0074140 msgr2=0x7fa9c00b8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 shutdown_connections 2024-05-11T01:01:55.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.563+0000 7fa9c5fc9640 1 -- 172.21.15.16:0/2572186310 wait complete. 2024-05-11T01:01:55.574 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-11T01:01:53.765804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":40,"acting":40,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236452,"kb_used_data":3604,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738268,"statfs":{"total":773094113280,"available":772851986432,"internally_reserved":0,"allocated":3690496,"data_stored":2103496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.259374"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627052+0000","last_change":"2024-05-11T01:01:51.533236+0000","last_active":"2024-05-11T01:01:52.627052+0000","last_peered":"2024-05-11T01:01:52.627052+0000","last_clean":"2024-05-11T01:01:52.627052+0000","last_became_active":"2024-05-11T01:01:51.533008+0000","last_became_peered":"2024-05-11T01:01:51.533008+0000","last_unstale":"2024-05-11T01:01:52.627052+0000","last_undegraded":"2024-05-11T01:01:52.627052+0000","last_fullsized":"2024-05-11T01:01:52.627052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:23:11.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517868+0000","last_change":"2024-05-11T01:01:51.527448+0000","last_active":"2024-05-11T01:01:52.517868+0000","last_peered":"2024-05-11T01:01:52.517868+0000","last_clean":"2024-05-11T01:01:52.517868+0000","last_became_active":"2024-05-11T01:01:51.527022+0000","last_became_peered":"2024-05-11T01:01:51.527022+0000","last_unstale":"2024-05-11T01:01:52.517868+0000","last_undegraded":"2024-05-11T01:01:52.517868+0000","last_fullsized":"2024-05-11T01:01:52.517868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:25:10.174005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518108+0000","last_change":"2024-05-11T01:01:51.528750+0000","last_active":"2024-05-11T01:01:52.518108+0000","last_peered":"2024-05-11T01:01:52.518108+0000","last_clean":"2024-05-11T01:01:52.518108+0000","last_became_active":"2024-05-11T01:01:51.528502+0000","last_became_peered":"2024-05-11T01:01:51.528502+0000","last_unstale":"2024-05-11T01:01:52.518108+0000","last_undegraded":"2024-05-11T01:01:52.518108+0000","last_fullsized":"2024-05-11T01:01:52.518108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:57.178603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518176+0000","last_change":"2024-05-11T01:01:51.532606+0000","last_active":"2024-05-11T01:01:52.518176+0000","last_peered":"2024-05-11T01:01:52.518176+0000","last_clean":"2024-05-11T01:01:52.518176+0000","last_became_active":"2024-05-11T01:01:51.532345+0000","last_became_peered":"2024-05-11T01:01:51.532345+0000","last_unstale":"2024-05-11T01:01:52.518176+0000","last_undegraded":"2024-05-11T01:01:52.518176+0000","last_fullsized":"2024-05-11T01:01:52.518176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:28:08.188980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518328+0000","last_change":"2024-05-11T01:01:51.542113+0000","last_active":"2024-05-11T01:01:52.518328+0000","last_peered":"2024-05-11T01:01:52.518328+0000","last_clean":"2024-05-11T01:01:52.518328+0000","last_became_active":"2024-05-11T01:01:51.541795+0000","last_became_peered":"2024-05-11T01:01:51.541795+0000","last_unstale":"2024-05-11T01:01:52.518328+0000","last_undegraded":"2024-05-11T01:01:52.518328+0000","last_fullsized":"2024-05-11T01:01:52.518328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:31:04.808808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517564+0000","last_change":"2024-05-11T01:01:51.527691+0000","last_active":"2024-05-11T01:01:52.517564+0000","last_peered":"2024-05-11T01:01:52.517564+0000","last_clean":"2024-05-11T01:01:52.517564+0000","last_became_active":"2024-05-11T01:01:51.527433+0000","last_became_peered":"2024-05-11T01:01:51.527433+0000","last_unstale":"2024-05-11T01:01:52.517564+0000","last_undegraded":"2024-05-11T01:01:52.517564+0000","last_fullsized":"2024-05-11T01:01:52.517564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:54:08.582356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.516949+0000","last_change":"2024-05-11T01:01:51.532261+0000","last_active":"2024-05-11T01:01:52.516949+0000","last_peered":"2024-05-11T01:01:52.516949+0000","last_clean":"2024-05-11T01:01:52.516949+0000","last_became_active":"2024-05-11T01:01:51.531949+0000","last_became_peered":"2024-05-11T01:01:51.531949+0000","last_unstale":"2024-05-11T01:01:52.516949+0000","last_undegraded":"2024-05-11T01:01:52.516949+0000","last_fullsized":"2024-05-11T01:01:52.516949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:57:08.967224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626838+0000","last_change":"2024-05-11T01:01:51.530596+0000","last_active":"2024-05-11T01:01:52.626838+0000","last_peered":"2024-05-11T01:01:52.626838+0000","last_clean":"2024-05-11T01:01:52.626838+0000","last_became_active":"2024-05-11T01:01:51.530299+0000","last_became_peered":"2024-05-11T01:01:51.530299+0000","last_unstale":"2024-05-11T01:01:52.626838+0000","last_undegraded":"2024-05-11T01:01:52.626838+0000","last_fullsized":"2024-05-11T01:01:52.626838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:59:37.953674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518154+0000","last_change":"2024-05-11T01:01:51.525593+0000","last_active":"2024-05-11T01:01:52.518154+0000","last_peered":"2024-05-11T01:01:52.518154+0000","last_clean":"2024-05-11T01:01:52.518154+0000","last_became_active":"2024-05-11T01:01:51.525300+0000","last_became_peered":"2024-05-11T01:01:51.525300+0000","last_unstale":"2024-05-11T01:01:52.518154+0000","last_undegraded":"2024-05-11T01:01:52.518154+0000","last_fullsized":"2024-05-11T01:01:52.518154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:17:47.861045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627157+0000","last_change":"2024-05-11T01:01:50.527854+0000","last_active":"2024-05-11T01:01:52.627157+0000","last_peered":"2024-05-11T01:01:52.627157+0000","last_clean":"2024-05-11T01:01:52.627157+0000","last_became_active":"2024-05-11T01:01:50.527525+0000","last_became_peered":"2024-05-11T01:01:50.527525+0000","last_unstale":"2024-05-11T01:01:52.627157+0000","last_undegraded":"2024-05-11T01:01:52.627157+0000","last_fullsized":"2024-05-11T01:01:52.627157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:04:47.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627081+0000","last_change":"2024-05-11T01:01:51.538015+0000","last_active":"2024-05-11T01:01:52.627081+0000","last_peered":"2024-05-11T01:01:52.627081+0000","last_clean":"2024-05-11T01:01:52.627081+0000","last_became_active":"2024-05-11T01:01:51.537108+0000","last_became_peered":"2024-05-11T01:01:51.537108+0000","last_unstale":"2024-05-11T01:01:52.627081+0000","last_undegraded":"2024-05-11T01:01:52.627081+0000","last_fullsized":"2024-05-11T01:01:52.627081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:42:19.486739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517007+0000","last_change":"2024-05-11T01:01:51.526242+0000","last_active":"2024-05-11T01:01:52.517007+0000","last_peered":"2024-05-11T01:01:52.517007+0000","last_clean":"2024-05-11T01:01:52.517007+0000","last_became_active":"2024-05-11T01:01:51.525959+0000","last_became_peered":"2024-05-11T01:01:51.525959+0000","last_unstale":"2024-05-11T01:01:52.517007+0000","last_undegraded":"2024-05-11T01:01:52.517007+0000","last_fullsized":"2024-05-11T01:01:52.517007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:28.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518231+0000","last_change":"2024-05-11T01:01:51.526860+0000","last_active":"2024-05-11T01:01:52.518231+0000","last_peered":"2024-05-11T01:01:52.518231+0000","last_clean":"2024-05-11T01:01:52.518231+0000","last_became_active":"2024-05-11T01:01:51.526599+0000","last_became_peered":"2024-05-11T01:01:51.526599+0000","last_unstale":"2024-05-11T01:01:52.518231+0000","last_undegraded":"2024-05-11T01:01:52.518231+0000","last_fullsized":"2024-05-11T01:01:52.518231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:58:31.715741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626861+0000","last_change":"2024-05-11T01:01:51.527459+0000","last_active":"2024-05-11T01:01:52.626861+0000","last_peered":"2024-05-11T01:01:52.626861+0000","last_clean":"2024-05-11T01:01:52.626861+0000","last_became_active":"2024-05-11T01:01:51.527178+0000","last_became_peered":"2024-05-11T01:01:51.527178+0000","last_unstale":"2024-05-11T01:01:52.626861+0000","last_undegraded":"2024-05-11T01:01:52.626861+0000","last_fullsized":"2024-05-11T01:01:52.626861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:32:19.779851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626913+0000","last_change":"2024-05-11T01:01:50.529260+0000","last_active":"2024-05-11T01:01:52.626913+0000","last_peered":"2024-05-11T01:01:52.626913+0000","last_clean":"2024-05-11T01:01:52.626913+0000","last_became_active":"2024-05-11T01:01:50.528975+0000","last_became_peered":"2024-05-11T01:01:50.528975+0000","last_unstale":"2024-05-11T01:01:52.626913+0000","last_undegraded":"2024-05-11T01:01:52.626913+0000","last_fullsized":"2024-05-11T01:01:52.626913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:52:49.672380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517381+0000","last_change":"2024-05-11T01:01:51.528330+0000","last_active":"2024-05-11T01:01:52.517381+0000","last_peered":"2024-05-11T01:01:52.517381+0000","last_clean":"2024-05-11T01:01:52.517381+0000","last_became_active":"2024-05-11T01:01:51.528059+0000","last_became_peered":"2024-05-11T01:01:51.528059+0000","last_unstale":"2024-05-11T01:01:52.517381+0000","last_undegraded":"2024-05-11T01:01:52.517381+0000","last_fullsized":"2024-05-11T01:01:52.517381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:03:18.124412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626913+0000","last_change":"2024-05-11T01:01:51.530811+0000","last_active":"2024-05-11T01:01:52.626913+0000","last_peered":"2024-05-11T01:01:52.626913+0000","last_clean":"2024-05-11T01:01:52.626913+0000","last_became_active":"2024-05-11T01:01:51.530544+0000","last_became_peered":"2024-05-11T01:01:51.530544+0000","last_unstale":"2024-05-11T01:01:52.626913+0000","last_undegraded":"2024-05-11T01:01:52.626913+0000","last_fullsized":"2024-05-11T01:01:52.626913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:40:41.896646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:50.505815+0000","last_change":"2024-05-11T01:01:50.505815+0000","last_active":"2024-05-11T01:01:50.505815+0000","last_peered":"2024-05-11T01:01:50.505815+0000","last_clean":"2024-05-11T01:01:50.505815+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:50.505815+0000","last_undegraded":"2024-05-11T01:01:50.505815+0000","last_fullsized":"2024-05-11T01:01:50.505815+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:01:49.503418+0000","last_change":"2024-05-11T01:01:49.503418+0000","last_active":"2024-05-11T01:01:49.503418+0000","last_peered":"2024-05-11T01:01:49.503418+0000","last_clean":"2024-05-11T01:01:49.503418+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:01:49.503418+0000","last_undegraded":"2024-05-11T01:01:49.503418+0000","last_fullsized":"2024-05-11T01:01:49.503418+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517630+0000","last_change":"2024-05-11T01:01:51.529652+0000","last_active":"2024-05-11T01:01:52.517630+0000","last_peered":"2024-05-11T01:01:52.517630+0000","last_clean":"2024-05-11T01:01:52.517630+0000","last_became_active":"2024-05-11T01:01:51.529058+0000","last_became_peered":"2024-05-11T01:01:51.529058+0000","last_unstale":"2024-05-11T01:01:52.517630+0000","last_undegraded":"2024-05-11T01:01:52.517630+0000","last_fullsized":"2024-05-11T01:01:52.517630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:26:47.692082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626993+0000","last_change":"2024-05-11T01:01:50.526156+0000","last_active":"2024-05-11T01:01:52.626993+0000","last_peered":"2024-05-11T01:01:52.626993+0000","last_clean":"2024-05-11T01:01:52.626993+0000","last_became_active":"2024-05-11T01:01:50.525831+0000","last_became_peered":"2024-05-11T01:01:50.525831+0000","last_unstale":"2024-05-11T01:01:52.626993+0000","last_undegraded":"2024-05-11T01:01:52.626993+0000","last_fullsized":"2024-05-11T01:01:52.626993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:51:38.099684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518269+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:52.518269+0000","last_peered":"2024-05-11T01:01:52.518269+0000","last_clean":"2024-05-11T01:01:52.518269+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:52.518269+0000","last_undegraded":"2024-05-11T01:01:52.518269+0000","last_fullsized":"2024-05-11T01:01:52.518269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":2},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":6,"acting":6,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31484,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":108967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":892928,"data_stored":699335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:55.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:01:55.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.718+0000 7f056a875640 1 Processor -- start 2024-05-11T01:01:55.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.718+0000 7f056a875640 1 -- start start 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.719+0000 7f056a875640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f05640bac10 0x7f05640d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.719+0000 7f056a875640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0564163e90 con 0x7f05640d3ec0 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.719+0000 7f056a875640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0564163310 con 0x7f05640b6d70 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.719+0000 7f056a875640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f05640cfad0 con 0x7f05640bac10 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.719+0000 7f0568e12640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f05640d3ec0 0x7f05640d4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53516/0 (socket says 172.21.15.16:53516) 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.719+0000 7f0568e12640 1 -- 172.21.15.16:0/1410513341 learned_addr learned my addr 172.21.15.16:0/1410513341 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.719+0000 7f05637fe640 1 --2- 172.21.15.16:0/1410513341 >> v2:172.21.15.174:3300/0 conn(0x7f05640bac10 0x7f05640d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.720+0000 7f0562ffd640 1 -- 172.21.15.16:0/1410513341 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3214062064 0 0) 0x7f0564163e90 con 0x7f05640d3ec0 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.720+0000 7f0562ffd640 1 -- 172.21.15.16:0/1410513341 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f054c003520 con 0x7f05640d3ec0 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.720+0000 7f0562ffd640 1 -- 172.21.15.16:0/1410513341 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699330389 0 0) 0x7f0564163310 con 0x7f05640b6d70 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.720+0000 7f0562ffd640 1 -- 172.21.15.16:0/1410513341 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0564163e90 con 0x7f05640b6d70 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.720+0000 7f0562ffd640 1 -- 172.21.15.16:0/1410513341 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2232574106 0 0) 0x7f054c003520 con 0x7f05640d3ec0 2024-05-11T01:01:55.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.720+0000 7f05637fe640 1 -- 172.21.15.16:0/1410513341 >> v1:172.21.15.174:6789/0 conn(0x7f05640b6d70 legacy=0x7f05640b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.720+0000 7f05637fe640 1 -- 172.21.15.16:0/1410513341 >> v1:172.21.15.16:6789/0 conn(0x7f05640d3ec0 legacy=0x7f05640d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.720+0000 7f05637fe640 1 -- 172.21.15.16:0/1410513341 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05641635f0 con 0x7f05640bac10 2024-05-11T01:01:55.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f05637fe640 1 --2- 172.21.15.16:0/1410513341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05640bac10 0x7f05640d3980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f05580097d0 tx=0x7f055802a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9408a252b591c862 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f0562ffd640 1 -- 172.21.15.16:0/1410513341 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558037070 con 0x7f05640bac10 2024-05-11T01:01:55.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f0562ffd640 1 -- 172.21.15.16:0/1410513341 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055802abf0 con 0x7f05640bac10 2024-05-11T01:01:55.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f0562ffd640 1 -- 172.21.15.16:0/1410513341 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c001a70 con 0x7f05640bac10 2024-05-11T01:01:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f056a875640 1 -- 172.21.15.16:0/1410513341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05640bac10 msgr2=0x7f05640d3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f056a875640 1 --2- 172.21.15.16:0/1410513341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05640bac10 0x7f05640d3980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f05580097d0 tx=0x7f055802a160 comp rx=0 tx=0).stop 2024-05-11T01:01:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f056a875640 1 -- 172.21.15.16:0/1410513341 shutdown_connections 2024-05-11T01:01:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f056a875640 1 --2- 172.21.15.16:0/1410513341 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05640bac10 0x7f05640d3980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.721+0000 7f056a875640 1 -- 172.21.15.16:0/1410513341 >> 172.21.15.16:0/1410513341 conn(0x7f0564074140 msgr2=0x7f05640d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.722+0000 7f056a875640 1 -- 172.21.15.16:0/1410513341 shutdown_connections 2024-05-11T01:01:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.722+0000 7f056a875640 1 -- 172.21.15.16:0/1410513341 wait complete. 2024-05-11T01:01:55.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.723+0000 7f056a875640 1 Processor -- start 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.723+0000 7f056a875640 1 -- start start 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f056a875640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05640b6d70 0x7f0564151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f056a875640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05640bac10 0x7f05640b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f056a875640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05640d3ec0 0x7f05640b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f056a875640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f056415f830 con 0x7f05640b6d70 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f056a875640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0564163bb0 con 0x7f05640bac10 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f056a875640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0564162fc0 con 0x7f05640d3ec0 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05640b6d70 0x7f0564151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05640b6d70 0x7f0564151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52092/0 (socket says 172.21.15.16:52092) 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 -- 172.21.15.16:0/4097878261 learned_addr learned my addr 172.21.15.16:0/4097878261 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 -- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05640d3ec0 msgr2=0x7f05640b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05640d3ec0 0x7f05640b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 -- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05640bac10 msgr2=0x7f05640b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05640bac10 0x7f05640b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 -- 172.21.15.16:0/4097878261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05640ba0e0 con 0x7f05640b6d70 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0563fff640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05640b6d70 0x7f0564151300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f055400c490 tx=0x7f055400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0560ff9640 1 -- 172.21.15.16:0/4097878261 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540052d0 con 0x7f05640b6d70 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0560ff9640 1 -- 172.21.15.16:0/4097878261 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0554005490 con 0x7f05640b6d70 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05640cc4f0 con 0x7f05640b6d70 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.724+0000 7f0560ff9640 1 -- 172.21.15.16:0/4097878261 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554012870 con 0x7f05640b6d70 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.725+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05640cca70 con 0x7f05640b6d70 2024-05-11T01:01:55.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.725+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056406a5b0 con 0x7f05640b6d70 2024-05-11T01:01:55.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.726+0000 7f0560ff9640 1 -- 172.21.15.16:0/4097878261 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0554012a10 con 0x7f05640b6d70 2024-05-11T01:01:55.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.726+0000 7f0560ff9640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f05500762d0 0x7f0550078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:55.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.727+0000 7f0560ff9640 1 -- 172.21.15.16:0/4097878261 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f05540971c0 con 0x7f05640b6d70 2024-05-11T01:01:55.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.727+0000 7f05637fe640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f05500762d0 0x7f0550078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:55.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.727+0000 7f05637fe640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f05500762d0 0x7f0550078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0558034000 tx=0x7f055802c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:55.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.731+0000 7f0560ff9640 1 -- 172.21.15.16:0/4097878261 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0554060bb0 con 0x7f05640b6d70 2024-05-11T01:01:55.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.918+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05640d02d0 con 0x7f05500762d0 2024-05-11T01:01:55.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.924+0000 7f0560ff9640 1 -- 172.21.15.16:0/4097878261 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f05640d02d0 con 0x7f05500762d0 2024-05-11T01:01:55.927 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:55.928 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:01:55.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f05500762d0 msgr2=0x7f0550078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f05500762d0 0x7f0550078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0558034000 tx=0x7f055802c000 comp rx=0 tx=0).stop 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05640b6d70 msgr2=0x7f0564151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05640b6d70 0x7f0564151300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f055400c490 tx=0x7f055400c950 comp rx=0 tx=0).stop 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 shutdown_connections 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f05500762d0 0x7f0550078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f05640d3ec0 0x7f05640b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f05640bac10 0x7f05640b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 --2- 172.21.15.16:0/4097878261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05640b6d70 0x7f0564151300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 >> 172.21.15.16:0/4097878261 conn(0x7f0564074140 msgr2=0x7f056415e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 shutdown_connections 2024-05-11T01:01:55.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:55.927+0000 7f056a875640 1 -- 172.21.15.16:0/4097878261 wait complete. 2024-05-11T01:01:55.938 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-05-11T01:01:55.766181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236792,"kb_used_data":3944,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737928,"statfs":{"total":773094113280,"available":772851638272,"internally_reserved":0,"allocated":4038656,"data_stored":2258564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001218"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627052+0000","last_change":"2024-05-11T01:01:51.533236+0000","last_active":"2024-05-11T01:01:52.627052+0000","last_peered":"2024-05-11T01:01:52.627052+0000","last_clean":"2024-05-11T01:01:52.627052+0000","last_became_active":"2024-05-11T01:01:51.533008+0000","last_became_peered":"2024-05-11T01:01:51.533008+0000","last_unstale":"2024-05-11T01:01:52.627052+0000","last_undegraded":"2024-05-11T01:01:52.627052+0000","last_fullsized":"2024-05-11T01:01:52.627052+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:23:11.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627469+0000","last_change":"2024-05-11T01:01:51.545021+0000","last_active":"2024-05-11T01:01:52.627469+0000","last_peered":"2024-05-11T01:01:52.627469+0000","last_clean":"2024-05-11T01:01:52.627469+0000","last_became_active":"2024-05-11T01:01:51.544734+0000","last_became_peered":"2024-05-11T01:01:51.544734+0000","last_unstale":"2024-05-11T01:01:52.627469+0000","last_undegraded":"2024-05-11T01:01:52.627469+0000","last_fullsized":"2024-05-11T01:01:52.627469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:03:18.124412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627399+0000","last_change":"2024-05-11T01:01:51.534117+0000","last_active":"2024-05-11T01:01:52.627399+0000","last_peered":"2024-05-11T01:01:52.627399+0000","last_clean":"2024-05-11T01:01:52.627399+0000","last_became_active":"2024-05-11T01:01:51.533842+0000","last_became_peered":"2024-05-11T01:01:51.533842+0000","last_unstale":"2024-05-11T01:01:52.627399+0000","last_undegraded":"2024-05-11T01:01:52.627399+0000","last_fullsized":"2024-05-11T01:01:52.627399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:25:10.174005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626810+0000","last_change":"2024-05-11T01:01:51.537107+0000","last_active":"2024-05-11T01:01:52.626810+0000","last_peered":"2024-05-11T01:01:52.626810+0000","last_clean":"2024-05-11T01:01:52.626810+0000","last_became_active":"2024-05-11T01:01:51.536517+0000","last_became_peered":"2024-05-11T01:01:51.536517+0000","last_unstale":"2024-05-11T01:01:52.626810+0000","last_undegraded":"2024-05-11T01:01:52.626810+0000","last_fullsized":"2024-05-11T01:01:52.626810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:42:28.262888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626356+0000","last_change":"2024-05-11T01:01:51.545259+0000","last_active":"2024-05-11T01:01:52.626356+0000","last_peered":"2024-05-11T01:01:52.626356+0000","last_clean":"2024-05-11T01:01:52.626356+0000","last_became_active":"2024-05-11T01:01:51.544637+0000","last_became_peered":"2024-05-11T01:01:51.544637+0000","last_unstale":"2024-05-11T01:01:52.626356+0000","last_undegraded":"2024-05-11T01:01:52.626356+0000","last_fullsized":"2024-05-11T01:01:52.626356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:23:42.555408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627120+0000","last_change":"2024-05-11T01:01:51.540406+0000","last_active":"2024-05-11T01:01:52.627120+0000","last_peered":"2024-05-11T01:01:52.627120+0000","last_clean":"2024-05-11T01:01:52.627120+0000","last_became_active":"2024-05-11T01:01:51.540117+0000","last_became_peered":"2024-05-11T01:01:51.540117+0000","last_unstale":"2024-05-11T01:01:52.627120+0000","last_undegraded":"2024-05-11T01:01:52.627120+0000","last_fullsized":"2024-05-11T01:01:52.627120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:57:08.967224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517868+0000","last_change":"2024-05-11T01:01:51.527448+0000","last_active":"2024-05-11T01:01:52.517868+0000","last_peered":"2024-05-11T01:01:52.517868+0000","last_clean":"2024-05-11T01:01:52.517868+0000","last_became_active":"2024-05-11T01:01:51.527022+0000","last_became_peered":"2024-05-11T01:01:51.527022+0000","last_unstale":"2024-05-11T01:01:52.517868+0000","last_undegraded":"2024-05-11T01:01:52.517868+0000","last_fullsized":"2024-05-11T01:01:52.517868+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:25:10.174005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518108+0000","last_change":"2024-05-11T01:01:51.528750+0000","last_active":"2024-05-11T01:01:52.518108+0000","last_peered":"2024-05-11T01:01:52.518108+0000","last_clean":"2024-05-11T01:01:52.518108+0000","last_became_active":"2024-05-11T01:01:51.528502+0000","last_became_peered":"2024-05-11T01:01:51.528502+0000","last_unstale":"2024-05-11T01:01:52.518108+0000","last_undegraded":"2024-05-11T01:01:52.518108+0000","last_fullsized":"2024-05-11T01:01:52.518108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:57.178603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518054+0000","last_change":"2024-05-11T01:01:51.529403+0000","last_active":"2024-05-11T01:01:52.518054+0000","last_peered":"2024-05-11T01:01:52.518054+0000","last_clean":"2024-05-11T01:01:52.518054+0000","last_became_active":"2024-05-11T01:01:51.528253+0000","last_became_peered":"2024-05-11T01:01:51.528253+0000","last_unstale":"2024-05-11T01:01:52.518054+0000","last_undegraded":"2024-05-11T01:01:52.518054+0000","last_fullsized":"2024-05-11T01:01:52.518054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:31:14.625691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627415+0000","last_change":"2024-05-11T01:01:51.547033+0000","last_active":"2024-05-11T01:01:52.627415+0000","last_peered":"2024-05-11T01:01:52.627415+0000","last_clean":"2024-05-11T01:01:52.627415+0000","last_became_active":"2024-05-11T01:01:51.546724+0000","last_became_peered":"2024-05-11T01:01:51.546724+0000","last_unstale":"2024-05-11T01:01:52.627415+0000","last_undegraded":"2024-05-11T01:01:52.627415+0000","last_fullsized":"2024-05-11T01:01:52.627415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:11:45.149525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518176+0000","last_change":"2024-05-11T01:01:51.532606+0000","last_active":"2024-05-11T01:01:52.518176+0000","last_peered":"2024-05-11T01:01:52.518176+0000","last_clean":"2024-05-11T01:01:52.518176+0000","last_became_active":"2024-05-11T01:01:51.532345+0000","last_became_peered":"2024-05-11T01:01:51.532345+0000","last_unstale":"2024-05-11T01:01:52.518176+0000","last_undegraded":"2024-05-11T01:01:52.518176+0000","last_fullsized":"2024-05-11T01:01:52.518176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:28:08.188980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627320+0000","last_change":"2024-05-11T01:01:51.539935+0000","last_active":"2024-05-11T01:01:52.627320+0000","last_peered":"2024-05-11T01:01:52.627320+0000","last_clean":"2024-05-11T01:01:52.627320+0000","last_became_active":"2024-05-11T01:01:51.539660+0000","last_became_peered":"2024-05-11T01:01:51.539660+0000","last_unstale":"2024-05-11T01:01:52.627320+0000","last_undegraded":"2024-05-11T01:01:52.627320+0000","last_fullsized":"2024-05-11T01:01:52.627320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:03:18.124412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626497+0000","last_change":"2024-05-11T01:01:51.532481+0000","last_active":"2024-05-11T01:01:52.626497+0000","last_peered":"2024-05-11T01:01:52.626497+0000","last_clean":"2024-05-11T01:01:52.626497+0000","last_became_active":"2024-05-11T01:01:51.531681+0000","last_became_peered":"2024-05-11T01:01:51.531681+0000","last_unstale":"2024-05-11T01:01:52.626497+0000","last_undegraded":"2024-05-11T01:01:52.626497+0000","last_fullsized":"2024-05-11T01:01:52.626497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:04:48.520790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627265+0000","last_change":"2024-05-11T01:01:51.537283+0000","last_active":"2024-05-11T01:01:52.627265+0000","last_peered":"2024-05-11T01:01:52.627265+0000","last_clean":"2024-05-11T01:01:52.627265+0000","last_became_active":"2024-05-11T01:01:51.537026+0000","last_became_peered":"2024-05-11T01:01:51.537026+0000","last_unstale":"2024-05-11T01:01:52.627265+0000","last_undegraded":"2024-05-11T01:01:52.627265+0000","last_fullsized":"2024-05-11T01:01:52.627265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:28.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627233+0000","last_change":"2024-05-11T01:01:51.530516+0000","last_active":"2024-05-11T01:01:52.627233+0000","last_peered":"2024-05-11T01:01:52.627233+0000","last_clean":"2024-05-11T01:01:52.627233+0000","last_became_active":"2024-05-11T01:01:51.530153+0000","last_became_peered":"2024-05-11T01:01:51.530153+0000","last_unstale":"2024-05-11T01:01:52.627233+0000","last_undegraded":"2024-05-11T01:01:52.627233+0000","last_fullsized":"2024-05-11T01:01:52.627233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:28.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518328+0000","last_change":"2024-05-11T01:01:51.542113+0000","last_active":"2024-05-11T01:01:52.518328+0000","last_peered":"2024-05-11T01:01:52.518328+0000","last_clean":"2024-05-11T01:01:52.518328+0000","last_became_active":"2024-05-11T01:01:51.541795+0000","last_became_peered":"2024-05-11T01:01:51.541795+0000","last_unstale":"2024-05-11T01:01:52.518328+0000","last_undegraded":"2024-05-11T01:01:52.518328+0000","last_fullsized":"2024-05-11T01:01:52.518328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:31:04.808808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517564+0000","last_change":"2024-05-11T01:01:51.527691+0000","last_active":"2024-05-11T01:01:52.517564+0000","last_peered":"2024-05-11T01:01:52.517564+0000","last_clean":"2024-05-11T01:01:52.517564+0000","last_became_active":"2024-05-11T01:01:51.527433+0000","last_became_peered":"2024-05-11T01:01:51.527433+0000","last_unstale":"2024-05-11T01:01:52.517564+0000","last_undegraded":"2024-05-11T01:01:52.517564+0000","last_fullsized":"2024-05-11T01:01:52.517564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:54:08.582356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627628+0000","last_change":"2024-05-11T01:01:51.544238+0000","last_active":"2024-05-11T01:01:52.627628+0000","last_peered":"2024-05-11T01:01:52.627628+0000","last_clean":"2024-05-11T01:01:52.627628+0000","last_became_active":"2024-05-11T01:01:51.543918+0000","last_became_peered":"2024-05-11T01:01:51.543918+0000","last_unstale":"2024-05-11T01:01:52.627628+0000","last_undegraded":"2024-05-11T01:01:52.627628+0000","last_fullsized":"2024-05-11T01:01:52.627628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:26:47.692082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627804+0000","last_change":"2024-05-11T01:01:51.541432+0000","last_active":"2024-05-11T01:01:52.627804+0000","last_peered":"2024-05-11T01:01:52.627804+0000","last_clean":"2024-05-11T01:01:52.627804+0000","last_became_active":"2024-05-11T01:01:51.541153+0000","last_became_peered":"2024-05-11T01:01:51.541153+0000","last_unstale":"2024-05-11T01:01:52.627804+0000","last_undegraded":"2024-05-11T01:01:52.627804+0000","last_fullsized":"2024-05-11T01:01:52.627804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:17:47.861045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626933+0000","last_change":"2024-05-11T01:01:51.533879+0000","last_active":"2024-05-11T01:01:52.626933+0000","last_peered":"2024-05-11T01:01:52.626933+0000","last_clean":"2024-05-11T01:01:52.626933+0000","last_became_active":"2024-05-11T01:01:51.533591+0000","last_became_peered":"2024-05-11T01:01:51.533591+0000","last_unstale":"2024-05-11T01:01:52.626933+0000","last_undegraded":"2024-05-11T01:01:52.626933+0000","last_fullsized":"2024-05-11T01:01:52.626933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:22:41.799674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517226+0000","last_change":"2024-05-11T01:01:51.525192+0000","last_active":"2024-05-11T01:01:52.517226+0000","last_peered":"2024-05-11T01:01:52.517226+0000","last_clean":"2024-05-11T01:01:52.517226+0000","last_became_active":"2024-05-11T01:01:51.524895+0000","last_became_peered":"2024-05-11T01:01:51.524895+0000","last_unstale":"2024-05-11T01:01:52.517226+0000","last_undegraded":"2024-05-11T01:01:52.517226+0000","last_fullsized":"2024-05-11T01:01:52.517226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:56:06.370045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517477+0000","last_change":"2024-05-11T01:01:51.539756+0000","last_active":"2024-05-11T01:01:52.517477+0000","last_peered":"2024-05-11T01:01:52.517477+0000","last_clean":"2024-05-11T01:01:52.517477+0000","last_became_active":"2024-05-11T01:01:51.539474+0000","last_became_peered":"2024-05-11T01:01:51.539474+0000","last_unstale":"2024-05-11T01:01:52.517477+0000","last_undegraded":"2024-05-11T01:01:52.517477+0000","last_fullsized":"2024-05-11T01:01:52.517477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:11:54.194932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.514998+0000","last_change":"2024-05-11T01:01:51.523326+0000","last_active":"2024-05-11T01:01:52.514998+0000","last_peered":"2024-05-11T01:01:52.514998+0000","last_clean":"2024-05-11T01:01:52.514998+0000","last_became_active":"2024-05-11T01:01:51.522915+0000","last_became_peered":"2024-05-11T01:01:51.522915+0000","last_unstale":"2024-05-11T01:01:52.514998+0000","last_undegraded":"2024-05-11T01:01:52.514998+0000","last_fullsized":"2024-05-11T01:01:52.514998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:23:11.258738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626624+0000","last_change":"2024-05-11T01:01:51.531090+0000","last_active":"2024-05-11T01:01:52.626624+0000","last_peered":"2024-05-11T01:01:52.626624+0000","last_clean":"2024-05-11T01:01:52.626624+0000","last_became_active":"2024-05-11T01:01:51.530820+0000","last_became_peered":"2024-05-11T01:01:51.530820+0000","last_unstale":"2024-05-11T01:01:52.626624+0000","last_undegraded":"2024-05-11T01:01:52.626624+0000","last_fullsized":"2024-05-11T01:01:52.626624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:56:31.176872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627738+0000","last_change":"2024-05-11T01:01:51.535623+0000","last_active":"2024-05-11T01:01:52.627738+0000","last_peered":"2024-05-11T01:01:52.627738+0000","last_clean":"2024-05-11T01:01:52.627738+0000","last_became_active":"2024-05-11T01:01:51.535357+0000","last_became_peered":"2024-05-11T01:01:51.535357+0000","last_unstale":"2024-05-11T01:01:52.627738+0000","last_undegraded":"2024-05-11T01:01:52.627738+0000","last_fullsized":"2024-05-11T01:01:52.627738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:32:39.307568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627710+0000","last_change":"2024-05-11T01:01:51.544249+0000","last_active":"2024-05-11T01:01:52.627710+0000","last_peered":"2024-05-11T01:01:52.627710+0000","last_clean":"2024-05-11T01:01:52.627710+0000","last_became_active":"2024-05-11T01:01:51.543955+0000","last_became_peered":"2024-05-11T01:01:51.543955+0000","last_unstale":"2024-05-11T01:01:52.627710+0000","last_undegraded":"2024-05-11T01:01:52.627710+0000","last_fullsized":"2024-05-11T01:01:52.627710+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:57.178603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627426+0000","last_change":"2024-05-11T01:01:51.532943+0000","last_active":"2024-05-11T01:01:52.627426+0000","last_peered":"2024-05-11T01:01:52.627426+0000","last_clean":"2024-05-11T01:01:52.627426+0000","last_became_active":"2024-05-11T01:01:51.532596+0000","last_became_peered":"2024-05-11T01:01:51.532596+0000","last_unstale":"2024-05-11T01:01:52.627426+0000","last_undegraded":"2024-05-11T01:01:52.627426+0000","last_fullsized":"2024-05-11T01:01:52.627426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:09:44.934151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627306+0000","last_change":"2024-05-11T01:01:51.531783+0000","last_active":"2024-05-11T01:01:52.627306+0000","last_peered":"2024-05-11T01:01:52.627306+0000","last_clean":"2024-05-11T01:01:52.627306+0000","last_became_active":"2024-05-11T01:01:51.531510+0000","last_became_peered":"2024-05-11T01:01:51.531510+0000","last_unstale":"2024-05-11T01:01:52.627306+0000","last_undegraded":"2024-05-11T01:01:52.627306+0000","last_fullsized":"2024-05-11T01:01:52.627306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:54:08.582356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517565+0000","last_change":"2024-05-11T01:01:51.544904+0000","last_active":"2024-05-11T01:01:52.517565+0000","last_peered":"2024-05-11T01:01:52.517565+0000","last_clean":"2024-05-11T01:01:52.517565+0000","last_became_active":"2024-05-11T01:01:51.544622+0000","last_became_peered":"2024-05-11T01:01:51.544622+0000","last_unstale":"2024-05-11T01:01:52.517565+0000","last_undegraded":"2024-05-11T01:01:52.517565+0000","last_fullsized":"2024-05-11T01:01:52.517565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:42:28.262888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.516949+0000","last_change":"2024-05-11T01:01:51.532261+0000","last_active":"2024-05-11T01:01:52.516949+0000","last_peered":"2024-05-11T01:01:52.516949+0000","last_clean":"2024-05-11T01:01:52.516949+0000","last_became_active":"2024-05-11T01:01:51.531949+0000","last_became_peered":"2024-05-11T01:01:51.531949+0000","last_unstale":"2024-05-11T01:01:52.516949+0000","last_undegraded":"2024-05-11T01:01:52.516949+0000","last_fullsized":"2024-05-11T01:01:52.516949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:57:08.967224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626838+0000","last_change":"2024-05-11T01:01:51.530596+0000","last_active":"2024-05-11T01:01:52.626838+0000","last_peered":"2024-05-11T01:01:52.626838+0000","last_clean":"2024-05-11T01:01:52.626838+0000","last_became_active":"2024-05-11T01:01:51.530299+0000","last_became_peered":"2024-05-11T01:01:51.530299+0000","last_unstale":"2024-05-11T01:01:52.626838+0000","last_undegraded":"2024-05-11T01:01:52.626838+0000","last_fullsized":"2024-05-11T01:01:52.626838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:59:37.953674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518154+0000","last_change":"2024-05-11T01:01:51.525593+0000","last_active":"2024-05-11T01:01:52.518154+0000","last_peered":"2024-05-11T01:01:52.518154+0000","last_clean":"2024-05-11T01:01:52.518154+0000","last_became_active":"2024-05-11T01:01:51.525300+0000","last_became_peered":"2024-05-11T01:01:51.525300+0000","last_unstale":"2024-05-11T01:01:52.518154+0000","last_undegraded":"2024-05-11T01:01:52.518154+0000","last_fullsized":"2024-05-11T01:01:52.518154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:17:47.861045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.515123+0000","last_change":"2024-05-11T01:01:51.523793+0000","last_active":"2024-05-11T01:01:52.515123+0000","last_peered":"2024-05-11T01:01:52.515123+0000","last_clean":"2024-05-11T01:01:52.515123+0000","last_became_active":"2024-05-11T01:01:51.523475+0000","last_became_peered":"2024-05-11T01:01:51.523475+0000","last_unstale":"2024-05-11T01:01:52.515123+0000","last_undegraded":"2024-05-11T01:01:52.515123+0000","last_fullsized":"2024-05-11T01:01:52.515123+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:39:09.510261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627157+0000","last_change":"2024-05-11T01:01:50.527854+0000","last_active":"2024-05-11T01:01:52.627157+0000","last_peered":"2024-05-11T01:01:52.627157+0000","last_clean":"2024-05-11T01:01:52.627157+0000","last_became_active":"2024-05-11T01:01:50.527525+0000","last_became_peered":"2024-05-11T01:01:50.527525+0000","last_unstale":"2024-05-11T01:01:52.627157+0000","last_undegraded":"2024-05-11T01:01:52.627157+0000","last_fullsized":"2024-05-11T01:01:52.627157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:04:47.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627081+0000","last_change":"2024-05-11T01:01:51.538015+0000","last_active":"2024-05-11T01:01:52.627081+0000","last_peered":"2024-05-11T01:01:52.627081+0000","last_clean":"2024-05-11T01:01:52.627081+0000","last_became_active":"2024-05-11T01:01:51.537108+0000","last_became_peered":"2024-05-11T01:01:51.537108+0000","last_unstale":"2024-05-11T01:01:52.627081+0000","last_undegraded":"2024-05-11T01:01:52.627081+0000","last_fullsized":"2024-05-11T01:01:52.627081+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:42:19.486739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.515107+0000","last_change":"2024-05-11T01:01:50.526722+0000","last_active":"2024-05-11T01:01:52.515107+0000","last_peered":"2024-05-11T01:01:52.515107+0000","last_clean":"2024-05-11T01:01:52.515107+0000","last_became_active":"2024-05-11T01:01:50.526384+0000","last_became_peered":"2024-05-11T01:01:50.526384+0000","last_unstale":"2024-05-11T01:01:52.515107+0000","last_undegraded":"2024-05-11T01:01:52.515107+0000","last_fullsized":"2024-05-11T01:01:52.515107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:15:06.451181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517748+0000","last_change":"2024-05-11T01:01:51.544513+0000","last_active":"2024-05-11T01:01:52.517748+0000","last_peered":"2024-05-11T01:01:52.517748+0000","last_clean":"2024-05-11T01:01:52.517748+0000","last_became_active":"2024-05-11T01:01:51.544249+0000","last_became_peered":"2024-05-11T01:01:51.544249+0000","last_unstale":"2024-05-11T01:01:52.517748+0000","last_undegraded":"2024-05-11T01:01:52.517748+0000","last_fullsized":"2024-05-11T01:01:52.517748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:22:30.799170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627908+0000","last_change":"2024-05-11T01:01:50.530975+0000","last_active":"2024-05-11T01:01:52.627908+0000","last_peered":"2024-05-11T01:01:52.627908+0000","last_clean":"2024-05-11T01:01:52.627908+0000","last_became_active":"2024-05-11T01:01:50.530675+0000","last_became_peered":"2024-05-11T01:01:50.530675+0000","last_unstale":"2024-05-11T01:01:52.627908+0000","last_undegraded":"2024-05-11T01:01:52.627908+0000","last_fullsized":"2024-05-11T01:01:52.627908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:32:18.777453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627431+0000","last_change":"2024-05-11T01:01:51.533754+0000","last_active":"2024-05-11T01:01:52.627431+0000","last_peered":"2024-05-11T01:01:52.627431+0000","last_clean":"2024-05-11T01:01:52.627431+0000","last_became_active":"2024-05-11T01:01:51.533231+0000","last_became_peered":"2024-05-11T01:01:51.533231+0000","last_unstale":"2024-05-11T01:01:52.627431+0000","last_undegraded":"2024-05-11T01:01:52.627431+0000","last_fullsized":"2024-05-11T01:01:52.627431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:51:23.761363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626932+0000","last_change":"2024-05-11T01:01:50.529020+0000","last_active":"2024-05-11T01:01:52.626932+0000","last_peered":"2024-05-11T01:01:52.626932+0000","last_clean":"2024-05-11T01:01:52.626932+0000","last_became_active":"2024-05-11T01:01:50.528655+0000","last_became_peered":"2024-05-11T01:01:50.528655+0000","last_unstale":"2024-05-11T01:01:52.626932+0000","last_undegraded":"2024-05-11T01:01:52.626932+0000","last_fullsized":"2024-05-11T01:01:52.626932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:31:06.390055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517007+0000","last_change":"2024-05-11T01:01:51.526242+0000","last_active":"2024-05-11T01:01:52.517007+0000","last_peered":"2024-05-11T01:01:52.517007+0000","last_clean":"2024-05-11T01:01:52.517007+0000","last_became_active":"2024-05-11T01:01:51.525959+0000","last_became_peered":"2024-05-11T01:01:51.525959+0000","last_unstale":"2024-05-11T01:01:52.517007+0000","last_undegraded":"2024-05-11T01:01:52.517007+0000","last_fullsized":"2024-05-11T01:01:52.517007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:28.769269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517827+0000","last_change":"2024-05-11T01:01:50.531649+0000","last_active":"2024-05-11T01:01:52.517827+0000","last_peered":"2024-05-11T01:01:52.517827+0000","last_clean":"2024-05-11T01:01:52.517827+0000","last_became_active":"2024-05-11T01:01:50.531450+0000","last_became_peered":"2024-05-11T01:01:50.531450+0000","last_unstale":"2024-05-11T01:01:52.517827+0000","last_undegraded":"2024-05-11T01:01:52.517827+0000","last_fullsized":"2024-05-11T01:01:52.517827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:16:24.040556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627103+0000","last_change":"2024-05-11T01:01:51.527037+0000","last_active":"2024-05-11T01:01:52.627103+0000","last_peered":"2024-05-11T01:01:52.627103+0000","last_clean":"2024-05-11T01:01:52.627103+0000","last_became_active":"2024-05-11T01:01:51.526741+0000","last_became_peered":"2024-05-11T01:01:51.526741+0000","last_unstale":"2024-05-11T01:01:52.627103+0000","last_undegraded":"2024-05-11T01:01:52.627103+0000","last_fullsized":"2024-05-11T01:01:52.627103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:57:08.967224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517598+0000","last_change":"2024-05-11T01:01:50.532897+0000","last_active":"2024-05-11T01:01:52.517598+0000","last_peered":"2024-05-11T01:01:52.517598+0000","last_clean":"2024-05-11T01:01:52.517598+0000","last_became_active":"2024-05-11T01:01:50.532611+0000","last_became_peered":"2024-05-11T01:01:50.532611+0000","last_unstale":"2024-05-11T01:01:52.517598+0000","last_undegraded":"2024-05-11T01:01:52.517598+0000","last_fullsized":"2024-05-11T01:01:52.517598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:56:08.426231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.516836+0000","last_change":"2024-05-11T01:01:51.527138+0000","last_active":"2024-05-11T01:01:52.516836+0000","last_peered":"2024-05-11T01:01:52.516836+0000","last_clean":"2024-05-11T01:01:52.516836+0000","last_became_active":"2024-05-11T01:01:51.526833+0000","last_became_peered":"2024-05-11T01:01:51.526833+0000","last_unstale":"2024-05-11T01:01:52.516836+0000","last_undegraded":"2024-05-11T01:01:52.516836+0000","last_fullsized":"2024-05-11T01:01:52.516836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:42:19.486739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627278+0000","last_change":"2024-05-11T01:01:50.524404+0000","last_active":"2024-05-11T01:01:52.627278+0000","last_peered":"2024-05-11T01:01:52.627278+0000","last_clean":"2024-05-11T01:01:52.627278+0000","last_became_active":"2024-05-11T01:01:50.524117+0000","last_became_peered":"2024-05-11T01:01:50.524117+0000","last_unstale":"2024-05-11T01:01:52.627278+0000","last_undegraded":"2024-05-11T01:01:52.627278+0000","last_fullsized":"2024-05-11T01:01:52.627278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:23:10.256340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626759+0000","last_change":"2024-05-11T01:01:51.534115+0000","last_active":"2024-05-11T01:01:52.626759+0000","last_peered":"2024-05-11T01:01:52.626759+0000","last_clean":"2024-05-11T01:01:52.626759+0000","last_became_active":"2024-05-11T01:01:51.533557+0000","last_became_peered":"2024-05-11T01:01:51.533557+0000","last_unstale":"2024-05-11T01:01:52.626759+0000","last_undegraded":"2024-05-11T01:01:52.626759+0000","last_fullsized":"2024-05-11T01:01:52.626759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:11:54.194932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.516826+0000","last_change":"2024-05-11T01:01:50.526037+0000","last_active":"2024-05-11T01:01:52.516826+0000","last_peered":"2024-05-11T01:01:52.516826+0000","last_clean":"2024-05-11T01:01:52.516826+0000","last_became_active":"2024-05-11T01:01:50.525103+0000","last_became_peered":"2024-05-11T01:01:50.525103+0000","last_unstale":"2024-05-11T01:01:52.516826+0000","last_undegraded":"2024-05-11T01:01:52.516826+0000","last_fullsized":"2024-05-11T01:01:52.516826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:01:38.965139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627556+0000","last_change":"2024-05-11T01:01:51.545441+0000","last_active":"2024-05-11T01:01:52.627556+0000","last_peered":"2024-05-11T01:01:52.627556+0000","last_clean":"2024-05-11T01:01:52.627556+0000","last_became_active":"2024-05-11T01:01:51.545159+0000","last_became_peered":"2024-05-11T01:01:51.545159+0000","last_unstale":"2024-05-11T01:01:52.627556+0000","last_undegraded":"2024-05-11T01:01:52.627556+0000","last_fullsized":"2024-05-11T01:01:52.627556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:57.178603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627672+0000","last_change":"2024-05-11T01:01:50.533123+0000","last_active":"2024-05-11T01:01:52.627672+0000","last_peered":"2024-05-11T01:01:52.627672+0000","last_clean":"2024-05-11T01:01:52.627672+0000","last_became_active":"2024-05-11T01:01:50.532773+0000","last_became_peered":"2024-05-11T01:01:50.532773+0000","last_unstale":"2024-05-11T01:01:52.627672+0000","last_undegraded":"2024-05-11T01:01:52.627672+0000","last_fullsized":"2024-05-11T01:01:52.627672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:40:40.894248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627582+0000","last_change":"2024-05-11T01:01:51.546913+0000","last_active":"2024-05-11T01:01:52.627582+0000","last_peered":"2024-05-11T01:01:52.627582+0000","last_clean":"2024-05-11T01:01:52.627582+0000","last_became_active":"2024-05-11T01:01:51.546270+0000","last_became_peered":"2024-05-11T01:01:51.546270+0000","last_unstale":"2024-05-11T01:01:52.627582+0000","last_undegraded":"2024-05-11T01:01:52.627582+0000","last_fullsized":"2024-05-11T01:01:52.627582+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:54:08.582356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.515177+0000","last_change":"2024-05-11T01:01:50.529135+0000","last_active":"2024-05-11T01:01:52.515177+0000","last_peered":"2024-05-11T01:01:52.515177+0000","last_clean":"2024-05-11T01:01:52.515177+0000","last_became_active":"2024-05-11T01:01:50.528876+0000","last_became_peered":"2024-05-11T01:01:50.528876+0000","last_unstale":"2024-05-11T01:01:52.515177+0000","last_undegraded":"2024-05-11T01:01:52.515177+0000","last_fullsized":"2024-05-11T01:01:52.515177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:47:59.425974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.628033+0000","last_change":"2024-05-11T01:01:51.544378+0000","last_active":"2024-05-11T01:01:52.628033+0000","last_peered":"2024-05-11T01:01:52.628033+0000","last_clean":"2024-05-11T01:01:52.628033+0000","last_became_active":"2024-05-11T01:01:51.543998+0000","last_became_peered":"2024-05-11T01:01:51.543998+0000","last_unstale":"2024-05-11T01:01:52.628033+0000","last_undegraded":"2024-05-11T01:01:52.628033+0000","last_fullsized":"2024-05-11T01:01:52.628033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:28:08.188980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627531+0000","last_change":"2024-05-11T01:01:50.526037+0000","last_active":"2024-05-11T01:01:52.627531+0000","last_peered":"2024-05-11T01:01:52.627531+0000","last_clean":"2024-05-11T01:01:52.627531+0000","last_became_active":"2024-05-11T01:01:50.525782+0000","last_became_peered":"2024-05-11T01:01:50.525782+0000","last_unstale":"2024-05-11T01:01:52.627531+0000","last_undegraded":"2024-05-11T01:01:52.627531+0000","last_fullsized":"2024-05-11T01:01:52.627531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:39:08.507864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627399+0000","last_change":"2024-05-11T01:01:51.535047+0000","last_active":"2024-05-11T01:01:52.627399+0000","last_peered":"2024-05-11T01:01:52.627399+0000","last_clean":"2024-05-11T01:01:52.627399+0000","last_became_active":"2024-05-11T01:01:51.534714+0000","last_became_peered":"2024-05-11T01:01:51.534714+0000","last_unstale":"2024-05-11T01:01:52.627399+0000","last_undegraded":"2024-05-11T01:01:52.627399+0000","last_fullsized":"2024-05-11T01:01:52.627399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:26:47.692082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.628052+0000","last_change":"2024-05-11T01:01:50.532332+0000","last_active":"2024-05-11T01:01:52.628052+0000","last_peered":"2024-05-11T01:01:52.628052+0000","last_clean":"2024-05-11T01:01:52.628052+0000","last_became_active":"2024-05-11T01:01:50.532041+0000","last_became_peered":"2024-05-11T01:01:50.532041+0000","last_unstale":"2024-05-11T01:01:52.628052+0000","last_undegraded":"2024-05-11T01:01:52.628052+0000","last_fullsized":"2024-05-11T01:01:52.628052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:39:08.507864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626838+0000","last_change":"2024-05-11T01:01:51.534292+0000","last_active":"2024-05-11T01:01:52.626838+0000","last_peered":"2024-05-11T01:01:52.626838+0000","last_clean":"2024-05-11T01:01:52.626838+0000","last_became_active":"2024-05-11T01:01:51.533958+0000","last_became_peered":"2024-05-11T01:01:51.533958+0000","last_unstale":"2024-05-11T01:01:52.626838+0000","last_undegraded":"2024-05-11T01:01:52.626838+0000","last_fullsized":"2024-05-11T01:01:52.626838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:22:30.799170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517757+0000","last_change":"2024-05-11T01:01:50.528152+0000","last_active":"2024-05-11T01:01:52.517757+0000","last_peered":"2024-05-11T01:01:52.517757+0000","last_clean":"2024-05-11T01:01:52.517757+0000","last_became_active":"2024-05-11T01:01:50.527856+0000","last_became_peered":"2024-05-11T01:01:50.527856+0000","last_unstale":"2024-05-11T01:01:52.517757+0000","last_undegraded":"2024-05-11T01:01:52.517757+0000","last_fullsized":"2024-05-11T01:01:52.517757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:04:47.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627636+0000","last_change":"2024-05-11T01:01:51.536167+0000","last_active":"2024-05-11T01:01:52.627636+0000","last_peered":"2024-05-11T01:01:52.627636+0000","last_clean":"2024-05-11T01:01:52.627636+0000","last_became_active":"2024-05-11T01:01:51.535909+0000","last_became_peered":"2024-05-11T01:01:51.535909+0000","last_unstale":"2024-05-11T01:01:52.627636+0000","last_undegraded":"2024-05-11T01:01:52.627636+0000","last_fullsized":"2024-05-11T01:01:52.627636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:25:10.174005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626984+0000","last_change":"2024-05-11T01:01:50.533648+0000","last_active":"2024-05-11T01:01:52.626984+0000","last_peered":"2024-05-11T01:01:52.626984+0000","last_clean":"2024-05-11T01:01:52.626984+0000","last_became_active":"2024-05-11T01:01:50.533336+0000","last_became_peered":"2024-05-11T01:01:50.533336+0000","last_unstale":"2024-05-11T01:01:52.626984+0000","last_undegraded":"2024-05-11T01:01:52.626984+0000","last_fullsized":"2024-05-11T01:01:52.626984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:22:40.797276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518231+0000","last_change":"2024-05-11T01:01:51.526860+0000","last_active":"2024-05-11T01:01:52.518231+0000","last_peered":"2024-05-11T01:01:52.518231+0000","last_clean":"2024-05-11T01:01:52.518231+0000","last_became_active":"2024-05-11T01:01:51.526599+0000","last_became_peered":"2024-05-11T01:01:51.526599+0000","last_unstale":"2024-05-11T01:01:52.518231+0000","last_undegraded":"2024-05-11T01:01:52.518231+0000","last_fullsized":"2024-05-11T01:01:52.518231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:58:31.715741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627371+0000","last_change":"2024-05-11T01:01:50.532512+0000","last_active":"2024-05-11T01:01:52.627371+0000","last_peered":"2024-05-11T01:01:52.627371+0000","last_clean":"2024-05-11T01:01:52.627371+0000","last_became_active":"2024-05-11T01:01:50.532201+0000","last_became_peered":"2024-05-11T01:01:50.532201+0000","last_unstale":"2024-05-11T01:01:52.627371+0000","last_undegraded":"2024-05-11T01:01:52.627371+0000","last_fullsized":"2024-05-11T01:01:52.627371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:42:18.484341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626861+0000","last_change":"2024-05-11T01:01:51.527459+0000","last_active":"2024-05-11T01:01:52.626861+0000","last_peered":"2024-05-11T01:01:52.626861+0000","last_clean":"2024-05-11T01:01:52.626861+0000","last_became_active":"2024-05-11T01:01:51.527178+0000","last_became_peered":"2024-05-11T01:01:51.527178+0000","last_unstale":"2024-05-11T01:01:52.626861+0000","last_undegraded":"2024-05-11T01:01:52.626861+0000","last_fullsized":"2024-05-11T01:01:52.626861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:32:19.779851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626564+0000","last_change":"2024-05-11T01:01:50.532996+0000","last_active":"2024-05-11T01:01:52.626564+0000","last_peered":"2024-05-11T01:01:52.626564+0000","last_clean":"2024-05-11T01:01:52.626564+0000","last_became_active":"2024-05-11T01:01:50.531591+0000","last_became_peered":"2024-05-11T01:01:50.531591+0000","last_unstale":"2024-05-11T01:01:52.626564+0000","last_undegraded":"2024-05-11T01:01:52.626564+0000","last_fullsized":"2024-05-11T01:01:52.626564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:25.217148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517451+0000","last_change":"2024-05-11T01:01:51.530736+0000","last_active":"2024-05-11T01:01:52.517451+0000","last_peered":"2024-05-11T01:01:52.517451+0000","last_clean":"2024-05-11T01:01:52.517451+0000","last_became_active":"2024-05-11T01:01:51.530475+0000","last_became_peered":"2024-05-11T01:01:51.530475+0000","last_unstale":"2024-05-11T01:01:52.517451+0000","last_undegraded":"2024-05-11T01:01:52.517451+0000","last_fullsized":"2024-05-11T01:01:52.517451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:38:55.693322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627942+0000","last_change":"2024-05-11T01:01:50.534157+0000","last_active":"2024-05-11T01:01:52.627942+0000","last_peered":"2024-05-11T01:01:52.627942+0000","last_clean":"2024-05-11T01:01:52.627942+0000","last_became_active":"2024-05-11T01:01:50.533680+0000","last_became_peered":"2024-05-11T01:01:50.533680+0000","last_unstale":"2024-05-11T01:01:52.627942+0000","last_undegraded":"2024-05-11T01:01:52.627942+0000","last_fullsized":"2024-05-11T01:01:52.627942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:15:06.451181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627689+0000","last_change":"2024-05-11T01:01:51.536157+0000","last_active":"2024-05-11T01:01:52.627689+0000","last_peered":"2024-05-11T01:01:52.627689+0000","last_clean":"2024-05-11T01:01:52.627689+0000","last_became_active":"2024-05-11T01:01:51.535919+0000","last_became_peered":"2024-05-11T01:01:51.535919+0000","last_unstale":"2024-05-11T01:01:52.627689+0000","last_undegraded":"2024-05-11T01:01:52.627689+0000","last_fullsized":"2024-05-11T01:01:52.627689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:28:08.188980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517557+0000","last_change":"2024-05-11T01:01:50.525769+0000","last_active":"2024-05-11T01:01:52.517557+0000","last_peered":"2024-05-11T01:01:52.517557+0000","last_clean":"2024-05-11T01:01:52.517557+0000","last_became_active":"2024-05-11T01:01:50.525380+0000","last_became_peered":"2024-05-11T01:01:50.525380+0000","last_unstale":"2024-05-11T01:01:52.517557+0000","last_undegraded":"2024-05-11T01:01:52.517557+0000","last_fullsized":"2024-05-11T01:01:52.517557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:08:36.450977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626955+0000","last_change":"2024-05-11T01:01:51.536855+0000","last_active":"2024-05-11T01:01:52.626955+0000","last_peered":"2024-05-11T01:01:52.626955+0000","last_clean":"2024-05-11T01:01:52.626955+0000","last_became_active":"2024-05-11T01:01:51.536380+0000","last_became_peered":"2024-05-11T01:01:51.536380+0000","last_unstale":"2024-05-11T01:01:52.626955+0000","last_undegraded":"2024-05-11T01:01:52.626955+0000","last_fullsized":"2024-05-11T01:01:52.626955+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:31:14.625691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518076+0000","last_change":"2024-05-11T01:01:50.524366+0000","last_active":"2024-05-11T01:01:52.518076+0000","last_peered":"2024-05-11T01:01:52.518076+0000","last_clean":"2024-05-11T01:01:52.518076+0000","last_became_active":"2024-05-11T01:01:50.524073+0000","last_became_peered":"2024-05-11T01:01:50.524073+0000","last_unstale":"2024-05-11T01:01:52.518076+0000","last_undegraded":"2024-05-11T01:01:52.518076+0000","last_fullsized":"2024-05-11T01:01:52.518076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:51:38.099684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626466+0000","last_change":"2024-05-11T01:01:51.529156+0000","last_active":"2024-05-11T01:01:52.626466+0000","last_peered":"2024-05-11T01:01:52.626466+0000","last_clean":"2024-05-11T01:01:52.626466+0000","last_became_active":"2024-05-11T01:01:51.528814+0000","last_became_peered":"2024-05-11T01:01:51.528814+0000","last_unstale":"2024-05-11T01:01:52.626466+0000","last_undegraded":"2024-05-11T01:01:52.626466+0000","last_fullsized":"2024-05-11T01:01:52.626466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:52:50.674777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517670+0000","last_change":"2024-05-11T01:01:50.531771+0000","last_active":"2024-05-11T01:01:52.517670+0000","last_peered":"2024-05-11T01:01:52.517670+0000","last_clean":"2024-05-11T01:01:52.517670+0000","last_became_active":"2024-05-11T01:01:50.531494+0000","last_became_peered":"2024-05-11T01:01:50.531494+0000","last_unstale":"2024-05-11T01:01:52.517670+0000","last_undegraded":"2024-05-11T01:01:52.517670+0000","last_fullsized":"2024-05-11T01:01:52.517670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:58:49.118550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626772+0000","last_change":"2024-05-11T01:01:51.525866+0000","last_active":"2024-05-11T01:01:52.626772+0000","last_peered":"2024-05-11T01:01:52.626772+0000","last_clean":"2024-05-11T01:01:52.626772+0000","last_became_active":"2024-05-11T01:01:51.525410+0000","last_became_peered":"2024-05-11T01:01:51.525410+0000","last_unstale":"2024-05-11T01:01:52.626772+0000","last_undegraded":"2024-05-11T01:01:52.626772+0000","last_fullsized":"2024-05-11T01:01:52.626772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:48:00.428372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.515226+0000","last_change":"2024-05-11T01:01:50.527950+0000","last_active":"2024-05-11T01:01:52.515226+0000","last_peered":"2024-05-11T01:01:52.515226+0000","last_clean":"2024-05-11T01:01:52.515226+0000","last_became_active":"2024-05-11T01:01:50.527673+0000","last_became_peered":"2024-05-11T01:01:50.527673+0000","last_unstale":"2024-05-11T01:01:52.515226+0000","last_undegraded":"2024-05-11T01:01:52.515226+0000","last_fullsized":"2024-05-11T01:01:52.515226+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:04:47.518393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626627+0000","last_change":"2024-05-11T01:01:51.525924+0000","last_active":"2024-05-11T01:01:52.626627+0000","last_peered":"2024-05-11T01:01:52.626627+0000","last_clean":"2024-05-11T01:01:52.626627+0000","last_became_active":"2024-05-11T01:01:51.525510+0000","last_became_peered":"2024-05-11T01:01:51.525510+0000","last_unstale":"2024-05-11T01:01:52.626627+0000","last_undegraded":"2024-05-11T01:01:52.626627+0000","last_fullsized":"2024-05-11T01:01:52.626627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:15:07.453578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626913+0000","last_change":"2024-05-11T01:01:50.529260+0000","last_active":"2024-05-11T01:01:52.626913+0000","last_peered":"2024-05-11T01:01:52.626913+0000","last_clean":"2024-05-11T01:01:52.626913+0000","last_became_active":"2024-05-11T01:01:50.528975+0000","last_became_peered":"2024-05-11T01:01:50.528975+0000","last_unstale":"2024-05-11T01:01:52.626913+0000","last_undegraded":"2024-05-11T01:01:52.626913+0000","last_fullsized":"2024-05-11T01:01:52.626913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:52:49.672380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626408+0000","last_change":"2024-05-11T01:01:51.525755+0000","last_active":"2024-05-11T01:01:52.626408+0000","last_peered":"2024-05-11T01:01:52.626408+0000","last_clean":"2024-05-11T01:01:52.626408+0000","last_became_active":"2024-05-11T01:01:51.525457+0000","last_became_peered":"2024-05-11T01:01:51.525457+0000","last_unstale":"2024-05-11T01:01:52.626408+0000","last_undegraded":"2024-05-11T01:01:52.626408+0000","last_fullsized":"2024-05-11T01:01:52.626408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:51:39.102082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.516966+0000","last_change":"2024-05-11T01:01:50.531426+0000","last_active":"2024-05-11T01:01:52.516966+0000","last_peered":"2024-05-11T01:01:52.516966+0000","last_clean":"2024-05-11T01:01:52.516966+0000","last_became_active":"2024-05-11T01:01:50.531203+0000","last_became_peered":"2024-05-11T01:01:50.531203+0000","last_unstale":"2024-05-11T01:01:52.516966+0000","last_undegraded":"2024-05-11T01:01:52.516966+0000","last_fullsized":"2024-05-11T01:01:52.516966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:52:49.672380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517381+0000","last_change":"2024-05-11T01:01:51.528330+0000","last_active":"2024-05-11T01:01:52.517381+0000","last_peered":"2024-05-11T01:01:52.517381+0000","last_clean":"2024-05-11T01:01:52.517381+0000","last_became_active":"2024-05-11T01:01:51.528059+0000","last_became_peered":"2024-05-11T01:01:51.528059+0000","last_unstale":"2024-05-11T01:01:52.517381+0000","last_undegraded":"2024-05-11T01:01:52.517381+0000","last_fullsized":"2024-05-11T01:01:52.517381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:03:18.124412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626728+0000","last_change":"2024-05-11T01:01:50.526171+0000","last_active":"2024-05-11T01:01:52.626728+0000","last_peered":"2024-05-11T01:01:52.626728+0000","last_clean":"2024-05-11T01:01:52.626728+0000","last_became_active":"2024-05-11T01:01:50.525752+0000","last_became_peered":"2024-05-11T01:01:50.525752+0000","last_unstale":"2024-05-11T01:01:52.626728+0000","last_undegraded":"2024-05-11T01:01:52.626728+0000","last_fullsized":"2024-05-11T01:01:52.626728+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:42:18.484341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626548+0000","last_change":"2024-05-11T01:01:51.532180+0000","last_active":"2024-05-11T01:01:52.626548+0000","last_peered":"2024-05-11T01:01:52.626548+0000","last_clean":"2024-05-11T01:01:52.626548+0000","last_became_active":"2024-05-11T01:01:51.531896+0000","last_became_peered":"2024-05-11T01:01:51.531896+0000","last_unstale":"2024-05-11T01:01:52.626548+0000","last_undegraded":"2024-05-11T01:01:52.626548+0000","last_fullsized":"2024-05-11T01:01:52.626548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:16:25.042953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.628058+0000","last_change":"2024-05-11T01:01:50.534740+0000","last_active":"2024-05-11T01:01:52.628058+0000","last_peered":"2024-05-11T01:01:52.628058+0000","last_clean":"2024-05-11T01:01:52.628058+0000","last_became_active":"2024-05-11T01:01:50.534465+0000","last_became_peered":"2024-05-11T01:01:50.534465+0000","last_unstale":"2024-05-11T01:01:52.628058+0000","last_undegraded":"2024-05-11T01:01:52.628058+0000","last_fullsized":"2024-05-11T01:01:52.628058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:47:59.425974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627677+0000","last_change":"2024-05-11T01:01:51.535358+0000","last_active":"2024-05-11T01:01:52.627677+0000","last_peered":"2024-05-11T01:01:52.627677+0000","last_clean":"2024-05-11T01:01:52.627677+0000","last_became_active":"2024-05-11T01:01:51.534891+0000","last_became_peered":"2024-05-11T01:01:51.534891+0000","last_unstale":"2024-05-11T01:01:52.627677+0000","last_undegraded":"2024-05-11T01:01:52.627677+0000","last_fullsized":"2024-05-11T01:01:52.627677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:17:47.861045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:53.520474+0000","last_change":"2024-05-11T01:01:50.527999+0000","last_active":"2024-05-11T01:01:53.520474+0000","last_peered":"2024-05-11T01:01:53.520474+0000","last_clean":"2024-05-11T01:01:53.520474+0000","last_became_active":"2024-05-11T01:01:50.527723+0000","last_became_peered":"2024-05-11T01:01:50.527723+0000","last_unstale":"2024-05-11T01:01:53.520474+0000","last_undegraded":"2024-05-11T01:01:53.520474+0000","last_fullsized":"2024-05-11T01:01:53.520474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:22:40.797276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.515092+0000","last_change":"2024-05-11T01:01:51.524601+0000","last_active":"2024-05-11T01:01:52.515092+0000","last_peered":"2024-05-11T01:01:52.515092+0000","last_clean":"2024-05-11T01:01:52.515092+0000","last_became_active":"2024-05-11T01:01:51.524318+0000","last_became_peered":"2024-05-11T01:01:51.524318+0000","last_unstale":"2024-05-11T01:01:52.515092+0000","last_undegraded":"2024-05-11T01:01:52.515092+0000","last_fullsized":"2024-05-11T01:01:52.515092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:42:19.486739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627137+0000","last_change":"2024-05-11T01:01:50.529122+0000","last_active":"2024-05-11T01:01:52.627137+0000","last_peered":"2024-05-11T01:01:52.627137+0000","last_clean":"2024-05-11T01:01:52.627137+0000","last_became_active":"2024-05-11T01:01:50.528735+0000","last_became_peered":"2024-05-11T01:01:50.528735+0000","last_unstale":"2024-05-11T01:01:52.627137+0000","last_undegraded":"2024-05-11T01:01:52.627137+0000","last_fullsized":"2024-05-11T01:01:52.627137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:25.217148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626913+0000","last_change":"2024-05-11T01:01:51.530811+0000","last_active":"2024-05-11T01:01:52.626913+0000","last_peered":"2024-05-11T01:01:52.626913+0000","last_clean":"2024-05-11T01:01:52.626913+0000","last_became_active":"2024-05-11T01:01:51.530544+0000","last_became_peered":"2024-05-11T01:01:51.530544+0000","last_unstale":"2024-05-11T01:01:52.626913+0000","last_undegraded":"2024-05-11T01:01:52.626913+0000","last_fullsized":"2024-05-11T01:01:52.626913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:40:41.896646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.515318+0000","last_change":"2024-05-11T01:01:50.526068+0000","last_active":"2024-05-11T01:01:52.515318+0000","last_peered":"2024-05-11T01:01:52.515318+0000","last_clean":"2024-05-11T01:01:52.515318+0000","last_became_active":"2024-05-11T01:01:50.525570+0000","last_became_peered":"2024-05-11T01:01:50.525570+0000","last_unstale":"2024-05-11T01:01:52.515318+0000","last_undegraded":"2024-05-11T01:01:52.515318+0000","last_fullsized":"2024-05-11T01:01:52.515318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:16:24.040556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.515257+0000","last_change":"2024-05-11T01:01:51.531287+0000","last_active":"2024-05-11T01:01:52.515257+0000","last_peered":"2024-05-11T01:01:52.515257+0000","last_clean":"2024-05-11T01:01:52.515257+0000","last_became_active":"2024-05-11T01:01:51.531012+0000","last_became_peered":"2024-05-11T01:01:51.531012+0000","last_unstale":"2024-05-11T01:01:52.515257+0000","last_undegraded":"2024-05-11T01:01:52.515257+0000","last_fullsized":"2024-05-11T01:01:52.515257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:56:06.370045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.627058+0000","last_change":"2024-05-11T01:01:50.534723+0000","last_active":"2024-05-11T01:01:52.627058+0000","last_peered":"2024-05-11T01:01:52.627058+0000","last_clean":"2024-05-11T01:01:52.627058+0000","last_became_active":"2024-05-11T01:01:50.534320+0000","last_became_peered":"2024-05-11T01:01:50.534320+0000","last_unstale":"2024-05-11T01:01:52.627058+0000","last_undegraded":"2024-05-11T01:01:52.627058+0000","last_fullsized":"2024-05-11T01:01:52.627058+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:16:24.040556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626378+0000","last_change":"2024-05-11T01:01:51.541412+0000","last_active":"2024-05-11T01:01:52.626378+0000","last_peered":"2024-05-11T01:01:52.626378+0000","last_clean":"2024-05-11T01:01:52.626378+0000","last_became_active":"2024-05-11T01:01:51.541132+0000","last_became_peered":"2024-05-11T01:01:51.541132+0000","last_unstale":"2024-05-11T01:01:52.626378+0000","last_undegraded":"2024-05-11T01:01:52.626378+0000","last_fullsized":"2024-05-11T01:01:52.626378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:56:31.176872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517113+0000","last_change":"2024-05-11T01:01:50.528875+0000","last_active":"2024-05-11T01:01:52.517113+0000","last_peered":"2024-05-11T01:01:52.517113+0000","last_clean":"2024-05-11T01:01:52.517113+0000","last_became_active":"2024-05-11T01:01:50.528597+0000","last_became_peered":"2024-05-11T01:01:50.528597+0000","last_unstale":"2024-05-11T01:01:52.517113+0000","last_undegraded":"2024-05-11T01:01:52.517113+0000","last_fullsized":"2024-05-11T01:01:52.517113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:23:41.553010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.516864+0000","last_change":"2024-05-11T01:01:51.548797+0000","last_active":"2024-05-11T01:01:52.516864+0000","last_peered":"2024-05-11T01:01:52.516864+0000","last_clean":"2024-05-11T01:01:52.516864+0000","last_became_active":"2024-05-11T01:01:51.548594+0000","last_became_peered":"2024-05-11T01:01:51.548594+0000","last_unstale":"2024-05-11T01:01:52.516864+0000","last_undegraded":"2024-05-11T01:01:52.516864+0000","last_fullsized":"2024-05-11T01:01:52.516864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:39:09.510261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626655+0000","last_change":"2024-05-11T01:01:50.523713+0000","last_active":"2024-05-11T01:01:52.626655+0000","last_peered":"2024-05-11T01:01:52.626655+0000","last_clean":"2024-05-11T01:01:52.626655+0000","last_became_active":"2024-05-11T01:01:50.523407+0000","last_became_peered":"2024-05-11T01:01:50.523407+0000","last_unstale":"2024-05-11T01:01:52.626655+0000","last_undegraded":"2024-05-11T01:01:52.626655+0000","last_fullsized":"2024-05-11T01:01:52.626655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:59:36.951277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.517630+0000","last_change":"2024-05-11T01:01:51.529652+0000","last_active":"2024-05-11T01:01:52.517630+0000","last_peered":"2024-05-11T01:01:52.517630+0000","last_clean":"2024-05-11T01:01:52.517630+0000","last_became_active":"2024-05-11T01:01:51.529058+0000","last_became_peered":"2024-05-11T01:01:51.529058+0000","last_unstale":"2024-05-11T01:01:52.517630+0000","last_undegraded":"2024-05-11T01:01:52.517630+0000","last_fullsized":"2024-05-11T01:01:52.517630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:50.505815+0000","last_clean_scrub_stamp":"2024-05-11T01:01:50.505815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:26:47.692082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.626993+0000","last_change":"2024-05-11T01:01:50.526156+0000","last_active":"2024-05-11T01:01:52.626993+0000","last_peered":"2024-05-11T01:01:52.626993+0000","last_clean":"2024-05-11T01:01:52.626993+0000","last_became_active":"2024-05-11T01:01:50.525831+0000","last_became_peered":"2024-05-11T01:01:50.525831+0000","last_unstale":"2024-05-11T01:01:52.626993+0000","last_undegraded":"2024-05-11T01:01:52.626993+0000","last_fullsized":"2024-05-11T01:01:52.626993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:49.503418+0000","last_clean_scrub_stamp":"2024-05-11T01:01:49.503418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:51:38.099684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":132,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-11T01:01:52.518269+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:01:52.518269+0000","last_peered":"2024-05-11T01:01:52.518269+0000","last_clean":"2024-05-11T01:01:52.518269+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:01:52.518269+0000","last_undegraded":"2024-05-11T01:01:52.518269+0000","last_fullsized":"2024-05-11T01:01:52.518269+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":134230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":352256,"data_stored":134196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":364544,"data_stored":135760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":724494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:01:55.942 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-11T01:01:55.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-11T01:01:56.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.090+0000 7f9f780e1640 1 Processor -- start 2024-05-11T01:01:56.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.091+0000 7f9f780e1640 1 -- start start 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.091+0000 7f9f780e1640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9f700d23c0 0x7f9f700d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.091+0000 7f9f780e1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f700b8770 0x7f9f700b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.091+0000 7f9f780e1640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f700d2ce0 con 0x7f9f700d3f80 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.091+0000 7f9f780e1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9f700d0bb0 con 0x7f9f700b8770 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.091+0000 7f9f780e1640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f9f700d4410 con 0x7f9f700d23c0 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.091+0000 7f9f7667e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f700b8770 0x7f9f700b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.092+0000 7f9f7667e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f700b8770 0x7f9f700b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52102/0 (socket says 172.21.15.16:52102) 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.092+0000 7f9f7667e640 1 -- 172.21.15.16:0/798405736 learned_addr learned my addr 172.21.15.16:0/798405736 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.092+0000 7f9f75e7d640 1 --2- 172.21.15.16:0/798405736 >> v2:172.21.15.174:3300/0 conn(0x7f9f700d23c0 0x7f9f700d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.092+0000 7f9f7667e640 1 -- 172.21.15.16:0/798405736 >> v2:172.21.15.174:3300/0 conn(0x7f9f700d23c0 msgr2=0x7f9f700d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.092+0000 7f9f7667e640 1 --2- 172.21.15.16:0/798405736 >> v2:172.21.15.174:3300/0 conn(0x7f9f700d23c0 0x7f9f700d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.092+0000 7f9f7667e640 1 -- 172.21.15.16:0/798405736 >> v1:172.21.15.174:6789/0 conn(0x7f9f700d3f80 legacy=0x7f9f700d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.092+0000 7f9f7667e640 1 -- 172.21.15.16:0/798405736 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f700d46f0 con 0x7f9f700b8770 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f7667e640 1 --2- 172.21.15.16:0/798405736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700b8770 0x7f9f700b8ba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9f700d64d0 tx=0x7f9f6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfad44c7125e88f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f74e7b640 1 -- 172.21.15.16:0/798405736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68037070 con 0x7f9f700b8770 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f74e7b640 1 -- 172.21.15.16:0/798405736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f68032440 con 0x7f9f700b8770 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f74e7b640 1 -- 172.21.15.16:0/798405736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68032810 con 0x7f9f700b8770 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f780e1640 1 -- 172.21.15.16:0/798405736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700b8770 msgr2=0x7f9f700b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f780e1640 1 --2- 172.21.15.16:0/798405736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700b8770 0x7f9f700b8ba0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9f700d64d0 tx=0x7f9f6802a270 comp rx=0 tx=0).stop 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f780e1640 1 -- 172.21.15.16:0/798405736 shutdown_connections 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f780e1640 1 --2- 172.21.15.16:0/798405736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700b8770 0x7f9f700b8ba0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f780e1640 1 --2- 172.21.15.16:0/798405736 >> v2:172.21.15.174:3300/0 conn(0x7f9f700d23c0 0x7f9f700d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f780e1640 1 -- 172.21.15.16:0/798405736 >> 172.21.15.16:0/798405736 conn(0x7f9f70073f00 msgr2=0x7f9f70074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:56.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f780e1640 1 -- 172.21.15.16:0/798405736 shutdown_connections 2024-05-11T01:01:56.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.093+0000 7f9f780e1640 1 -- 172.21.15.16:0/798405736 wait complete. 2024-05-11T01:01:56.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.094+0000 7f9f780e1640 1 Processor -- start 2024-05-11T01:01:56.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.095+0000 7f9f780e1640 1 -- start start 2024-05-11T01:01:56.096 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-05-11T01:01:56.095+0000 7fe6b095b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-11T01:01:56.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.095+0000 7f9f780e1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f700b8770 0x7f9f700b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.095+0000 7f9f780e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f700d23c0 0x7f9f70156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.095+0000 7f9f780e1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700ba060 0x7f9f700ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.095+0000 7f9f780e1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9f700d4f90 con 0x7f9f700ba060 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.095+0000 7f9f780e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f700d4cb0 con 0x7f9f700d23c0 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.095+0000 7f9f780e1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7015f980 con 0x7f9f700b8770 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.095+0000 7f9f7667e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700ba060 0x7f9f700ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7667e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700ba060 0x7f9f700ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52112/0 (socket says 172.21.15.16:52112) 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7667e640 1 -- 172.21.15.16:0/3419212177 learned_addr learned my addr 172.21.15.16:0/3419212177 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7567c640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f700d23c0 0x7f9f70156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f75e7d640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f700b8770 0x7f9f700b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7667e640 1 -- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f700b8770 msgr2=0x7f9f700b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7667e640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f700b8770 0x7f9f700b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7667e640 1 -- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f700d23c0 msgr2=0x7f9f70156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7667e640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f700d23c0 0x7f9f70156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7667e640 1 -- 172.21.15.16:0/3419212177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f701f9ac0 con 0x7f9f700ba060 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f7667e640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700ba060 0x7f9f700ba4f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f680090b0 tx=0x7f9f680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f6e7fc640 1 -- 172.21.15.16:0/3419212177 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68041020 con 0x7f9f700ba060 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f6e7fc640 1 -- 172.21.15.16:0/3419212177 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6803d640 con 0x7f9f700ba060 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f6e7fc640 1 -- 172.21.15.16:0/3419212177 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68037040 con 0x7f9f700ba060 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f700b6b70 con 0x7f9f700ba060 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.096+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f700b7130 con 0x7f9f700ba060 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.097+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7006a5b0 con 0x7f9f700ba060 2024-05-11T01:01:56.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.098+0000 7f9f6e7fc640 1 -- 172.21.15.16:0/3419212177 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9f68044020 con 0x7f9f700ba060 2024-05-11T01:01:56.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.098+0000 7f9f6e7fc640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9f5c0762d0 0x7f9f5c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.098+0000 7f9f6e7fc640 1 -- 172.21.15.16:0/3419212177 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9f680b7c50 con 0x7f9f700ba060 2024-05-11T01:01:56.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.099+0000 7f9f75e7d640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9f5c0762d0 0x7f9f5c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.099+0000 7f9f75e7d640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9f5c0762d0 0x7f9f5c078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9f600113e0 tx=0x7f9f6000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:56.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.103+0000 7f9f6e7fc640 1 -- 172.21.15.16:0/3419212177 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9f680bd020 con 0x7f9f700ba060 2024-05-11T01:01:56.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.367+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9f700d0280 con 0x7f9f700ba060 2024-05-11T01:01:56.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.369+0000 7f9f6e7fc640 1 -- 172.21.15.16:0/3419212177 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f9f6804b030 con 0x7f9f700ba060 2024-05-11T01:01:56.369 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-05-11T01:01:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5mBE92NxAAwjJJ4BDqTpd7qQZiD1YlYA== 2024-05-11T01:01:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: caps mds = "allow" 2024-05-11T01:01:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: caps mon = "allow r" 2024-05-11T01:01:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-11T01:01:56.370 INFO:teuthology.orchestra.run.smithi016.stderr:updated caps for client.0 2024-05-11T01:01:56.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9f5c0762d0 msgr2=0x7f9f5c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9f5c0762d0 0x7f9f5c078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9f600113e0 tx=0x7f9f6000b040 comp rx=0 tx=0).stop 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700ba060 msgr2=0x7f9f700ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700ba060 0x7f9f700ba4f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f680090b0 tx=0x7f9f680046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 shutdown_connections 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9f5c0762d0 0x7f9f5c078790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f700ba060 0x7f9f700ba4f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f700d23c0 0x7f9f70156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 --2- 172.21.15.16:0/3419212177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9f700b8770 0x7f9f700b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 >> 172.21.15.16:0/3419212177 conn(0x7f9f70073f00 msgr2=0x7f9f70160530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 shutdown_connections 2024-05-11T01:01:56.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.371+0000 7f9f780e1640 1 -- 172.21.15.16:0/3419212177 wait complete. 2024-05-11T01:01:56.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:01:56.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.487+0000 7f168a324640 1 Processor -- start 2024-05-11T01:01:56.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.487+0000 7f168a324640 1 -- start start 2024-05-11T01:01:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f168a324640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1684145ae0 0x7f168415d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f168a324640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f16840b4040 0x7f16840b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f168a324640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16840b2cd0 0x7f16840b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f168a324640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f16840b3680 con 0x7f1684145ae0 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f168a324640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f168415ccc0 con 0x7f16840b4040 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f168a324640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f168415c6e0 con 0x7f16840b2cd0 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f1683fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1684145ae0 0x7f168415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f1683fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1684145ae0 0x7f168415d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52118/0 (socket says 172.21.15.16:52118) 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f1683fff640 1 -- 172.21.15.16:0/3081376216 learned_addr learned my addr 172.21.15.16:0/3081376216 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f16888c1640 1 --2- 172.21.15.16:0/3081376216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16840b2cd0 0x7f16840b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f167bfff640 1 --2- 172.21.15.16:0/3081376216 >> v2:172.21.15.174:3300/0 conn(0x7f16840b4040 0x7f16840b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f1683fff640 1 -- 172.21.15.16:0/3081376216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16840b2cd0 msgr2=0x7f16840b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f1683fff640 1 --2- 172.21.15.16:0/3081376216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16840b2cd0 0x7f16840b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f1683fff640 1 -- 172.21.15.16:0/3081376216 >> v2:172.21.15.174:3300/0 conn(0x7f16840b4040 msgr2=0x7f16840b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f1683fff640 1 --2- 172.21.15.16:0/3081376216 >> v2:172.21.15.174:3300/0 conn(0x7f16840b4040 0x7f16840b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f1683fff640 1 -- 172.21.15.16:0/3081376216 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1684145ec0 con 0x7f1684145ae0 2024-05-11T01:01:56.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.488+0000 7f167bfff640 1 --2- 172.21.15.16:0/3081376216 >> v2:172.21.15.174:3300/0 conn(0x7f16840b4040 0x7f16840b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:56.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.489+0000 7f1683fff640 1 --2- 172.21.15.16:0/3081376216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1684145ae0 0x7f168415d150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1684160e30 tx=0x7f167402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b89a8cd475ec63 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.489+0000 7f16837fe640 1 -- 172.21.15.16:0/3081376216 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674037070 con 0x7f1684145ae0 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.489+0000 7f16837fe640 1 -- 172.21.15.16:0/3081376216 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1674032440 con 0x7f1684145ae0 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.489+0000 7f16837fe640 1 -- 172.21.15.16:0/3081376216 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674032810 con 0x7f1684145ae0 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 -- 172.21.15.16:0/3081376216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1684145ae0 msgr2=0x7f168415d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 --2- 172.21.15.16:0/3081376216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1684145ae0 0x7f168415d150 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1684160e30 tx=0x7f167402a1e0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 -- 172.21.15.16:0/3081376216 shutdown_connections 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 --2- 172.21.15.16:0/3081376216 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f16840b2cd0 0x7f16840b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 --2- 172.21.15.16:0/3081376216 >> v2:172.21.15.174:3300/0 conn(0x7f16840b4040 0x7f16840b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 --2- 172.21.15.16:0/3081376216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1684145ae0 0x7f168415d150 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 -- 172.21.15.16:0/3081376216 >> 172.21.15.16:0/3081376216 conn(0x7f168406fd90 msgr2=0x7f168406c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 -- 172.21.15.16:0/3081376216 shutdown_connections 2024-05-11T01:01:56.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.490+0000 7f168a324640 1 -- 172.21.15.16:0/3081376216 wait complete. 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.491+0000 7f168a324640 1 Processor -- start 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.491+0000 7f168a324640 1 -- start start 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f168a324640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b2cd0 0x7f168415be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f168a324640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16840b4040 0x7f16840ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f168a324640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1684145ae0 0x7f16840cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f168a324640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f16840b4d70 con 0x7f16840b2cd0 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f168a324640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f16840b4a90 con 0x7f16840b4040 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f168a324640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f168415c950 con 0x7f1684145ae0 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b2cd0 0x7f168415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b2cd0 0x7f168415be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52120/0 (socket says 172.21.15.16:52120) 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 -- 172.21.15.16:0/1077194610 learned_addr learned my addr 172.21.15.16:0/1077194610 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f167bfff640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16840b4040 0x7f16840ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f16888c1640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1684145ae0 0x7f16840cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 -- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1684145ae0 msgr2=0x7f16840cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1684145ae0 0x7f16840cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 -- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16840b4040 msgr2=0x7f16840ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16840b4040 0x7f16840ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 -- 172.21.15.16:0/1077194610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168415c360 con 0x7f16840b2cd0 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f1683fff640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b2cd0 0x7f168415be20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f167402a220 tx=0x7f16740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f16817fa640 1 -- 172.21.15.16:0/1077194610 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674041020 con 0x7f16840b2cd0 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f16817fa640 1 -- 172.21.15.16:0/1077194610 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16740306c0 con 0x7f16840b2cd0 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168415e720 con 0x7f16840b2cd0 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.492+0000 7f16817fa640 1 -- 172.21.15.16:0/1077194610 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674037040 con 0x7f16840b2cd0 2024-05-11T01:01:56.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.493+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168415ece0 con 0x7f16840b2cd0 2024-05-11T01:01:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.493+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f168406a5b0 con 0x7f16840b2cd0 2024-05-11T01:01:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.494+0000 7f16817fa640 1 -- 172.21.15.16:0/1077194610 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1674044020 con 0x7f16840b2cd0 2024-05-11T01:01:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.495+0000 7f16817fa640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f16640762d0 0x7f1664078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.495+0000 7f16817fa640 1 -- 172.21.15.16:0/1077194610 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f16740b7e30 con 0x7f16840b2cd0 2024-05-11T01:01:56.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.495+0000 7f167bfff640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f16640762d0 0x7f1664078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:56.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.496+0000 7f167bfff640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f16640762d0 0x7f1664078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f16841609d0 tx=0x7f166c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:56.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.499+0000 7f16817fa640 1 -- 172.21.15.16:0/1077194610 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f167404b030 con 0x7f16840b2cd0 2024-05-11T01:01:56.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.734+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1684073440 con 0x7f16840b2cd0 2024-05-11T01:01:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.735+0000 7f16817fa640 1 -- 172.21.15.16:0/1077194610 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f1674081790 con 0x7f16840b2cd0 2024-05-11T01:01:56.735 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:01:56.735 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/325711019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":325711019},{"type":"v1","addr":"172.21.15.174:6836","nonce":325711019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2354391599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2354391599},{"type":"v1","addr":"172.21.15.16:6835","nonce":2354391599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4809,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2932760959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2932760959},{"type":"v1","addr":"172.21.15.174:6837","nonce":2932760959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:50.892297+0000","modified":"2024-05-11T01:01:53.909794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4812},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4812":{"gid":4812,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/2086463820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2086463820},{"type":"v1","addr":"172.21.15.16:6834","nonce":2086463820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4812,"qdb_cluster":[4812]},"id":2}]} 2024-05-11T01:01:56.735 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-05-11T01:01:56.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f16640762d0 msgr2=0x7f1664078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f16640762d0 0x7f1664078790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f16841609d0 tx=0x7f166c008040 comp rx=0 tx=0).stop 2024-05-11T01:01:56.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b2cd0 msgr2=0x7f168415be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b2cd0 0x7f168415be20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f167402a220 tx=0x7f16740046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 shutdown_connections 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f16640762d0 0x7f1664078790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1684145ae0 0x7f16840cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16840b4040 0x7f16840ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 --2- 172.21.15.16:0/1077194610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b2cd0 0x7f168415be20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 >> 172.21.15.16:0/1077194610 conn(0x7f168406fd90 msgr2=0x7f16840d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 shutdown_connections 2024-05-11T01:01:56.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:56.737+0000 7f168a324640 1 -- 172.21.15.16:0/1077194610 wait complete. 2024-05-11T01:01:57.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-11T01:01:50.892297+0000', 'modified': '2024-05-11T01:01:53.909794+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4812}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4812': {'gid': 4812, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6834/2086463820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 2086463820}, {'type': 'v1', 'addr': '172.21.15.16:6834', 'nonce': 2086463820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4812, 'qdb_cluster': [4812]} 2024-05-11T01:01:57.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-11T01:01:57.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-11T01:01:57.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.261+0000 7ff337e9c640 1 Processor -- start 2024-05-11T01:01:57.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.261+0000 7ff337e9c640 1 -- start start 2024-05-11T01:01:57.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff337e9c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff330145ae0 0x7ff33015d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff337e9c640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33015c6e0 con 0x7ff3300b4040 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff337e9c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff330145ec0 con 0x7ff3300b33e0 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff337e9c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff33015ccc0 con 0x7ff330145ae0 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff335437640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff3300b4040 0x7ff3300b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53518/0 (socket says 172.21.15.16:53518) 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff335437640 1 -- 172.21.15.16:0/1510495756 learned_addr learned my addr 172.21.15.16:0/1510495756 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff335c38640 1 --2- 172.21.15.16:0/1510495756 >> v2:172.21.15.174:3300/0 conn(0x7ff330145ae0 0x7ff33015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677862228 0 0) 0x7ff33015c6e0 con 0x7ff3300b4040 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.262+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff31c003520 con 0x7ff3300b4040 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254871928 0 0) 0x7ff330145ec0 con 0x7ff3300b33e0 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff33015c6e0 con 0x7ff3300b33e0 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1894685824 0 0) 0x7ff31c003520 con 0x7ff3300b4040 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 >> v2:172.21.15.174:3300/0 conn(0x7ff330145ae0 msgr2=0x7ff33015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 --2- 172.21.15.16:0/1510495756 >> v2:172.21.15.174:3300/0 conn(0x7ff330145ae0 0x7ff33015d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 >> v1:172.21.15.174:6789/0 conn(0x7ff3300b33e0 legacy=0x7ff33015fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33015d690 con 0x7ff3300b4040 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7ff3200016f0 con 0x7ff3300b4040 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 >> v1:172.21.15.16:6789/0 conn(0x7ff3300b4040 legacy=0x7ff3300b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff31c003c80 0x7ff31c004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31c004800 0x7ff31c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c005230 0x7ff31c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff33015ccc0 con 0x7ff31c003c80 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff31c00e3a0 con 0x7ff31c004800 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff31c00e5a0 con 0x7ff31c005230 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335c38640 1 --2- 172.21.15.16:0/1510495756 >> v2:172.21.15.174:3300/0 conn(0x7ff330145ae0 0x7ff33015d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335437640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31c004800 0x7ff31c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335c38640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff31c003c80 0x7ff31c004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff336439640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c005230 0x7ff31c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335c38640 1 -- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c005230 msgr2=0x7ff31c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.267 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335c38640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c005230 0x7ff31c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335c38640 1 -- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31c004800 msgr2=0x7ff31c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335c38640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31c004800 0x7ff31c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335c38640 1 -- 172.21.15.16:0/1510495756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31c003520 con 0x7ff31c003c80 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff336439640 1 -- 172.21.15.16:0/1510495756 reap_dead start 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.263+0000 7ff335437640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff31c004800 0x7ff31c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.264+0000 7ff335c38640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff31c003c80 0x7ff31c004080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff32c009c70 tx=0x7ff31c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390c052ea4214a67 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.264+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c009840 con 0x7ff31c003c80 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.264+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c004020 con 0x7ff31c003c80 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.264+0000 7ff334c36640 1 -- 172.21.15.16:0/1510495756 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0043d0 con 0x7ff31c003c80 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.265+0000 7ff337e9c640 1 -- 172.21.15.16:0/1510495756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff31c003c80 msgr2=0x7ff31c004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.265+0000 7ff337e9c640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff31c003c80 0x7ff31c004080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff32c009c70 tx=0x7ff31c005830 comp rx=0 tx=0).stop 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.265+0000 7ff337e9c640 1 -- 172.21.15.16:0/1510495756 shutdown_connections 2024-05-11T01:01:57.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.265+0000 7ff337e9c640 1 --2- 172.21.15.16:0/1510495756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff31c003c80 0x7ff31c004080 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.265+0000 7ff337e9c640 1 -- 172.21.15.16:0/1510495756 >> 172.21.15.16:0/1510495756 conn(0x7ff33006fd90 msgr2=0x7ff33006c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:57.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.265+0000 7ff337e9c640 1 -- 172.21.15.16:0/1510495756 shutdown_connections 2024-05-11T01:01:57.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.265+0000 7ff337e9c640 1 -- 172.21.15.16:0/1510495756 wait complete. 2024-05-11T01:01:57.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.266+0000 7ff337e9c640 1 Processor -- start 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.266+0000 7ff337e9c640 1 -- start start 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff337e9c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c003c80 0x7ff33015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff337e9c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3301f13d0 0x7ff3300b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff337e9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3301f1810 0x7ff3300b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff337e9c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff33015c950 con 0x7ff3301f1810 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff337e9c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3300b4d70 con 0x7ff3301f13d0 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff337e9c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff330073b70 con 0x7ff31c003c80 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3301f1810 0x7ff3300b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3301f1810 0x7ff3300b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52150/0 (socket says 172.21.15.16:52150) 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 -- 172.21.15.16:0/4027390090 learned_addr learned my addr 172.21.15.16:0/4027390090 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 -- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c003c80 msgr2=0x7ff33015bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff335c38640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c003c80 0x7ff33015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c003c80 0x7ff33015bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 -- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3301f13d0 msgr2=0x7ff3300b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3301f13d0 0x7ff3300b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 -- 172.21.15.16:0/4027390090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3300ab6f0 con 0x7ff3301f1810 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff336439640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3301f1810 0x7ff3300b2120 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3300741b0 tx=0x7ff32800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.267+0000 7ff3267fc640 1 -- 172.21.15.16:0/4027390090 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328003b80 con 0x7ff3301f1810 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.268+0000 7ff3267fc640 1 -- 172.21.15.16:0/4027390090 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff328018070 con 0x7ff3301f1810 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.268+0000 7ff337e9c640 1 -- 172.21.15.16:0/4027390090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3300ab9d0 con 0x7ff3301f1810 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.268+0000 7ff3267fc640 1 -- 172.21.15.16:0/4027390090 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280050d0 con 0x7ff3301f1810 2024-05-11T01:01:57.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.268+0000 7ff337e9c640 1 -- 172.21.15.16:0/4027390090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3300abf90 con 0x7ff3301f1810 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.269+0000 7ff3267fc640 1 -- 172.21.15.16:0/4027390090 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff328005270 con 0x7ff3301f1810 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.270+0000 7ff3267fc640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff314076300 0x7ff3140787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.270+0000 7ff3267fc640 1 -- 172.21.15.16:0/4027390090 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff328096fe0 con 0x7ff3301f1810 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.270+0000 7ff335c38640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff314076300 0x7ff3140787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff33abb7740 1 Processor -- start 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff335c38640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff314076300 0x7ff3140787c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff32c032000 tx=0x7ff32c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff33abb7740 1 -- start start 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 0x55a27fe83800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fe83d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe53c50 0x55a27fe57460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff33abb7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a27fdbd8d0 con 0x55a27fe813d0 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff33abb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a27fd76c10 con 0x55a27fe80ff0 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.271+0000 7ff33abb7740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55a27fdb9890 con 0x55a27fe53c50 2024-05-11T01:01:57.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fe83d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fe83d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52158/0 (socket says 172.21.15.16:52158) 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 -- 172.21.15.16:0/2599402137 learned_addr learned my addr 172.21.15.16:0/2599402137 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff336439640 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe53c50 0x55a27fe57460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335c38640 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 0x55a27fe83800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 -- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe53c50 msgr2=0x55a27fe57460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe53c50 0x55a27fe57460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 -- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 msgr2=0x55a27fe83800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 0x55a27fe83800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 -- 172.21.15.16:0/2599402137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a27fd7e5d0 con 0x55a27fe813d0 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335c38640 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 0x55a27fe83800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff335437640 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fe83d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3200015a0 tx=0x7ff320004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17aa5f79861b1f8c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff3137fe640 1 -- 172.21.15.16:0/2599402137 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320007c40 con 0x55a27fe813d0 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff3137fe640 1 -- 172.21.15.16:0/2599402137 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff320018070 con 0x55a27fe813d0 2024-05-11T01:01:57.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.272+0000 7ff3137fe640 1 -- 172.21.15.16:0/2599402137 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3200133f0 con 0x55a27fe813d0 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 -- 172.21.15.16:0/2599402137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 msgr2=0x55a27fe83d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fe83d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3200015a0 tx=0x7ff320004bb0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 -- 172.21.15.16:0/2599402137 shutdown_connections 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe53c50 0x55a27fe57460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fe83d40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 --2- 172.21.15.16:0/2599402137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 0x55a27fe83800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 -- 172.21.15.16:0/2599402137 >> 172.21.15.16:0/2599402137 conn(0x55a27fe55ec0 msgr2=0x55a27fe9e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 -- 172.21.15.16:0/2599402137 shutdown_connections 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 -- 172.21.15.16:0/2599402137 wait complete. 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 -- start start 2024-05-11T01:01:57.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.273+0000 7ff33abb7740 1 Processor -- start 2024-05-11T01:01:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe80ff0 0x55a27fe9d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe813d0 0x55a27fe9dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe775b0 0x55a27fe85380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff33abb7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a27fe59070 con 0x55a27fe80ff0 2024-05-11T01:01:57.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff33abb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a27fd7a760 con 0x55a27fe813d0 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff33abb7740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55a27fe59350 con 0x55a27fe775b0 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff33abb7740 10 client.0 _ll_register_callbacks cb 0x55a27fdb3cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff335c38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe80ff0 0x55a27fe9d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff335c38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe80ff0 0x55a27fe9d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52176/0 (socket says 172.21.15.16:52176) 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.274+0000 7ff335c38640 1 -- 172.21.15.16:0/831601338 learned_addr learned my addr 172.21.15.16:0/831601338 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff336439640 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe775b0 0x55a27fe85380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff335437640 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe813d0 0x55a27fe9dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff335c38640 1 -- 172.21.15.16:0/831601338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe775b0 msgr2=0x55a27fe85380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff335c38640 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe775b0 0x55a27fe85380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff335c38640 1 -- 172.21.15.16:0/831601338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe813d0 msgr2=0x55a27fe9dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff335c38640 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe813d0 0x55a27fe9dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff335c38640 1 -- 172.21.15.16:0/831601338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a27facf2d0 con 0x55a27fe80ff0 2024-05-11T01:01:57.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff335c38640 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe80ff0 0x55a27fe9d6a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff32c02ad30 tx=0x7ff32c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96c9cacad95a2fe server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff310ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff310ff9640 1 -- 172.21.15.16:0/831601338 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c04c060 con 0x55a27fe80ff0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff310ff9640 1 -- 172.21.15.16:0/831601338 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff32c03b430 con 0x55a27fe80ff0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff33abb7740 1 -- 172.21.15.16:0/831601338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff320018070 con 0x55a27fe80ff0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff310ff9640 1 -- 172.21.15.16:0/831601338 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff32c052050 con 0x55a27fe80ff0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff33abb7740 10 client.4959 fetch_fsmap learned FSMap version 17 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff33abb7740 1 -- 172.21.15.16:0/831601338 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a27fb996b0 con 0x55a27fe80ff0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.275+0000 7ff310ff9640 1 -- 172.21.15.16:0/831601338 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff320018070 con 0x55a27fe80ff0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff310ff9640 1 -- 172.21.15.16:0/831601338 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7ff32c055020 con 0x55a27fe80ff0 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff33abb7740 10 client.4959 fetch_fsmap finished waiting for FSMap version 17 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff33abb7740 10 client.4959 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff33abb7740 20 client.4959 populate_metadata read hostname 'smithi016' 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff33abb7740 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] conn(0x55a27fea0350 0x55a27fea0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff33abb7740 4 client.4959 mds_command: new command op to 4812 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff33abb7740 1 -- 172.21.15.16:0/831601338 --> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a27fd41760 con 0x55a27fea0350 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff335437640 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] conn(0x55a27fea0350 0x55a27fea0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff335437640 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] conn(0x55a27fea0350 0x55a27fea0730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c7304a1349e6a6e server_cookie=abff2875c9789014 in_seq=0 out_seq=0 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.276+0000 7ff310ff9640 10 client.4959 ms_handle_connect on v2:172.21.15.16:6832/2086463820 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff310ff9640 1 -- 172.21.15.16:0/831601338 <== mds.0 v2:172.21.15.16:6832/2086463820 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a27fd41760 con 0x55a27fea0350 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff310ff9640 10 client.4959 handle_command_reply: tid=0 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 client.4959 shutdown 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 -- 172.21.15.16:0/831601338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe80ff0 msgr2=0x55a27fe9d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe80ff0 0x55a27fe9d6a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff32c02ad30 tx=0x7ff32c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 -- 172.21.15.16:0/831601338 shutdown_connections 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] conn(0x55a27fea0350 0x55a27fea0730 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe775b0 0x55a27fe85380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe813d0 0x55a27fe9dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff310ff9640 0 client.4959 ms_handle_reset on v2:172.21.15.16:6832/2086463820 2024-05-11T01:01:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 --2- 172.21.15.16:0/831601338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe80ff0 0x55a27fe9d6a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 -- 172.21.15.16:0/831601338 >> 172.21.15.16:0/831601338 conn(0x55a27fe53c50 msgr2=0x55a27fe548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 -- 172.21.15.16:0/831601338 shutdown_connections 2024-05-11T01:01:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 1 -- 172.21.15.16:0/831601338 wait complete. 2024-05-11T01:01:57.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.277+0000 7ff33abb7740 20 client.4959 trim_cache size 0 max 16384 2024-05-11T01:01:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.296+0000 7ff33abb7740 1 Processor -- start 2024-05-11T01:01:57.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.296+0000 7ff33abb7740 1 -- start start 2024-05-11T01:01:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe775b0 0x55a27fe80340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 0x55a27fe80880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe813d0 0x55a27fea2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff33abb7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff3301fcd00 con 0x55a27fe775b0 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff33abb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff3300ad0a0 con 0x55a27fe80ff0 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff33abb7740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff3300ab140 con 0x55a27fe813d0 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe775b0 0x55a27fe80340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe775b0 0x55a27fe80340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52182/0 (socket says 172.21.15.16:52182) 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 -- 172.21.15.16:0/866893625 learned_addr learned my addr 172.21.15.16:0/866893625 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 -- 172.21.15.16:0/866893625 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe813d0 msgr2=0x55a27fea2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 --2- 172.21.15.16:0/866893625 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe813d0 0x55a27fea2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 -- 172.21.15.16:0/866893625 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 msgr2=0x55a27fe80880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 --2- 172.21.15.16:0/866893625 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 0x55a27fe80880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 -- 172.21.15.16:0/866893625 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a27fe9e800 con 0x55a27fe775b0 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff335c38640 1 --2- 172.21.15.16:0/866893625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe775b0 0x55a27fe80340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff32c03b5f0 tx=0x7ff32c044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1a80e6b9a14058 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.297+0000 7ff312ffd640 1 -- 172.21.15.16:0/866893625 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c03b960 con 0x55a27fe775b0 2024-05-11T01:01:57.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff312ffd640 1 -- 172.21.15.16:0/866893625 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c03f070 con 0x55a27fe775b0 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff312ffd640 1 -- 172.21.15.16:0/866893625 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c03bd00 con 0x55a27fe775b0 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 -- 172.21.15.16:0/866893625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe775b0 msgr2=0x55a27fe80340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 --2- 172.21.15.16:0/866893625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe775b0 0x55a27fe80340 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff32c03b5f0 tx=0x7ff32c044000 comp rx=0 tx=0).stop 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 -- 172.21.15.16:0/866893625 shutdown_connections 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 --2- 172.21.15.16:0/866893625 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe813d0 0x55a27fea2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 --2- 172.21.15.16:0/866893625 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe80ff0 0x55a27fe80880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 --2- 172.21.15.16:0/866893625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe775b0 0x55a27fe80340 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 -- 172.21.15.16:0/866893625 >> 172.21.15.16:0/866893625 conn(0x55a27fe53c50 msgr2=0x55a27fe79350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 -- 172.21.15.16:0/866893625 shutdown_connections 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.298+0000 7ff33abb7740 1 -- 172.21.15.16:0/866893625 wait complete. 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.299+0000 7ff33abb7740 1 -- start start 2024-05-11T01:01:57.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.299+0000 7ff33abb7740 1 Processor -- start 2024-05-11T01:01:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe775b0 0x55a27fe84310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe80ff0 0x55a27fe80720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fec2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a27fe785f0 con 0x55a27fe813d0 2024-05-11T01:01:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a27fe7b190 con 0x55a27fe775b0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55a27fe85d90 con 0x55a27fe80ff0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 10 client.0 _ll_register_callbacks cb 0x7ff31c0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fec2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fec2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52184/0 (socket says 172.21.15.16:52184) 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 -- 172.21.15.16:0/1708316608 learned_addr learned my addr 172.21.15.16:0/1708316608 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff335437640 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe80ff0 0x55a27fe80720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff335c38640 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe775b0 0x55a27fe84310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 -- 172.21.15.16:0/1708316608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe80ff0 msgr2=0x55a27fe80720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe80ff0 0x55a27fe80720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 -- 172.21.15.16:0/1708316608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe775b0 msgr2=0x55a27fe84310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe775b0 0x55a27fe84310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 -- 172.21.15.16:0/1708316608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a27fe59e20 con 0x55a27fe813d0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff336439640 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fec2440 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff328060200 tx=0x7ff328007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fa2d4a377e497b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff310ff9640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-05-11T01:01:57.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff310ff9640 1 -- 172.21.15.16:0/1708316608 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328060270 con 0x55a27fe813d0 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff310ff9640 1 -- 172.21.15.16:0/1708316608 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff32808fd90 con 0x55a27fe813d0 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 1 -- 172.21.15.16:0/1708316608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff32c03f070 con 0x55a27fe813d0 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff310ff9640 1 -- 172.21.15.16:0/1708316608 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff328064620 con 0x55a27fe813d0 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 10 client.4965 fetch_fsmap learned FSMap version 17 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.300+0000 7ff33abb7740 1 -- 172.21.15.16:0/1708316608 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55a27fec1c40 con 0x55a27fe813d0 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff310ff9640 1 -- 172.21.15.16:0/1708316608 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32c03f070 con 0x55a27fe813d0 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff310ff9640 1 -- 172.21.15.16:0/1708316608 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7ff328006b50 con 0x55a27fe813d0 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 10 client.4965 fetch_fsmap finished waiting for FSMap version 17 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 10 client.4965 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 20 client.4965 populate_metadata read hostname 'smithi016' 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] conn(0x55a27ff24f00 0x55a27ff252e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 4 client.4965 mds_command: new command op to 4812 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 1 -- 172.21.15.16:0/1708316608 --> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] -- command(tid 0: {"prefix": "status"}) -- 0x55a27fdcb4e0 con 0x55a27ff24f00 2024-05-11T01:01:57.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff335c38640 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] conn(0x55a27ff24f00 0x55a27ff252e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff310ff9640 10 client.4965 ms_handle_connect on v2:172.21.15.16:6832/2086463820 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff335c38640 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] conn(0x55a27ff24f00 0x55a27ff252e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9590caa253cbab1 server_cookie=9e6543f21b0d299e in_seq=0 out_seq=0 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff310ff9640 1 -- 172.21.15.16:0/1708316608 <== mds.0 v2:172.21.15.16:6832/2086463820 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a27fdcb4e0 con 0x55a27ff24f00 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff310ff9640 10 client.4965 handle_command_reply: tid=0 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 1 client.4965 shutdown 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 1 -- 172.21.15.16:0/1708316608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 msgr2=0x55a27fec2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.301+0000 7ff33abb7740 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fec2440 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff328060200 tx=0x7ff328007e30 comp rx=0 tx=0).stop 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 1 -- 172.21.15.16:0/1708316608 shutdown_connections 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.16:6832/2086463820,v1:172.21.15.16:6834/2086463820] conn(0x55a27ff24f00 0x55a27ff252e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a27fe813d0 0x55a27fec2440 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55a27fe80ff0 0x55a27fe80720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 1 --2- 172.21.15.16:0/1708316608 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a27fe775b0 0x55a27fe84310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff310ff9640 0 client.4965 ms_handle_reset on v2:172.21.15.16:6832/2086463820 2024-05-11T01:01:57.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 1 -- 172.21.15.16:0/1708316608 >> 172.21.15.16:0/1708316608 conn(0x55a27fe53c50 msgr2=0x55a27fe79290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 1 -- 172.21.15.16:0/1708316608 shutdown_connections 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 1 -- 172.21.15.16:0/1708316608 wait complete. 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff33abb7740 20 client.4965 trim_cache size 0 max 16384 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "3d939707-6559-4ce1-a2ce-e98842b2ed86", 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4812, 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-05-11T01:01:57.308 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 5.7898986270000004, 2024-05-11T01:01:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 17, 2024-05-11T01:01:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 31, 2024-05-11T01:01:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 31, 2024-05-11T01:01:57.309 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 13.065175232 2024-05-11T01:01:57.309 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 -- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff314076300 msgr2=0x7ff3140787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff314076300 0x7ff3140787c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff32c032000 tx=0x7ff32c008030 comp rx=0 tx=0).stop 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 -- 172.21.15.16:0/4027390090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3301f1810 msgr2=0x7ff3300b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3301f1810 0x7ff3300b2120 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3300741b0 tx=0x7ff32800ff70 comp rx=0 tx=0).stop 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 -- 172.21.15.16:0/4027390090 shutdown_connections 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff314076300 0x7ff3140787c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff3301f1810 0x7ff3300b2120 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff3301f13d0 0x7ff3300b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 --2- 172.21.15.16:0/4027390090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff31c003c80 0x7ff33015bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 -- 172.21.15.16:0/4027390090 >> 172.21.15.16:0/4027390090 conn(0x7ff33006fd90 msgr2=0x7ff3300ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 -- 172.21.15.16:0/4027390090 shutdown_connections 2024-05-11T01:01:57.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.302+0000 7ff337e9c640 1 -- 172.21.15.16:0/4027390090 wait complete. 2024-05-11T01:01:57.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-11T01:01:57.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.417+0000 7f2460bb7640 1 Processor -- start 2024-05-11T01:01:57.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.417+0000 7f2460bb7640 1 -- start start 2024-05-11T01:01:57.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f2460bb7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f245c0b4040 0x7f245c0b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f2460bb7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c0b2cd0 0x7f245c0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f2460bb7640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f245c15c6e0 con 0x7f245c145ae0 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f2460bb7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f245c0b3680 con 0x7f245c0b4040 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f2460bb7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f245c15ccc0 con 0x7f245c0b2cd0 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f245a59c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f245c145ae0 0x7f245c15d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53530/0 (socket says 172.21.15.16:53530) 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f245a59c640 1 -- 172.21.15.16:0/630999530 learned_addr learned my addr 172.21.15.16:0/630999530 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f245ad9d640 1 --2- 172.21.15.16:0/630999530 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c0b2cd0 0x7f245c0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.418+0000 7f2459d9b640 1 --2- 172.21.15.16:0/630999530 >> v2:172.21.15.174:3300/0 conn(0x7f245c0b4040 0x7f245c0b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.419+0000 7f245959a640 1 -- 172.21.15.16:0/630999530 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648656783 0 0) 0x7f245c15c6e0 con 0x7f245c145ae0 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.419+0000 7f245959a640 1 -- 172.21.15.16:0/630999530 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2448005730 con 0x7f245c145ae0 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.419+0000 7f245ad9d640 1 -- 172.21.15.16:0/630999530 >> v2:172.21.15.174:3300/0 conn(0x7f245c0b4040 msgr2=0x7f245c0b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.419+0000 7f245ad9d640 1 --2- 172.21.15.16:0/630999530 >> v2:172.21.15.174:3300/0 conn(0x7f245c0b4040 0x7f245c0b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.419+0000 7f245ad9d640 1 -- 172.21.15.16:0/630999530 >> v1:172.21.15.16:6789/0 conn(0x7f245c145ae0 legacy=0x7f245c15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.419+0000 7f245ad9d640 1 -- 172.21.15.16:0/630999530 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c145ec0 con 0x7f245c0b2cd0 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.419+0000 7f245ad9d640 1 --2- 172.21.15.16:0/630999530 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c0b2cd0 0x7f245c0b3140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24540097a0 tx=0x7f245402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce1ea56743b7390 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f245959a640 1 -- 172.21.15.16:0/630999530 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454037070 con 0x7f245c0b2cd0 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f245959a640 1 -- 172.21.15.16:0/630999530 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2454032440 con 0x7f245c0b2cd0 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f245959a640 1 -- 172.21.15.16:0/630999530 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24540327f0 con 0x7f245c0b2cd0 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f2460bb7640 1 -- 172.21.15.16:0/630999530 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c0b2cd0 msgr2=0x7f245c0b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f2460bb7640 1 --2- 172.21.15.16:0/630999530 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c0b2cd0 0x7f245c0b3140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24540097a0 tx=0x7f245402a180 comp rx=0 tx=0).stop 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f2460bb7640 1 -- 172.21.15.16:0/630999530 shutdown_connections 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f2460bb7640 1 --2- 172.21.15.16:0/630999530 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c0b2cd0 0x7f245c0b3140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f2460bb7640 1 --2- 172.21.15.16:0/630999530 >> v2:172.21.15.174:3300/0 conn(0x7f245c0b4040 0x7f245c0b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f2460bb7640 1 -- 172.21.15.16:0/630999530 >> 172.21.15.16:0/630999530 conn(0x7f245c06fd90 msgr2=0x7f245c06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f2460bb7640 1 -- 172.21.15.16:0/630999530 shutdown_connections 2024-05-11T01:01:57.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.420+0000 7f2460bb7640 1 -- 172.21.15.16:0/630999530 wait complete. 2024-05-11T01:01:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.422+0000 7f2460bb7640 1 Processor -- start 2024-05-11T01:01:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.422+0000 7f2460bb7640 1 -- start start 2024-05-11T01:01:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.422+0000 7f2460bb7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f245c0b2cd0 0x7f245c0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2460bb7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245c0b4040 0x7f245c0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2460bb7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c145ae0 0x7f245c072790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2460bb7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f245c15c950 con 0x7f245c0b4040 2024-05-11T01:01:57.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2460bb7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f245c0b4d70 con 0x7f245c0b2cd0 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2460bb7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f245c073b70 con 0x7f245c145ae0 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245c0b4040 0x7f245c0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245c0b4040 0x7f245c0aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52196/0 (socket says 172.21.15.16:52196) 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 -- 172.21.15.16:0/3038601773 learned_addr learned my addr 172.21.15.16:0/3038601773 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f245ad9d640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c145ae0 0x7f245c072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f245a59c640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f245c0b2cd0 0x7f245c0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 -- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c145ae0 msgr2=0x7f245c072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c145ae0 0x7f245c072790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 -- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f245c0b2cd0 msgr2=0x7f245c0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f245c0b2cd0 0x7f245c0ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 -- 172.21.15.16:0/3038601773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245c0af450 con 0x7f245c0b4040 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f245a59c640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f245c0b2cd0 0x7f245c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2459d9b640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245c0b4040 0x7f245c0aee20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f244400e9e0 tx=0x7f244400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2452ffd640 1 -- 172.21.15.16:0/3038601773 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2444017070 con 0x7f245c0b4040 2024-05-11T01:01:57.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2452ffd640 1 -- 172.21.15.16:0/3038601773 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244400c9d0 con 0x7f245c0b4040 2024-05-11T01:01:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245c0af730 con 0x7f245c0b4040 2024-05-11T01:01:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2452ffd640 1 -- 172.21.15.16:0/3038601773 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244400cdc0 con 0x7f245c0b4040 2024-05-11T01:01:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.423+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f245c0afcf0 con 0x7f245c0b4040 2024-05-11T01:01:57.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.424+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245c06a5b0 con 0x7f245c0b4040 2024-05-11T01:01:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.425+0000 7f2452ffd640 1 -- 172.21.15.16:0/3038601773 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f244401a070 con 0x7f245c0b4040 2024-05-11T01:01:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.426+0000 7f2452ffd640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f243c0762d0 0x7f243c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.426+0000 7f2452ffd640 1 -- 172.21.15.16:0/3038601773 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2444097640 con 0x7f245c0b4040 2024-05-11T01:01:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.426+0000 7f245a59c640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f243c0762d0 0x7f243c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:57.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.426+0000 7f245a59c640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f243c0762d0 0x7f243c078790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f244c0015c0 tx=0x7f244c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:57.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.430+0000 7f2452ffd640 1 -- 172.21.15.16:0/3038601773 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2444060fa0 con 0x7f245c0b4040 2024-05-11T01:01:57.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.663+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f245c073440 con 0x7f245c0b4040 2024-05-11T01:01:57.663 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.663+0000 7f2452ffd640 1 -- 172.21.15.16:0/3038601773 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f24440608a0 con 0x7f245c0b4040 2024-05-11T01:01:57.663 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-11T01:01:57.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.665+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f243c0762d0 msgr2=0x7f243c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.665+0000 7f2460bb7640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f243c0762d0 0x7f243c078790 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f244c0015c0 tx=0x7f244c009040 comp rx=0 tx=0).stop 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.665+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245c0b4040 msgr2=0x7f245c0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.665+0000 7f2460bb7640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245c0b4040 0x7f245c0aee20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f244400e9e0 tx=0x7f244400eea0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.666+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 shutdown_connections 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.666+0000 7f2460bb7640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f243c0762d0 0x7f243c078790 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.666+0000 7f2460bb7640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f245c145ae0 0x7f245c072790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.666+0000 7f2460bb7640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245c0b4040 0x7f245c0aee20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.666+0000 7f2460bb7640 1 --2- 172.21.15.16:0/3038601773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f245c0b2cd0 0x7f245c0ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.666+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 >> 172.21.15.16:0/3038601773 conn(0x7f245c06fd90 msgr2=0x7f245c0b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.666+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 shutdown_connections 2024-05-11T01:01:57.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57.666+0000 7f2460bb7640 1 -- 172.21.15.16:0/3038601773 wait complete. 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-11T01:01:57.677 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-11T01:01:57.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:57.678 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-05-11T01:01:57.694 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:01:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:01:57.694 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-11T01:01:57.695 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link noprefixroute 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 66:7c:9f:9d:19:03 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::245b:6cff:fe33:c9f/64 scope link 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 8e:ce:99:4a:60:d1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::8cce:99ff:fe4a:60d1/64 scope link 2024-05-11T01:01:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:57.697 INFO:teuthology.orchestra.run.smithi016.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-11T01:01:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 66:7c:9f:9d:19:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-11T01:01:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::647c:9fff:fe9d:1903/64 scope link 2024-05-11T01:01:57.697 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:01:57.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:57.697 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-11T01:01:57.760 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-05-11T01:01:57.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:57.762 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-05-11T01:01:57.819 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-05-11T01:01:57.819 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-11T01:01:57.819 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-11T01:01:57.819 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-11T01:01:57.819 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-11T01:01:57.820 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:01:57.820 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:01:57.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-11T01:01:57.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-11T01:01:57.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-11T01:01:57.820 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:01:57.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:01:57.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:57.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:57.950 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-05-11T01:01:57.966 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-11T01:01:57.966 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-11T01:01:57.966 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-11T01:01:57.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:57.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-05-11T01:01:58.033 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:58.033 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:58.089 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-11T01:01:58.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:01:58.089 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:58.145 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-11T01:01:58.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:58.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:58.231 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:58.231 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:58.242 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:01:58.242 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:01:58.242 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-11T01:01:58.242 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with new device syntax: 0@3d939707-6559-4ce1-a2ce-e98842b2ed86.cephfs=/ 2024-05-11T01:01:58.242 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.16:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-11T01:01:58.242 INFO:teuthology.orchestra.run.smithi016.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-11T01:01:58.242 INFO:teuthology.orchestra.run.smithi016.stdout: You just mounted a file system that supports labels which does not 2024-05-11T01:01:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-11T01:01:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: applications will generate AVC messages and not be allowed access to 2024-05-11T01:01:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-11T01:01:58.245 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-11T01:01:58.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:01:58.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-11T01:01:58.271 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:01:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:01:58.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:01:58.375 INFO:teuthology.orchestra.run.smithi016.stdout:client4855 2024-05-11T01:01:58.376 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:01:58.376 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:01:58.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-11T01:01:58.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.539+0000 7f34fea37640 1 Processor -- start 2024-05-11T01:01:58.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.539+0000 7f34fea37640 1 -- start start 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.539+0000 7f34fea37640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f34f815f530 0x7f34f806f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.539+0000 7f34fea37640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34f80d2a20 0x7f34f80cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.539+0000 7f34fea37640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34f80cdc90 con 0x7f34f80d3090 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.539+0000 7f34fea37640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f34f8163ea0 con 0x7f34f80d2a20 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.539+0000 7f34fea37640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f34f80d2e80 con 0x7f34f815f530 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f77fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34f80d2a20 0x7f34f80cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f77fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f34f80d2a20 0x7f34f80cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52202/0 (socket says 172.21.15.16:52202) 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f77fe640 1 -- 172.21.15.16:0/3318433649 learned_addr learned my addr 172.21.15.16:0/3318433649 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f7fff640 1 --2- 172.21.15.16:0/3318433649 >> v2:172.21.15.174:3300/0 conn(0x7f34f815f530 0x7f34f806f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f77fe640 1 -- 172.21.15.16:0/3318433649 >> v2:172.21.15.174:3300/0 conn(0x7f34f815f530 msgr2=0x7f34f806f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:58.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f77fe640 1 --2- 172.21.15.16:0/3318433649 >> v2:172.21.15.174:3300/0 conn(0x7f34f815f530 0x7f34f806f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f77fe640 1 -- 172.21.15.16:0/3318433649 >> v1:172.21.15.16:6789/0 conn(0x7f34f80d3090 legacy=0x7f34f80cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f77fe640 1 -- 172.21.15.16:0/3318433649 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f8162fb0 con 0x7f34f80d2a20 2024-05-11T01:01:58.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.540+0000 7f34f7fff640 1 --2- 172.21.15.16:0/3318433649 >> v2:172.21.15.174:3300/0 conn(0x7f34f815f530 0x7f34f806f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:01:58.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34f77fe640 1 --2- 172.21.15.16:0/3318433649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d2a20 0x7f34f80cd750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f34f80d3060 tx=0x7f34ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0a5d6a46cde85f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:58.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34f6ffd640 1 -- 172.21.15.16:0/3318433649 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec037070 con 0x7f34f80d2a20 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34f6ffd640 1 -- 172.21.15.16:0/3318433649 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec032440 con 0x7f34f80d2a20 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34f6ffd640 1 -- 172.21.15.16:0/3318433649 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec032810 con 0x7f34f80d2a20 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34fea37640 1 -- 172.21.15.16:0/3318433649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d2a20 msgr2=0x7f34f80cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34fea37640 1 --2- 172.21.15.16:0/3318433649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d2a20 0x7f34f80cd750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f34f80d3060 tx=0x7f34ec02a270 comp rx=0 tx=0).stop 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34fea37640 1 -- 172.21.15.16:0/3318433649 shutdown_connections 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34fea37640 1 --2- 172.21.15.16:0/3318433649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d2a20 0x7f34f80cd750 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34fea37640 1 --2- 172.21.15.16:0/3318433649 >> v2:172.21.15.174:3300/0 conn(0x7f34f815f530 0x7f34f806f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34fea37640 1 -- 172.21.15.16:0/3318433649 >> 172.21.15.16:0/3318433649 conn(0x7f34f80681c0 msgr2=0x7f34f80685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34fea37640 1 -- 172.21.15.16:0/3318433649 shutdown_connections 2024-05-11T01:01:58.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.541+0000 7f34fea37640 1 -- 172.21.15.16:0/3318433649 wait complete. 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.543+0000 7f34fea37640 1 Processor -- start 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.543+0000 7f34fea37640 1 -- start start 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34fea37640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80d2a20 0x7f34f80c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34fea37640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d3090 0x7f34f8143470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34fea37640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f815f530 0x7f34f81439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34fea37640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f34f8163850 con 0x7f34f80d3090 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34fea37640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f34f8163570 con 0x7f34f80d2a20 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34fea37640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f34f8163b30 con 0x7f34f815f530 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d3090 0x7f34f8143470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d3090 0x7f34f8143470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52212/0 (socket says 172.21.15.16:52212) 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 -- 172.21.15.16:0/3152980461 learned_addr learned my addr 172.21.15.16:0/3152980461 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f7fff640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80d2a20 0x7f34f80c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34fcfd4640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f815f530 0x7f34f81439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 -- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f815f530 msgr2=0x7f34f81439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f815f530 0x7f34f81439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 -- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80d2a20 msgr2=0x7f34f80c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80d2a20 0x7f34f80c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 -- 172.21.15.16:0/3152980461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f8141310 con 0x7f34f80d3090 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34fcfd4640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f815f530 0x7f34f81439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f77fe640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d3090 0x7f34f8143470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f34ec02a2b0 tx=0x7f34ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.544+0000 7f34f4ff9640 1 -- 172.21.15.16:0/3152980461 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec041020 con 0x7f34f80d3090 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.545+0000 7f34f4ff9640 1 -- 172.21.15.16:0/3152980461 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec0306c0 con 0x7f34f80d3090 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.545+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f81415f0 con 0x7f34f80d3090 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.545+0000 7f34f4ff9640 1 -- 172.21.15.16:0/3152980461 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec037040 con 0x7f34f80d3090 2024-05-11T01:01:58.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.545+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f815f910 con 0x7f34f80d3090 2024-05-11T01:01:58.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.546+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34f806a5b0 con 0x7f34f80d3090 2024-05-11T01:01:58.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.546+0000 7f34f4ff9640 1 -- 172.21.15.16:0/3152980461 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f34ec044020 con 0x7f34f80d3090 2024-05-11T01:01:58.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.547+0000 7f34f4ff9640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f34e4076300 0x7f34e40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.547+0000 7f34f4ff9640 1 -- 172.21.15.16:0/3152980461 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f34ec0b7df0 con 0x7f34f80d3090 2024-05-11T01:01:58.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.547+0000 7f34f7fff640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f34e4076300 0x7f34e40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.547+0000 7f34f7fff640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f34e4076300 0x7f34e40787c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f34e8006fd0 tx=0x7f34e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:58.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.551+0000 7f34f4ff9640 1 -- 172.21.15.16:0/3152980461 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f34ec04b030 con 0x7f34f80d3090 2024-05-11T01:01:58.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.767+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f34f80cf4d0 con 0x7f34e4076300 2024-05-11T01:01:58.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.769+0000 7f34f4ff9640 1 -- 172.21.15.16:0/3152980461 <== mgr.4106 v2:172.21.15.174:6832/704865226 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f34f80cf4d0 con 0x7f34e4076300 2024-05-11T01:01:58.769 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-05-11T01:01:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:01:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: "name": "cephfs" 2024-05-11T01:01:58.769 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:01:58.769 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-05-11T01:01:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f34e4076300 msgr2=0x7f34e40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f34e4076300 0x7f34e40787c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f34e8006fd0 tx=0x7f34e8008040 comp rx=0 tx=0).stop 2024-05-11T01:01:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d3090 msgr2=0x7f34f8143470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d3090 0x7f34f8143470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f34ec02a2b0 tx=0x7f34ec0046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 shutdown_connections 2024-05-11T01:01:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f34e4076300 0x7f34e40787c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f34f815f530 0x7f34f81439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f34f80d3090 0x7f34f8143470 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 --2- 172.21.15.16:0/3152980461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f34f80d2a20 0x7f34f80c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 >> 172.21.15.16:0/3152980461 conn(0x7f34f80681c0 msgr2=0x7f34f80cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 shutdown_connections 2024-05-11T01:01:58.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.771+0000 7f34fea37640 1 -- 172.21.15.16:0/3152980461 wait complete. 2024-05-11T01:01:58.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-05-11T01:01:58.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.888+0000 7f41e9e2a640 1 Processor -- start 2024-05-11T01:01:58.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.888+0000 7f41e9e2a640 1 -- start start 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e9e2a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e40cddd0 0x7f41e4141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e9e2a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e415db00 con 0x7f41e40cd940 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e9e2a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e415dde0 con 0x7f41e41402d0 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e9e2a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f41e415e0c0 con 0x7f41e40cddd0 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e2ffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f41e40cd940 0x7f41e4140b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53560/0 (socket says 172.21.15.16:53560) 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e2ffd640 1 -- 172.21.15.16:0/3741887529 learned_addr learned my addr 172.21.15.16:0/3741887529 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e3fff640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e40cddd0 0x7f41e4141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904289128 0 0) 0x7f41e415db00 con 0x7f41e40cd940 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41cc003520 con 0x7f41e40cd940 2024-05-11T01:01:58.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3865870720 0 0) 0x7f41cc003520 con 0x7f41e40cd940 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e40cddd0 msgr2=0x7f41e4141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e40cddd0 0x7f41e4141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 >> v1:172.21.15.174:6789/0 conn(0x7f41e41402d0 legacy=0x7f41e40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e415e3a0 con 0x7f41e40cd940 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f41d80016f0 con 0x7f41e40cd940 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 >> v1:172.21.15.16:6789/0 conn(0x7f41e40cd940 legacy=0x7f41e4140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e40cddd0 0x7f41cc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.889+0000 7f41e27fc640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e27fc640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41e415e0c0 con 0x7f41cc003f70 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41cc00bad0 con 0x7f41cc004d40 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc00bcd0 con 0x7f41e40cddd0 2024-05-11T01:01:58.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e2ffd640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e37fe640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e40cddd0 0x7f41cc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e3fff640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e2ffd640 1 -- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e40cddd0 msgr2=0x7f41cc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e2ffd640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e40cddd0 0x7f41cc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e2ffd640 1 -- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41cc004d40 msgr2=0x7f41cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e2ffd640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.890+0000 7f41e2ffd640 1 -- 172.21.15.16:0/3741887529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc003520 con 0x7f41cc003f70 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e2ffd640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41cc004800 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41d8001eb0 tx=0x7f41cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36da178d75511c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8007d30 con 0x7f41cc003f70 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d8005af0 con 0x7f41cc003f70 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e27fc640 1 -- 172.21.15.16:0/3741887529 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8007070 con 0x7f41cc003f70 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3741887529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 msgr2=0x7f41cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e9e2a640 1 --2- 172.21.15.16:0/3741887529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41cc004800 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f41d8001eb0 tx=0x7f41cc005830 comp rx=0 tx=0).stop 2024-05-11T01:01:58.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e3fff640 1 -- 172.21.15.16:0/3741887529 reap_dead start 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3741887529 shutdown_connections 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3741887529 >> 172.21.15.16:0/3741887529 conn(0x7f41e406c3e0 msgr2=0x7f41e406c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3741887529 shutdown_connections 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.891+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3741887529 wait complete. 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.893+0000 7f41e9e2a640 1 Processor -- start 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.893+0000 7f41e9e2a640 1 -- start start 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.893+0000 7f41e9e2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41e4154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e9e2a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e413f100 0x7f41e4137b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e9e2a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e4138070 0x7f41e4138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e9e2a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f41e40ce200 con 0x7f41cc003f70 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e9e2a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41406b0 con 0x7f41e4138070 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e9e2a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f41e40b2d40 con 0x7f41e413f100 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41e4154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41e4154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52224/0 (socket says 172.21.15.16:52224) 2024-05-11T01:01:58.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 -- 172.21.15.16:0/3556153896 learned_addr learned my addr 172.21.15.16:0/3556153896 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 -- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e413f100 msgr2=0x7f41e4137b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e413f100 0x7f41e4137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 -- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e4138070 msgr2=0x7f41e4138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e4138070 0x7f41e4138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 -- 172.21.15.16:0/3556153896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e413c060 con 0x7f41cc003f70 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e37fe640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41e4154270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f41d400f850 tx=0x7f41d400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41cbfff640 1 -- 172.21.15.16:0/3556153896 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d40052e0 con 0x7f41cc003f70 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41cbfff640 1 -- 172.21.15.16:0/3556153896 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d4018070 con 0x7f41cc003f70 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41cbfff640 1 -- 172.21.15.16:0/3556153896 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d400d8f0 con 0x7f41cc003f70 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e413c340 con 0x7f41cc003f70 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.894+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e413c900 con 0x7f41cc003f70 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.895+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e406a5b0 con 0x7f41cc003f70 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.896+0000 7f41cbfff640 1 -- 172.21.15.16:0/3556153896 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f41d400da90 con 0x7f41cc003f70 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.896+0000 7f41cbfff640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41d0076300 0x7f41d00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:58.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.896+0000 7f41cbfff640 1 -- 172.21.15.16:0/3556153896 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f41d4097430 con 0x7f41cc003f70 2024-05-11T01:01:58.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.897+0000 7f41e2ffd640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41d0076300 0x7f41d00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:58.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.897+0000 7f41e2ffd640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41d0076300 0x7f41d00787c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f41d8032000 tx=0x7f41d8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:58.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:58.901+0000 7f41cbfff640 1 -- 172.21.15.16:0/3556153896 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f41d4060e20 con 0x7f41cc003f70 2024-05-11T01:01:59.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.143+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f41e40b4c50 con 0x7f41cc003f70 2024-05-11T01:01:59.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.562+0000 7f41cbfff640 1 -- 172.21.15.16:0/3556153896 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) ==== 92+0+0 (secure 0 0 0) 0x7f41d4060720 con 0x7f41cc003f70 2024-05-11T01:01:59.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41d0076300 msgr2=0x7f41d00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:59.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41d0076300 0x7f41d00787c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f41d8032000 tx=0x7f41d8009030 comp rx=0 tx=0).stop 2024-05-11T01:01:59.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 msgr2=0x7f41e4154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:59.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41e4154270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f41d400f850 tx=0x7f41d400fd10 comp rx=0 tx=0).stop 2024-05-11T01:01:59.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 shutdown_connections 2024-05-11T01:01:59.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f41d0076300 0x7f41d00787c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e4138070 0x7f41e4138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f41e413f100 0x7f41e4137b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 --2- 172.21.15.16:0/3556153896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41cc003f70 0x7f41e4154270 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.565+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 >> 172.21.15.16:0/3556153896 conn(0x7f41e406c3e0 msgr2=0x7f41e41409e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:59.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.566+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 shutdown_connections 2024-05-11T01:01:59.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.566+0000 7f41e9e2a640 1 -- 172.21.15.16:0/3556153896 wait complete. 2024-05-11T01:01:59.579 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-05-11T01:01:59.683 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:01:59.684+0000 7f875b520040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-11T01:01:59.685 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:01:59.685+0000 7fb2cb709040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-11T01:01:59.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.689+0000 7fadd3e1d640 1 Processor -- start 2024-05-11T01:01:59.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.690+0000 7fadd3e1d640 1 -- start start 2024-05-11T01:01:59.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.690+0000 7fadd3e1d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc06db10 0x7fadcc0b4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:59.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.690+0000 7fadd3e1d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc0d61b0 con 0x7fadcc0b46c0 2024-05-11T01:01:59.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd3e1d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc06ee60 con 0x7fadcc162f30 2024-05-11T01:01:59.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd3e1d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc06ec10 con 0x7fadcc06db10 2024-05-11T01:01:59.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd23ba640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fadcc0b46c0 0x7fadcc169580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53568/0 (socket says 172.21.15.16:53568) 2024-05-11T01:01:59.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd23ba640 1 -- 172.21.15.16:0/4017355721 learned_addr learned my addr 172.21.15.16:0/4017355721 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:01:59.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd13b8640 1 --2- 172.21.15.16:0/4017355721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc06db10 0x7fadcc0b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:59.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd0bb7640 1 -- 172.21.15.16:0/4017355721 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224264456 0 0) 0x7fadcc06ee60 con 0x7fadcc162f30 2024-05-11T01:01:59.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd0bb7640 1 -- 172.21.15.16:0/4017355721 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadb4003520 con 0x7fadcc162f30 2024-05-11T01:01:59.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd0bb7640 1 -- 172.21.15.16:0/4017355721 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704092044 0 0) 0x7fadcc0d61b0 con 0x7fadcc0b46c0 2024-05-11T01:01:59.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd0bb7640 1 -- 172.21.15.16:0/4017355721 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadcc06ee60 con 0x7fadcc0b46c0 2024-05-11T01:01:59.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd13b8640 1 -- 172.21.15.16:0/4017355721 >> v1:172.21.15.174:6789/0 conn(0x7fadcc162f30 legacy=0x7fadcc06d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:59.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd13b8640 1 -- 172.21.15.16:0/4017355721 >> v1:172.21.15.16:6789/0 conn(0x7fadcc0b46c0 legacy=0x7fadcc169580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:59.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.691+0000 7fadd13b8640 1 -- 172.21.15.16:0/4017355721 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc06f140 con 0x7fadcc06db10 2024-05-11T01:01:59.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.692+0000 7fadd13b8640 1 --2- 172.21.15.16:0/4017355721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc06db10 0x7fadcc0b4110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadc00097d0 tx=0x7fadc002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6335a4f2a0eb739b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:59.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.692+0000 7fadd0bb7640 1 -- 172.21.15.16:0/4017355721 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0037070 con 0x7fadcc06db10 2024-05-11T01:01:59.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.692+0000 7fadd0bb7640 1 -- 172.21.15.16:0/4017355721 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0032440 con 0x7fadcc06db10 2024-05-11T01:01:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.692+0000 7fadd0bb7640 1 -- 172.21.15.16:0/4017355721 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0032810 con 0x7fadcc06db10 2024-05-11T01:01:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.693+0000 7fadd3e1d640 1 -- 172.21.15.16:0/4017355721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc06db10 msgr2=0x7fadcc0b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.693+0000 7fadd3e1d640 1 --2- 172.21.15.16:0/4017355721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc06db10 0x7fadcc0b4110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fadc00097d0 tx=0x7fadc002a180 comp rx=0 tx=0).stop 2024-05-11T01:01:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.693+0000 7fadd3e1d640 1 -- 172.21.15.16:0/4017355721 shutdown_connections 2024-05-11T01:01:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.693+0000 7fadd3e1d640 1 --2- 172.21.15.16:0/4017355721 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc06db10 0x7fadcc0b4110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.693+0000 7fadd3e1d640 1 -- 172.21.15.16:0/4017355721 >> 172.21.15.16:0/4017355721 conn(0x7fadcc09e6d0 msgr2=0x7fadcc0d5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.693+0000 7fadd3e1d640 1 -- 172.21.15.16:0/4017355721 shutdown_connections 2024-05-11T01:01:59.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.693+0000 7fadd3e1d640 1 -- 172.21.15.16:0/4017355721 wait complete. 2024-05-11T01:01:59.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.694+0000 7fadd3e1d640 1 Processor -- start 2024-05-11T01:01:59.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.694+0000 7fadd3e1d640 1 -- start start 2024-05-11T01:01:59.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd3e1d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc06db10 0x7fadcc155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:59.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd3e1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fadcc0b46c0 0x7fadcc0ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:59.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd3e1d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc162f30 0x7fadcc160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:59.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd3e1d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0d3a00 con 0x7fadcc0b46c0 2024-05-11T01:01:59.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd3e1d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0d5f50 con 0x7fadcc06db10 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd3e1d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc163310 con 0x7fadcc162f30 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd13b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fadcc0b46c0 0x7fadcc0ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd13b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fadcc0b46c0 0x7fadcc0ba2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52236/0 (socket says 172.21.15.16:52236) 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd13b8640 1 -- 172.21.15.16:0/2976081536 learned_addr learned my addr 172.21.15.16:0/2976081536 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd1bb9640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc06db10 0x7fadcc155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd23ba640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc162f30 0x7fadcc160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd13b8640 1 -- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc162f30 msgr2=0x7fadcc160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd13b8640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc162f30 0x7fadcc160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd13b8640 1 -- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc06db10 msgr2=0x7fadcc155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd13b8640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc06db10 0x7fadcc155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.695+0000 7fadd13b8640 1 -- 172.21.15.16:0/2976081536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc0bb020 con 0x7fadcc0b46c0 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.696+0000 7fadd13b8640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fadcc0b46c0 0x7fadcc0ba2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fadc00097d0 tx=0x7fadc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.696+0000 7fadca7fc640 1 -- 172.21.15.16:0/2976081536 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0041070 con 0x7fadcc0b46c0 2024-05-11T01:01:59.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.696+0000 7fadca7fc640 1 -- 172.21.15.16:0/2976081536 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0004250 con 0x7fadcc0b46c0 2024-05-11T01:01:59.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.696+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc0bad40 con 0x7fadcc0b46c0 2024-05-11T01:01:59.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.696+0000 7fadca7fc640 1 -- 172.21.15.16:0/2976081536 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0037040 con 0x7fadcc0b46c0 2024-05-11T01:01:59.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.696+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc0cc870 con 0x7fadcc0b46c0 2024-05-11T01:01:59.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.697+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadcc06a5b0 con 0x7fadcc0b46c0 2024-05-11T01:01:59.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.697+0000 7fadca7fc640 1 -- 172.21.15.16:0/2976081536 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 6) ==== 98218+0+0 (secure 0 0 0) 0x7fadc0003610 con 0x7fadcc0b46c0 2024-05-11T01:01:59.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.698+0000 7fadca7fc640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fadb8076320 0x7fadb80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:01:59.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.698+0000 7fadd1bb9640 1 -- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fadb8076320 msgr2=0x7fadb80787e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/704865226 2024-05-11T01:01:59.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.698+0000 7fadca7fc640 1 -- 172.21.15.16:0/2976081536 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fadc00b7b90 con 0x7fadcc0b46c0 2024-05-11T01:01:59.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.698+0000 7fadd1bb9640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fadb8076320 0x7fadb80787e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:01:59.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.702+0000 7fadca7fc640 1 -- 172.21.15.16:0/2976081536 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fadc0080f30 con 0x7fadcc0b46c0 2024-05-11T01:01:59.800 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:01:59.800+0000 7fb2cb709040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:01:59.818 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:01:59.819+0000 7f875b520040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:01:59.848 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:01:59.848+0000 7fb2cb709040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-11T01:01:59.868 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:01:59.868+0000 7f875b520040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-11T01:01:59.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.899+0000 7fadd1bb9640 1 -- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fadb8076320 msgr2=0x7fadb80787e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/704865226 2024-05-11T01:01:59.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.899+0000 7fadd1bb9640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fadb8076320 0x7fadb80787e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:01:59.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.911+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fadcc0d2dd0 con 0x7fadcc0b46c0 2024-05-11T01:01:59.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.914+0000 7fadca7fc640 1 -- 172.21.15.16:0/2976081536 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) ==== 138+0+0 (secure 0 0 0) 0x7fadc0085230 con 0x7fadcc0b46c0 2024-05-11T01:01:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fadb8076320 msgr2=0x7fadb80787e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:01:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fadb8076320 0x7fadb80787e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fadcc0b46c0 msgr2=0x7fadcc0ba2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fadcc0b46c0 0x7fadcc0ba2f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fadc00097d0 tx=0x7fadc00046c0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 shutdown_connections 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7fadb8076320 0x7fadb80787e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fadcc162f30 0x7fadcc160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fadcc0b46c0 0x7fadcc0ba2f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 --2- 172.21.15.16:0/2976081536 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fadcc06db10 0x7fadcc155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 >> 172.21.15.16:0/2976081536 conn(0x7fadcc09e6d0 msgr2=0x7fadcc0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 shutdown_connections 2024-05-11T01:01:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:01:59.916+0000 7fadd3e1d640 1 -- 172.21.15.16:0/2976081536 wait complete. 2024-05-11T01:01:59.928 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-05-11T01:02:00.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.036+0000 7ff876062640 1 Processor -- start 2024-05-11T01:02:00.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.036+0000 7ff876062640 1 -- start start 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff876062640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8700cd940 0x7ff8700cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff876062640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87015db00 con 0x7ff8701402d0 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff876062640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff87015dde0 con 0x7ff870140b00 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff876062640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff87015e0c0 con 0x7ff8700cd940 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86f7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff8701402d0 0x7ff8700b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53582/0 (socket says 172.21.15.16:53582) 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86f7fe640 1 -- 172.21.15.16:0/2256168332 learned_addr learned my addr 172.21.15.16:0/2256168332 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86effd640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8700cd940 0x7ff8700cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155756743 0 0) 0x7ff87015db00 con 0x7ff8701402d0 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff858003520 con 0x7ff8701402d0 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322741142 0 0) 0x7ff87015dde0 con 0x7ff870140b00 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff87015db00 con 0x7ff870140b00 2024-05-11T01:02:00.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1602728127 0 0) 0x7ff858003520 con 0x7ff8701402d0 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8700cd940 msgr2=0x7ff8700cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8700cd940 0x7ff8700cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 >> v1:172.21.15.174:6789/0 conn(0x7ff870140b00 legacy=0x7ff870140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87015e3a0 con 0x7ff8701402d0 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7ff8600016f0 con 0x7ff8701402d0 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 >> v1:172.21.15.16:6789/0 conn(0x7ff8701402d0 legacy=0x7ff8700b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858003c10 0x7ff858004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.037+0000 7ff86e7fc640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff858004800 0x7ff858004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86e7fc640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8700cd940 0x7ff858005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff87015e0c0 con 0x7ff858004800 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff85800bb50 con 0x7ff858003c10 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff85800bd50 con 0x7ff8700cd940 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86effd640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff858004800 0x7ff858004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86ffff640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8700cd940 0x7ff858005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86f7fe640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858003c10 0x7ff858004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86effd640 1 -- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8700cd940 msgr2=0x7ff858005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86effd640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8700cd940 0x7ff858005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86effd640 1 -- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858003c10 msgr2=0x7ff858004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86effd640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858003c10 0x7ff858004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.038+0000 7ff86effd640 1 -- 172.21.15.16:0/2256168332 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff858003520 con 0x7ff858004800 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.039+0000 7ff86effd640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff858004800 0x7ff858004c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff864009ac0 tx=0x7ff858005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cc8eedba47e278 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.039+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864036070 con 0x7ff858004800 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.039+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff864031400 con 0x7ff858004800 2024-05-11T01:02:00.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.039+0000 7ff86e7fc640 1 -- 172.21.15.16:0/2256168332 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864009690 con 0x7ff858004800 2024-05-11T01:02:00.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.040+0000 7ff876062640 1 -- 172.21.15.16:0/2256168332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff858004800 msgr2=0x7ff858004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.040+0000 7ff876062640 1 --2- 172.21.15.16:0/2256168332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff858004800 0x7ff858004c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff864009ac0 tx=0x7ff858005830 comp rx=0 tx=0).stop 2024-05-11T01:02:00.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.040+0000 7ff86ffff640 1 -- 172.21.15.16:0/2256168332 reap_dead start 2024-05-11T01:02:00.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.040+0000 7ff876062640 1 -- 172.21.15.16:0/2256168332 shutdown_connections 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.040+0000 7ff876062640 1 -- 172.21.15.16:0/2256168332 >> 172.21.15.16:0/2256168332 conn(0x7ff87006c3e0 msgr2=0x7ff87006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.040+0000 7ff876062640 1 -- 172.21.15.16:0/2256168332 shutdown_connections 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.040+0000 7ff876062640 1 -- 172.21.15.16:0/2256168332 wait complete. 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.041+0000 7ff876062640 1 Processor -- start 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.041+0000 7ff876062640 1 -- start start 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff876062640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858004800 0x7ff87013ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff876062640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff87015c690 0x7ff87015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff876062640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8701565d0 0x7ff870156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff876062640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8700b2d40 con 0x7ff8701565d0 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff876062640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff8701406b0 con 0x7ff858004800 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff876062640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff8700b2ec0 con 0x7ff87015c690 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8701565d0 0x7ff870156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8701565d0 0x7ff870156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52262/0 (socket says 172.21.15.16:52262) 2024-05-11T01:02:00.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86ffff640 1 -- 172.21.15.16:0/1966837437 learned_addr learned my addr 172.21.15.16:0/1966837437 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:00.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86effd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff87015c690 0x7ff87015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86f7fe640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858004800 0x7ff87013ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86f7fe640 1 -- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff87015c690 msgr2=0x7ff87015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86f7fe640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff87015c690 0x7ff87015cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86f7fe640 1 -- 172.21.15.16:0/1966837437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8701565d0 msgr2=0x7ff870156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.042+0000 7ff86f7fe640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8701565d0 0x7ff870156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.043+0000 7ff86f7fe640 1 -- 172.21.15.16:0/1966837437 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8700726f0 con 0x7ff858004800 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.043+0000 7ff86ffff640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8701565d0 0x7ff870156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.043+0000 7ff86f7fe640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858004800 0x7ff87013ac10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff8600072c0 tx=0x7ff860007780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.043+0000 7ff857fff640 1 -- 172.21.15.16:0/1966837437 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86000f960 con 0x7ff858004800 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.043+0000 7ff857fff640 1 -- 172.21.15.16:0/1966837437 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff860018070 con 0x7ff858004800 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.043+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8700729d0 con 0x7ff858004800 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.043+0000 7ff857fff640 1 -- 172.21.15.16:0/1966837437 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86000fd40 con 0x7ff858004800 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.043+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff870072f90 con 0x7ff858004800 2024-05-11T01:02:00.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.044+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff87006a5b0 con 0x7ff858004800 2024-05-11T01:02:00.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.045+0000 7ff857fff640 1 -- 172.21.15.16:0/1966837437 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) ==== 98218+0+0 (secure 0 0 0) 0x7ff86001d460 con 0x7ff858004800 2024-05-11T01:02:00.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.045+0000 7ff857fff640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff85c076350 0x7ff85c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.045+0000 7ff86effd640 1 -- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff85c076350 msgr2=0x7ff85c078810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/704865226 2024-05-11T01:02:00.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.045+0000 7ff857fff640 1 -- 172.21.15.16:0/1966837437 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff860097500 con 0x7ff858004800 2024-05-11T01:02:00.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.045+0000 7ff86effd640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff85c076350 0x7ff85c078810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:02:00.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.050+0000 7ff857fff640 1 -- 172.21.15.16:0/1966837437 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff860060810 con 0x7ff858004800 2024-05-11T01:02:00.053 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:00.053+0000 7fb2cb709040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-11T01:02:00.090 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:00.091+0000 7f875b520040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-11T01:02:00.096 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:00.096+0000 7fb2cb709040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-11T01:02:00.137 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:00.137+0000 7f875b520040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-11T01:02:00.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.245+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7ff8700b3ad0 con 0x7ff858004800 2024-05-11T01:02:00.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.246+0000 7ff86effd640 1 -- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff85c076350 msgr2=0x7ff85c078810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/704865226 2024-05-11T01:02:00.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.246+0000 7ff86effd640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff85c076350 0x7ff85c078810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:02:00.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.249+0000 7ff857fff640 1 -- 172.21.15.16:0/1966837437 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) ==== 133+0+0 (secure 0 0 0) 0x7ff860064b10 con 0x7ff858004800 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff85c076350 msgr2=0x7ff85c078810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff85c076350 0x7ff85c078810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858004800 msgr2=0x7ff87013ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858004800 0x7ff87013ac10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff8600072c0 tx=0x7ff860007780 comp rx=0 tx=0).stop 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 shutdown_connections 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7ff85c076350 0x7ff85c078810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8701565d0 0x7ff870156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff87015c690 0x7ff87015cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 --2- 172.21.15.16:0/1966837437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff858004800 0x7ff87013ac10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 >> 172.21.15.16:0/1966837437 conn(0x7ff87006c3e0 msgr2=0x7ff8700b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:00.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 shutdown_connections 2024-05-11T01:02:00.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.252+0000 7ff876062640 1 -- 172.21.15.16:0/1966837437 wait complete. 2024-05-11T01:02:00.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:00.263 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-05-11T01:02:00.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:00.283 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2024-05-11T01:02:00.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir0 1m 2024-05-11T01:02:00.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.490+0000 7f9e08c7e640 1 Processor -- start 2024-05-11T01:02:00.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.490+0000 7f9e08c7e640 1 -- start start 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e08c7e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9e040cfb10 0x7f9e040b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e08c7e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e040b4e90 0x7f9e0415f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e08c7e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e040cfff0 con 0x7f9e0415ba00 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e08c7e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9e040d02d0 con 0x7f9e040cfb10 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e08c7e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9e040d05b0 con 0x7f9e040b4e90 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e01d9b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9e040cfb10 0x7f9e040b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e01d9b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9e040cfb10 0x7f9e040b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52280/0 (socket says 172.21.15.16:52280) 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e01d9b640 1 -- 172.21.15.16:0/1614138736 learned_addr learned my addr 172.21.15.16:0/1614138736 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.491+0000 7f9e02d9d640 1 --2- 172.21.15.16:0/1614138736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e040b4e90 0x7f9e0415f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e01d9b640 1 -- 172.21.15.16:0/1614138736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e040b4e90 msgr2=0x7f9e0415f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:00.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1614138736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e040b4e90 0x7f9e0415f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e01d9b640 1 -- 172.21.15.16:0/1614138736 >> v1:172.21.15.16:6789/0 conn(0x7f9e0415ba00 legacy=0x7f9e040d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e01d9b640 1 -- 172.21.15.16:0/1614138736 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e040d0890 con 0x7f9e040cfb10 2024-05-11T01:02:00.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e0159a640 1 -- 172.21.15.16:0/1614138736 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919232905 0 0) 0x7f9e040cfff0 con 0x7f9e0415ba00 2024-05-11T01:02:00.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e02d9d640 1 --2- 172.21.15.16:0/1614138736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e040b4e90 0x7f9e0415f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:00.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1614138736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040cfb10 0x7f9e040b4950 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009870 tx=0x7f9df802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13933165fb0bf84 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:00.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e0159a640 1 -- 172.21.15.16:0/1614138736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8037070 con 0x7f9e040cfb10 2024-05-11T01:02:00.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e0159a640 1 -- 172.21.15.16:0/1614138736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df8032440 con 0x7f9e040cfb10 2024-05-11T01:02:00.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.492+0000 7f9e0159a640 1 -- 172.21.15.16:0/1614138736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8032810 con 0x7f9e040cfb10 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.493+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1614138736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040cfb10 msgr2=0x7f9e040b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.493+0000 7f9e08c7e640 1 --2- 172.21.15.16:0/1614138736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040cfb10 0x7f9e040b4950 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009870 tx=0x7f9df802a270 comp rx=0 tx=0).stop 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.493+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1614138736 shutdown_connections 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.493+0000 7f9e08c7e640 1 --2- 172.21.15.16:0/1614138736 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e040b4e90 0x7f9e0415f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.493+0000 7f9e08c7e640 1 --2- 172.21.15.16:0/1614138736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040cfb10 0x7f9e040b4950 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.493+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1614138736 >> 172.21.15.16:0/1614138736 conn(0x7f9e04073af0 msgr2=0x7f9e0406c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.493+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1614138736 shutdown_connections 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.493+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1614138736 wait complete. 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.495+0000 7f9e08c7e640 1 Processor -- start 2024-05-11T01:02:00.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.495+0000 7f9e08c7e640 1 -- start start 2024-05-11T01:02:00.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.495+0000 7f9e08c7e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040b4e90 0x7f9e041586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.495+0000 7f9e08c7e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e040cfb10 0x7f9e04147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e08c7e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0415ba00 0x7f9e0415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e08c7e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9e040b0d40 con 0x7f9e040b4e90 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e08c7e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9e040b5340 con 0x7f9e040cfb10 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e08c7e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9e040b0ec0 con 0x7f9e0415ba00 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040b4e90 0x7f9e041586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040b4e90 0x7f9e041586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:52282/0 (socket says 172.21.15.16:52282) 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 -- 172.21.15.16:0/1546079594 learned_addr learned my addr 172.21.15.16:0/1546079594 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e040cfb10 0x7f9e04147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e02d9d640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0415ba00 0x7f9e0415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0415ba00 msgr2=0x7f9e0415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e0415ba00 0x7f9e0415cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e040cfb10 msgr2=0x7f9e04147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e040cfb10 0x7f9e04147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 -- 172.21.15.16:0/1546079594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0415d680 con 0x7f9e040b4e90 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e0259c640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040b4e90 0x7f9e041586e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c3f0 tx=0x7f9df400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df4017070 con 0x7f9e040b4e90 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df40035f0 con 0x7f9e040b4e90 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0415d960 con 0x7f9e040b4e90 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df40039e0 con 0x7f9e040b4e90 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.496+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e0415df20 con 0x7f9e040b4e90 2024-05-11T01:02:00.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.498+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0406a5b0 con 0x7f9e040b4e90 2024-05-11T01:02:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.498+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 6) ==== 98218+0+0 (secure 0 0 0) 0x7f9df401a070 con 0x7f9e040b4e90 2024-05-11T01:02:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.499+0000 7f9df2ffd640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 0x7f9de4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.499+0000 7f9e01d9b640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 msgr2=0x7f9de4078830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/704865226 2024-05-11T01:02:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.499+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9df405c2d0 con 0x7f9e040b4e90 2024-05-11T01:02:00.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.499+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 0x7f9de4078830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:02:00.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.504+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9df405fce0 con 0x7f9e040b4e90 2024-05-11T01:02:00.583 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:00.583+0000 7fb2cb709040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-11T01:02:00.663 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:00.663+0000 7f875b520040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-11T01:02:00.667 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:00.667+0000 7fb2cb709040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-11T01:02:00.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.700+0000 7f9e01d9b640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 msgr2=0x7f9de4078830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/704865226 2024-05-11T01:02:00.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.700+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 0x7f9de4078830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:02:00.709 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:00.709+0000 7fb2cb709040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-11T01:02:00.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:00.722+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 --> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir0", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9e0415f1e0 con 0x7f9de4076370 2024-05-11T01:02:00.752 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:00.752+0000 7f875b520040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-11T01:02:00.796 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:00.796+0000 7f875b520040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-11T01:02:00.871 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:00.871+0000 7fb2cb709040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-11T01:02:00.916 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:00.916+0000 7fb2cb709040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-11T01:02:00.966 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:00.965+0000 7fb2cb709040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-11T01:02:00.967 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:00.968+0000 7f875b520040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-11T01:02:01.014 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:01.015+0000 7f875b520040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-11T01:02:01.066 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:01.066+0000 7f875b520040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-11T01:02:01.077 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:01.076+0000 7fb2cb709040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:02:01.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:01.101+0000 7f9e01d9b640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 msgr2=0x7f9de4078830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/704865226 2024-05-11T01:02:01.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:01.101+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 0x7f9de4078830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-11T01:02:01.181 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:01.182+0000 7f875b520040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:02:01.397 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:01.397+0000 7fb2cb709040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-11T01:02:01.518 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:01.519+0000 7f875b520040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-11T01:02:01.520 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:01.520+0000 7fb2cb709040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-11T01:02:01.647 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:01.648+0000 7f875b520040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-11T01:02:01.730 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:01.730+0000 7fb2cb709040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-11T01:02:01.780 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:01.779+0000 7fb2cb709040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-11T01:02:01.868 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:01.868+0000 7f875b520040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-11T01:02:01.893 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:01.893+0000 7fb2cb709040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-11T01:02:01.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:01.902+0000 7f9e01d9b640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 msgr2=0x7f9de4078830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/704865226 2024-05-11T01:02:01.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:01.902+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 0x7f9de4078830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-11T01:02:01.920 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:01.920+0000 7f875b520040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-11T01:02:02.040 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:02.040+0000 7f875b520040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-11T01:02:02.163 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:02.162+0000 7fb2cb709040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-11T01:02:02.206 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:02.206+0000 7fb2cb709040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-11T01:02:02.324 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:02.324+0000 7f875b520040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-11T01:02:02.350 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:02.350+0000 7fb2cb709040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-11T01:02:02.369 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:02.370+0000 7f875b520040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-11T01:02:02.482 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:02.482+0000 7fb2cb709040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-11T01:02:02.520 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:02.520+0000 7f875b520040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-11T01:02:02.530 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:02.530+0000 7fb2cb709040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-11T01:02:02.584 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:02.583+0000 7fb2cb709040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-11T01:02:02.627 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:02.627+0000 7fb2cb709040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-11T01:02:02.661 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:02.661+0000 7f875b520040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-11T01:02:02.712 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:02.712+0000 7f875b520040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-11T01:02:02.768 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:02.768+0000 7f875b520040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-11T01:02:02.813 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:02.813+0000 7f875b520040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-11T01:02:03.016 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.015+0000 7fb2cb709040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-11T01:02:03.132 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.131+0000 7fb2cb709040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-11T01:02:03.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:03.141+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 7) ==== 97929+0+0 (secure 0 0 0) 0x7f9df401a070 con 0x7f9e040b4e90 2024-05-11T01:02:03.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:03.141+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 msgr2=0x7f9de4078830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:02:03.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:03.141+0000 7f9df2ffd640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/704865226,v1:172.21.15.174:6833/704865226] conn(0x7f9de4076370 0x7f9de4078830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:03.237 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:03.237+0000 7f875b520040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-11T01:02:03.281 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.280+0000 7fb24a1b8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.281 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.280+0000 7fb24a1b8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.281 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.280+0000 7fb24a1b8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.281 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.280+0000 7fb24a1b8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.281 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.280+0000 7fb24a1b8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.281 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.281+0000 7fb2471b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.281 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.281+0000 7fb2471b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.281 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.281+0000 7fb2471b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.282 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.281+0000 7fb2471b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.282 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:02:03.281+0000 7fb2471b2640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:02:03.365 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:02:03.365+0000 7f875b520040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-11T01:02:04.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.146+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mgrmap(e 8) ==== 98056+0+0 (secure 0 0 0) 0x7f9df403b570 con 0x7f9e040b4e90 2024-05-11T01:02:04.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.146+0000 7f9df2ffd640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9de403b870 0x7f9de4081570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.146+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir0", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9de402b170 con 0x7f9de403b870 2024-05-11T01:02:04.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.148+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9de403b870 0x7f9de4081570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.151+0000 7f9e01d9b640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9de403b870 0x7f9de4081570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9df8034000 tx=0x7f9df802e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:04.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.223+0000 7f9df2ffd640 1 -- 172.21.15.16:0/1546079594 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9de402b170 con 0x7f9de403b870 2024-05-11T01:02:04.223 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir0 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9de403b870 msgr2=0x7f9de4081570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e08c7e640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9de403b870 0x7f9de4081570 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9df8034000 tx=0x7f9df802e000 comp rx=0 tx=0).stop 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040b4e90 msgr2=0x7f9e041586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e08c7e640 1 --2- 172.21.15.16:0/1546079594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e040b4e90 0x7f9e041586e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c3f0 tx=0x7f9df400c8b0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e02d9d640 1 -- 172.21.15.16:0/1546079594 reap_dead start 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 shutdown_connections 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 >> 172.21.15.16:0/1546079594 conn(0x7f9e04073af0 msgr2=0x7f9e041550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 shutdown_connections 2024-05-11T01:02:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.226+0000 7f9e08c7e640 1 -- 172.21.15.16:0/1546079594 wait complete. 2024-05-11T01:02:04.238 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2024-05-11T01:02:04.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:04.238 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2024-05-11T01:02:04.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir1 1m 2024-05-11T01:02:04.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.405+0000 7f7518259640 1 Processor -- start 2024-05-11T01:02:04.405 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.405+0000 7f7518259640 1 -- start start 2024-05-11T01:02:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7518259640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7510146d30 0x7f75100d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7518259640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75100d20d0 0x7f75100707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7518259640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75100d2670 con 0x7f7510070ce0 2024-05-11T01:02:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7518259640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7510147110 con 0x7f7510146d30 2024-05-11T01:02:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7518259640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f75100d2950 con 0x7f75100d20d0 2024-05-11T01:02:04.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f75167f6640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7510070ce0 0x7f75100b4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58080/0 (socket says 172.21.15.16:58080) 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f75167f6640 1 -- 172.21.15.16:0/3956301349 learned_addr learned my addr 172.21.15.16:0/3956301349 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7515ff5640 1 --2- 172.21.15.16:0/3956301349 >> v2:172.21.15.174:3300/0 conn(0x7f7510146d30 0x7f75100d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f75157f4640 1 --2- 172.21.15.16:0/3956301349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75100d20d0 0x7f75100707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7514ff3640 1 -- 172.21.15.16:0/3956301349 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763504017 0 0) 0x7f75100d2670 con 0x7f7510070ce0 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7514ff3640 1 -- 172.21.15.16:0/3956301349 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74fc003520 con 0x7f7510070ce0 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7515ff5640 1 -- 172.21.15.16:0/3956301349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75100d20d0 msgr2=0x7f75100707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7515ff5640 1 --2- 172.21.15.16:0/3956301349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75100d20d0 0x7f75100707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7514ff3640 1 -- 172.21.15.16:0/3956301349 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3233988274 0 0) 0x7f74fc003520 con 0x7f7510070ce0 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7515ff5640 1 -- 172.21.15.16:0/3956301349 >> v1:172.21.15.16:6789/0 conn(0x7f7510070ce0 legacy=0x7f75100b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.406+0000 7f7515ff5640 1 -- 172.21.15.16:0/3956301349 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75100d2c30 con 0x7f7510146d30 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.407+0000 7f7515ff5640 1 --2- 172.21.15.16:0/3956301349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7510146d30 0x7f75100d1b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f750c0097a0 tx=0x7f750c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15c6de158f218ab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.407+0000 7f7514ff3640 1 -- 172.21.15.16:0/3956301349 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c037070 con 0x7f7510146d30 2024-05-11T01:02:04.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.407+0000 7f7514ff3640 1 -- 172.21.15.16:0/3956301349 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c02aba0 con 0x7f7510146d30 2024-05-11T01:02:04.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.407+0000 7f7514ff3640 1 -- 172.21.15.16:0/3956301349 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508001a70 con 0x7f7510146d30 2024-05-11T01:02:04.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.408+0000 7f7518259640 1 -- 172.21.15.16:0/3956301349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7510146d30 msgr2=0x7f75100d1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.408+0000 7f7518259640 1 --2- 172.21.15.16:0/3956301349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7510146d30 0x7f75100d1b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f750c0097a0 tx=0x7f750c02a110 comp rx=0 tx=0).stop 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.408+0000 7f7518259640 1 -- 172.21.15.16:0/3956301349 shutdown_connections 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.408+0000 7f7518259640 1 --2- 172.21.15.16:0/3956301349 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75100d20d0 0x7f75100707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.408+0000 7f7518259640 1 --2- 172.21.15.16:0/3956301349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7510146d30 0x7f75100d1b90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.408+0000 7f7518259640 1 -- 172.21.15.16:0/3956301349 >> 172.21.15.16:0/3956301349 conn(0x7f75100b8510 msgr2=0x7f75100b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.408+0000 7f7518259640 1 -- 172.21.15.16:0/3956301349 shutdown_connections 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.408+0000 7f7518259640 1 -- 172.21.15.16:0/3956301349 wait complete. 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.409+0000 7f7518259640 1 Processor -- start 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.409+0000 7f7518259640 1 -- start start 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7518259640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7510070ce0 0x7f75100b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7518259640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75100d20d0 0x7f751015b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7518259640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7510146d30 0x7f75100b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7518259640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f751015dbb0 con 0x7f7510070ce0 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7518259640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f751015da30 con 0x7f75100d20d0 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7518259640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f75100b76c0 con 0x7f7510146d30 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7515ff5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7510070ce0 0x7f75100b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7515ff5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7510070ce0 0x7f75100b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47814/0 (socket says 172.21.15.16:47814) 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7515ff5640 1 -- 172.21.15.16:0/477927522 learned_addr learned my addr 172.21.15.16:0/477927522 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f75167f6640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7510146d30 0x7f75100b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f75157f4640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75100d20d0 0x7f751015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7515ff5640 1 -- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7510146d30 msgr2=0x7f75100b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7515ff5640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7510146d30 0x7f75100b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7515ff5640 1 -- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75100d20d0 msgr2=0x7f751015b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7515ff5640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75100d20d0 0x7f751015b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.410+0000 7f7515ff5640 1 -- 172.21.15.16:0/477927522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751015b5a0 con 0x7f7510070ce0 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.411+0000 7f75167f6640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7510146d30 0x7f75100b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.411+0000 7f7515ff5640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7510070ce0 0x7f75100b1810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f750c0098c0 tx=0x7f750c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:04.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.411+0000 7f75067fc640 1 -- 172.21.15.16:0/477927522 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c037050 con 0x7f7510070ce0 2024-05-11T01:02:04.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.411+0000 7f75067fc640 1 -- 172.21.15.16:0/477927522 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750c043070 con 0x7f7510070ce0 2024-05-11T01:02:04.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.411+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7510140300 con 0x7f7510070ce0 2024-05-11T01:02:04.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.411+0000 7f75067fc640 1 -- 172.21.15.16:0/477927522 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c006e10 con 0x7f7510070ce0 2024-05-11T01:02:04.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.411+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751013cb60 con 0x7f7510070ce0 2024-05-11T01:02:04.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.412+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751006a5b0 con 0x7f7510070ce0 2024-05-11T01:02:04.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.412+0000 7f75067fc640 1 -- 172.21.15.16:0/477927522 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) ==== 98056+0+0 (secure 0 0 0) 0x7f750c03ca10 con 0x7f7510070ce0 2024-05-11T01:02:04.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.413+0000 7f75067fc640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74f4076170 0x7f74f4078630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.413+0000 7f75067fc640 1 -- 172.21.15.16:0/477927522 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f750c0b7db0 con 0x7f7510070ce0 2024-05-11T01:02:04.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.413+0000 7f75157f4640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74f4076170 0x7f74f4078630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.414+0000 7f75157f4640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74f4076170 0x7f74f4078630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7510070cb0 tx=0x7f7500008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:04.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.417+0000 7f75067fc640 1 -- 172.21.15.16:0/477927522 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f750c081950 con 0x7f7510070ce0 2024-05-11T01:02:04.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.630+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir1", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f751015ef40 con 0x7f74f4076170 2024-05-11T01:02:04.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.694+0000 7f75067fc640 1 -- 172.21.15.16:0/477927522 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f751015ef40 con 0x7f74f4076170 2024-05-11T01:02:04.694 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir1 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74f4076170 msgr2=0x7f74f4078630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74f4076170 0x7f74f4078630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7510070cb0 tx=0x7f7500008040 comp rx=0 tx=0).stop 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7510070ce0 msgr2=0x7f75100b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7510070ce0 0x7f75100b1810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f750c0098c0 tx=0x7f750c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 shutdown_connections 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74f4076170 0x7f74f4078630 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7510146d30 0x7f75100b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75100d20d0 0x7f751015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 --2- 172.21.15.16:0/477927522 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7510070ce0 0x7f75100b1810 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.696+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 >> 172.21.15.16:0/477927522 conn(0x7f75100b8510 msgr2=0x7f751015f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.697+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 shutdown_connections 2024-05-11T01:02:04.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.697+0000 7f7518259640 1 -- 172.21.15.16:0/477927522 wait complete. 2024-05-11T01:02:04.707 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2024-05-11T01:02:04.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:04.707 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2024-05-11T01:02:04.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir2 1m 2024-05-11T01:02:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.871+0000 7f0648f33640 1 Processor -- start 2024-05-11T01:02:04.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.871+0000 7f0648f33640 1 -- start start 2024-05-11T01:02:04.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.872+0000 7f0648f33640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06440707a0 0x7f0644070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.872+0000 7f0648f33640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f064406db00 0x7f064406df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.872+0000 7f0648f33640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0644149230 con 0x7f0644148e50 2024-05-11T01:02:04.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.872+0000 7f0648f33640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0644071140 con 0x7f064406db00 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.872+0000 7f0648f33640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0644163290 con 0x7f06440707a0 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.872+0000 7f0642d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f064406db00 0x7f064406df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.872+0000 7f0642d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f064406db00 0x7f064406df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47820/0 (socket says 172.21.15.16:47820) 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.872+0000 7f0642d9d640 1 -- 172.21.15.16:0/2778100382 learned_addr learned my addr 172.21.15.16:0/2778100382 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.873+0000 7f0642d9d640 1 -- 172.21.15.16:0/2778100382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06440707a0 msgr2=0x7f0644070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.873+0000 7f0641d9b640 1 --2- 172.21.15.16:0/2778100382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06440707a0 0x7f0644070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.873+0000 7f0642d9d640 1 --2- 172.21.15.16:0/2778100382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06440707a0 0x7f0644070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.873+0000 7f0642d9d640 1 -- 172.21.15.16:0/2778100382 >> v1:172.21.15.174:6789/0 conn(0x7f0644148e50 legacy=0x7f06440b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:04.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.873+0000 7f0642d9d640 1 -- 172.21.15.16:0/2778100382 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0644163570 con 0x7f064406db00 2024-05-11T01:02:04.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.873+0000 7f0642d9d640 1 --2- 172.21.15.16:0/2778100382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f064406db00 0x7f064406df90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f063c009870 tx=0x7f063c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01fa69f3b6cdc85 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.873+0000 7f064159a640 1 -- 172.21.15.16:0/2778100382 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c037070 con 0x7f064406db00 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f064159a640 1 -- 172.21.15.16:0/2778100382 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c032440 con 0x7f064406db00 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f064159a640 1 -- 172.21.15.16:0/2778100382 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c032810 con 0x7f064406db00 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f0648f33640 1 -- 172.21.15.16:0/2778100382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f064406db00 msgr2=0x7f064406df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f0648f33640 1 --2- 172.21.15.16:0/2778100382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f064406db00 0x7f064406df90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f063c009870 tx=0x7f063c02a1c0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f0648f33640 1 -- 172.21.15.16:0/2778100382 shutdown_connections 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f0648f33640 1 --2- 172.21.15.16:0/2778100382 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f064406db00 0x7f064406df90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f0648f33640 1 --2- 172.21.15.16:0/2778100382 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f06440707a0 0x7f0644070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f0648f33640 1 -- 172.21.15.16:0/2778100382 >> 172.21.15.16:0/2778100382 conn(0x7f06440b8510 msgr2=0x7f06440b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f0648f33640 1 -- 172.21.15.16:0/2778100382 shutdown_connections 2024-05-11T01:02:04.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.874+0000 7f0648f33640 1 -- 172.21.15.16:0/2778100382 wait complete. 2024-05-11T01:02:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0648f33640 1 Processor -- start 2024-05-11T01:02:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0648f33640 1 -- start start 2024-05-11T01:02:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0648f33640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f064406db00 0x7f06440b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0648f33640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06440707a0 0x7f06440b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0648f33640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0644148e50 0x7f06441421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0648f33640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f06440b6140 con 0x7f0644148e50 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0648f33640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0644163b30 con 0x7f06440707a0 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0648f33640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f06440b62c0 con 0x7f064406db00 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.876+0000 7f0642d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0644148e50 0x7f06441421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0642d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0644148e50 0x7f06441421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47822/0 (socket says 172.21.15.16:47822) 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0642d9d640 1 -- 172.21.15.16:0/2238668693 learned_addr learned my addr 172.21.15.16:0/2238668693 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f064259c640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f064406db00 0x7f06440b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0641d9b640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06440707a0 0x7f06440b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0642d9d640 1 -- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f064406db00 msgr2=0x7f06440b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0642d9d640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f064406db00 0x7f06440b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0642d9d640 1 -- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06440707a0 msgr2=0x7f06440b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0642d9d640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06440707a0 0x7f06440b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0642d9d640 1 -- 172.21.15.16:0/2238668693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06441e90c0 con 0x7f0644148e50 2024-05-11T01:02:04.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0642d9d640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0644148e50 0x7f06441421e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f063c009870 tx=0x7f063c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:04.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f063affd640 1 -- 172.21.15.16:0/2238668693 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c037040 con 0x7f0644148e50 2024-05-11T01:02:04.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f063affd640 1 -- 172.21.15.16:0/2238668693 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c042070 con 0x7f0644148e50 2024-05-11T01:02:04.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f063affd640 1 -- 172.21.15.16:0/2238668693 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c030bd0 con 0x7f0644148e50 2024-05-11T01:02:04.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06441e93a0 con 0x7f0644148e50 2024-05-11T01:02:04.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.877+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06441e9960 con 0x7f0644148e50 2024-05-11T01:02:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.878+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0644070c00 con 0x7f0644148e50 2024-05-11T01:02:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.879+0000 7f063affd640 1 -- 172.21.15.16:0/2238668693 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 8) ==== 98056+0+0 (secure 0 0 0) 0x7f063c02ad10 con 0x7f0644148e50 2024-05-11T01:02:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.879+0000 7f063affd640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0624076170 0x7f0624078630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.879+0000 7f063affd640 1 -- 172.21.15.16:0/2238668693 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f063c0b7c20 con 0x7f0644148e50 2024-05-11T01:02:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.880+0000 7f064259c640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0624076170 0x7f0624078630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:04.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.880+0000 7f064259c640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0624076170 0x7f0624078630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f063400b450 tx=0x7f063400d040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:04.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:04.884+0000 7f063affd640 1 -- 172.21.15.16:0/2238668693 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0644070c00 con 0x7f0644148e50 2024-05-11T01:02:05.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.097+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir2", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f064406a5b0 con 0x7f0624076170 2024-05-11T01:02:05.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.158+0000 7f063affd640 1 -- 172.21.15.16:0/2238668693 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f064406a5b0 con 0x7f0624076170 2024-05-11T01:02:05.158 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir2 2024-05-11T01:02:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0624076170 msgr2=0x7f0624078630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0624076170 0x7f0624078630 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f063400b450 tx=0x7f063400d040 comp rx=0 tx=0).stop 2024-05-11T01:02:05.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0644148e50 msgr2=0x7f06441421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0644148e50 0x7f06441421e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f063c009870 tx=0x7f063c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 shutdown_connections 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0624076170 0x7f0624078630 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0644148e50 0x7f06441421e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06440707a0 0x7f06440b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 --2- 172.21.15.16:0/2238668693 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f064406db00 0x7f06440b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 >> 172.21.15.16:0/2238668693 conn(0x7f06440b8510 msgr2=0x7f0644160450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 shutdown_connections 2024-05-11T01:02:05.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.160+0000 7f0648f33640 1 -- 172.21.15.16:0/2238668693 wait complete. 2024-05-11T01:02:05.171 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2024-05-11T01:02:05.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:05.172 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2024-05-11T01:02:05.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir3 1m 2024-05-11T01:02:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.337+0000 7f9c6a0fc640 1 Processor -- start 2024-05-11T01:02:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.337+0000 7f9c6a0fc640 1 -- start start 2024-05-11T01:02:05.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c6a0fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 0x7f9c640d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c6a0fc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9c6415fd00 0x7f9c640b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c6a0fc640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c640d2e30 con 0x7f9c64160180 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c6a0fc640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f9c640d3460 con 0x7f9c6415fd00 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c6a0fc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9c64160750 con 0x7f9c640d16c0 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c63fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9c64160180 0x7f9c6406d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58088/0 (socket says 172.21.15.16:58088) 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c63fff640 1 -- 172.21.15.16:0/2977006027 learned_addr learned my addr 172.21.15.16:0/2977006027 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c637fe640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 0x7f9c640d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c62ffd640 1 --2- 172.21.15.16:0/2977006027 >> v2:172.21.15.174:3300/0 conn(0x7f9c6415fd00 0x7f9c640b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767201832 0 0) 0x7f9c640d2e30 con 0x7f9c64160180 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.338+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c4c003520 con 0x7f9c64160180 2024-05-11T01:02:05.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 586978258 0 0) 0x7f9c4c003520 con 0x7f9c64160180 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 msgr2=0x7f9c640d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 0x7f9c640d38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 >> v2:172.21.15.174:3300/0 conn(0x7f9c6415fd00 msgr2=0x7f9c640b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 --2- 172.21.15.16:0/2977006027 >> v2:172.21.15.174:3300/0 conn(0x7f9c6415fd00 0x7f9c640b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c64160a30 con 0x7f9c64160180 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f9c5c001a70 con 0x7f9c64160180 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 >> v1:172.21.15.16:6789/0 conn(0x7f9c64160180 legacy=0x7f9c6406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 0x7f9c4c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c4c003fd0 0x7f9c4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c004d40 0x7f9c4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c640d3460 con 0x7f9c4c003fd0 2024-05-11T01:02:05.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9c64160750 con 0x7f9c4c004d40 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4c00ba10 con 0x7f9c640d16c0 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c62ffd640 1 --2- 172.21.15.16:0/2977006027 >> v2:172.21.15.174:3300/0 conn(0x7f9c6415fd00 0x7f9c640b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c637fe640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 0x7f9c4c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c62ffd640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c4c003fd0 0x7f9c4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c63fff640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c004d40 0x7f9c4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c62ffd640 1 -- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 msgr2=0x7f9c4c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c62ffd640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 0x7f9c4c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c62ffd640 1 -- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c004d40 msgr2=0x7f9c4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c62ffd640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c004d40 0x7f9c4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c62ffd640 1 -- 172.21.15.16:0/2977006027 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c003520 con 0x7f9c4c003fd0 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.339+0000 7f9c637fe640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c640d16c0 0x7f9c4c003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:02:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.340+0000 7f9c62ffd640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c4c003fd0 0x7f9c4c004800 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009ca0 tx=0x7f9c4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb4d62a69e11cb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.340+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58009840 con 0x7f9c4c003fd0 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.340+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c58004020 con 0x7f9c4c003fd0 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.340+0000 7f9c627fc640 1 -- 172.21.15.16:0/2977006027 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c580043d0 con 0x7f9c4c003fd0 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.341+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/2977006027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c4c003fd0 msgr2=0x7f9c4c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.341+0000 7f9c6a0fc640 1 --2- 172.21.15.16:0/2977006027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c4c003fd0 0x7f9c4c004800 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009ca0 tx=0x7f9c4c005830 comp rx=0 tx=0).stop 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.341+0000 7f9c63fff640 1 -- 172.21.15.16:0/2977006027 reap_dead start 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.341+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/2977006027 shutdown_connections 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.341+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/2977006027 >> 172.21.15.16:0/2977006027 conn(0x7f9c640681c0 msgr2=0x7f9c640685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.341+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/2977006027 shutdown_connections 2024-05-11T01:02:05.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.341+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/2977006027 wait complete. 2024-05-11T01:02:05.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.342+0000 7f9c6a0fc640 1 Processor -- start 2024-05-11T01:02:05.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.342+0000 7f9c6a0fc640 1 -- start start 2024-05-11T01:02:05.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c6a0fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c4c003fd0 0x7f9c64153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c6a0fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640b5d70 0x7f9c6415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c6a0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c640b7360 0x7f9c640b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c6a0fc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6406f3d0 con 0x7f9c640b7360 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c6a0fc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6406f250 con 0x7f9c640b5d70 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c6a0fc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9c6406dc00 con 0x7f9c4c003fd0 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c640b7360 0x7f9c640b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c640b7360 0x7f9c640b77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47828/0 (socket says 172.21.15.16:47828) 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c63fff640 1 -- 172.21.15.16:0/350143372 learned_addr learned my addr 172.21.15.16:0/350143372 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c62ffd640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640b5d70 0x7f9c6415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c637fe640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c4c003fd0 0x7f9c64153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c63fff640 1 -- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c4c003fd0 msgr2=0x7f9c64153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c63fff640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c4c003fd0 0x7f9c64153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c63fff640 1 -- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640b5d70 msgr2=0x7f9c6415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c63fff640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640b5d70 0x7f9c6415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c63fff640 1 -- 172.21.15.16:0/350143372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6415d200 con 0x7f9c640b7360 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.343+0000 7f9c637fe640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c4c003fd0 0x7f9c64153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:05.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.344+0000 7f9c63fff640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c640b7360 0x7f9c640b77e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c000f80 tx=0x7f9c5c007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.344+0000 7f9c4bfff640 1 -- 172.21.15.16:0/350143372 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54009690 con 0x7f9c640b7360 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.344+0000 7f9c4bfff640 1 -- 172.21.15.16:0/350143372 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c5c018070 con 0x7f9c640b7360 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.344+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c640b62c0 con 0x7f9c640b7360 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.344+0000 7f9c4bfff640 1 -- 172.21.15.16:0/350143372 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00ad40 con 0x7f9c640b7360 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.344+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c640b6880 con 0x7f9c640b7360 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.345+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c6415c0d0 con 0x7f9c640b7360 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.345+0000 7f9c4bfff640 1 -- 172.21.15.16:0/350143372 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 9) ==== 98321+0+0 (secure 0 0 0) 0x7f9c5c01d460 con 0x7f9c640b7360 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.346+0000 7f9c4bfff640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9c50076440 0x7f9c50078900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.346+0000 7f9c4bfff640 1 -- 172.21.15.16:0/350143372 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f9c5c097b80 con 0x7f9c640b7360 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.346+0000 7f9c637fe640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9c50076440 0x7f9c50078900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.347+0000 7f9c637fe640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9c50076440 0x7f9c50078900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009c80 tx=0x7f9c54008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:05.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.350+0000 7f9c4bfff640 1 -- 172.21.15.16:0/350143372 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c6415c0d0 con 0x7f9c640b7360 2024-05-11T01:02:05.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.563+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir3", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9c640d06f0 con 0x7f9c50076440 2024-05-11T01:02:05.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.633+0000 7f9c4bfff640 1 -- 172.21.15.16:0/350143372 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9c640d06f0 con 0x7f9c50076440 2024-05-11T01:02:05.633 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir3 2024-05-11T01:02:05.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9c50076440 msgr2=0x7f9c50078900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9c50076440 0x7f9c50078900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009c80 tx=0x7f9c54008040 comp rx=0 tx=0).stop 2024-05-11T01:02:05.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c640b7360 msgr2=0x7f9c640b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c640b7360 0x7f9c640b77e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c000f80 tx=0x7f9c5c007b20 comp rx=0 tx=0).stop 2024-05-11T01:02:05.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 shutdown_connections 2024-05-11T01:02:05.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f9c50076440 0x7f9c50078900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c640b7360 0x7f9c640b77e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c640b5d70 0x7f9c6415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 --2- 172.21.15.16:0/350143372 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9c4c003fd0 0x7f9c64153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 >> 172.21.15.16:0/350143372 conn(0x7f9c640681c0 msgr2=0x7f9c64163060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:05.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 shutdown_connections 2024-05-11T01:02:05.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.635+0000 7f9c6a0fc640 1 -- 172.21.15.16:0/350143372 wait complete. 2024-05-11T01:02:05.646 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2024-05-11T01:02:05.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:05.646 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2024-05-11T01:02:05.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir4 1m 2024-05-11T01:02:05.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.810+0000 7fc2ac314640 1 Processor -- start 2024-05-11T01:02:05.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.810+0000 7fc2ac314640 1 -- start start 2024-05-11T01:02:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.811+0000 7fc2ac314640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2a40bae40 0x7fc2a41604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.811+0000 7fc2ac314640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a41609e0 con 0x7fc2a4163010 2024-05-11T01:02:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.811+0000 7fc2ac314640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a41635d0 con 0x7fc2a40b7490 2024-05-11T01:02:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.811+0000 7fc2ac314640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a41638b0 con 0x7fc2a40bae40 2024-05-11T01:02:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2a98af640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc2a4163010 0x7fc2a40b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58098/0 (socket says 172.21.15.16:58098) 2024-05-11T01:02:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2a98af640 1 -- 172.21.15.16:0/2279993602 learned_addr learned my addr 172.21.15.16:0/2279993602 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2aa0b0640 1 --2- 172.21.15.16:0/2279993602 >> v2:172.21.15.174:3300/0 conn(0x7fc2a40bae40 0x7fc2a41604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2a90ae640 1 -- 172.21.15.16:0/2279993602 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484710298 0 0) 0x7fc294001110 con 0x7fc2a4163010 2024-05-11T01:02:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2a90ae640 1 -- 172.21.15.16:0/2279993602 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc290003520 con 0x7fc2a4163010 2024-05-11T01:02:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2aa0b0640 1 -- 172.21.15.16:0/2279993602 >> v1:172.21.15.174:6789/0 conn(0x7fc2a40b7490 legacy=0x7fc2a40b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2aa0b0640 1 -- 172.21.15.16:0/2279993602 >> v1:172.21.15.16:6789/0 conn(0x7fc2a4163010 legacy=0x7fc2a40b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2a90ae640 1 -- 172.21.15.16:0/2279993602 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2191458117 0 0) 0x7fc290003520 con 0x7fc2a4163010 2024-05-11T01:02:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.812+0000 7fc2aa0b0640 1 -- 172.21.15.16:0/2279993602 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a4163b90 con 0x7fc2a40bae40 2024-05-11T01:02:05.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.813+0000 7fc2aa0b0640 1 --2- 172.21.15.16:0/2279993602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40bae40 0x7fc2a41604a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0097a0 tx=0x7fc29c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5883db5e8f602635 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.813+0000 7fc2a90ae640 1 -- 172.21.15.16:0/2279993602 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c037070 con 0x7fc2a40bae40 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.813+0000 7fc2a90ae640 1 -- 172.21.15.16:0/2279993602 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc29c02abc0 con 0x7fc2a40bae40 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.813+0000 7fc2a90ae640 1 -- 172.21.15.16:0/2279993602 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940018c0 con 0x7fc2a40bae40 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.814+0000 7fc2ac314640 1 -- 172.21.15.16:0/2279993602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40bae40 msgr2=0x7fc2a41604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.814+0000 7fc2ac314640 1 --2- 172.21.15.16:0/2279993602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40bae40 0x7fc2a41604a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0097a0 tx=0x7fc29c02a130 comp rx=0 tx=0).stop 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.814+0000 7fc2ac314640 1 -- 172.21.15.16:0/2279993602 shutdown_connections 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.814+0000 7fc2ac314640 1 --2- 172.21.15.16:0/2279993602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40bae40 0x7fc2a41604a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.814+0000 7fc2ac314640 1 -- 172.21.15.16:0/2279993602 >> 172.21.15.16:0/2279993602 conn(0x7fc2a4074140 msgr2=0x7fc2a40d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.814+0000 7fc2ac314640 1 -- 172.21.15.16:0/2279993602 shutdown_connections 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.814+0000 7fc2ac314640 1 -- 172.21.15.16:0/2279993602 wait complete. 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.815+0000 7fc2ac314640 1 Processor -- start 2024-05-11T01:02:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.815+0000 7fc2ac314640 1 -- start start 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2ac314640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40b7490 0x7fc2a40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2ac314640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a40bae40 0x7fc2a41f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2ac314640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a4163010 0x7fc2a415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2ac314640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a40d46f0 con 0x7fc2a4163010 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2ac314640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a40bb220 con 0x7fc2a40b7490 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2ac314640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a40d4870 con 0x7fc2a40bae40 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a4163010 0x7fc2a415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a4163010 0x7fc2a415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47842/0 (socket says 172.21.15.16:47842) 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 -- 172.21.15.16:0/1424532954 learned_addr learned my addr 172.21.15.16:0/1424532954 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:05.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa0b0640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40b7490 0x7fc2a40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2a98af640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a40bae40 0x7fc2a41f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 -- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a40bae40 msgr2=0x7fc2a41f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a40bae40 0x7fc2a41f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 -- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40b7490 msgr2=0x7fc2a40caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40b7490 0x7fc2a40caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 -- 172.21.15.16:0/1424532954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a415e150 con 0x7fc2a4163010 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2a98af640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a40bae40 0x7fc2a41f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc2aa8b1640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a4163010 0x7fc2a415d860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000c700 tx=0x7fc2a000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.816+0000 7fc29affd640 1 -- 172.21.15.16:0/1424532954 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0003b70 con 0x7fc2a4163010 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.817+0000 7fc29affd640 1 -- 172.21.15.16:0/1424532954 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a0003d10 con 0x7fc2a4163010 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.817+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a415e430 con 0x7fc2a4163010 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.817+0000 7fc29affd640 1 -- 172.21.15.16:0/1424532954 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000aa70 con 0x7fc2a4163010 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.817+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a415e9f0 con 0x7fc2a4163010 2024-05-11T01:02:05.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.817+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a406a5b0 con 0x7fc2a4163010 2024-05-11T01:02:05.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.818+0000 7fc29affd640 1 -- 172.21.15.16:0/1424532954 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 9) ==== 98321+0+0 (secure 0 0 0) 0x7fc2a000ac10 con 0x7fc2a4163010 2024-05-11T01:02:05.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.819+0000 7fc29affd640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc288076440 0x7fc288078900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:05.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.819+0000 7fc29affd640 1 -- 172.21.15.16:0/1424532954 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc2a0097660 con 0x7fc2a4163010 2024-05-11T01:02:05.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.819+0000 7fc2aa0b0640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc288076440 0x7fc288078900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:05.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.819+0000 7fc2aa0b0640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc288076440 0x7fc288078900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc29c034000 tx=0x7fc29c02e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:05.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:05.823+0000 7fc29affd640 1 -- 172.21.15.16:0/1424532954 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc2a0060e40 con 0x7fc2a4163010 2024-05-11T01:02:06.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.036+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir4", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc2a40d2fa0 con 0x7fc288076440 2024-05-11T01:02:06.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.104+0000 7fc29affd640 1 -- 172.21.15.16:0/1424532954 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fc2a40d2fa0 con 0x7fc288076440 2024-05-11T01:02:06.105 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir4 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.106+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc288076440 msgr2=0x7fc288078900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.106+0000 7fc2ac314640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc288076440 0x7fc288078900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc29c034000 tx=0x7fc29c02e000 comp rx=0 tx=0).stop 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.106+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a4163010 msgr2=0x7fc2a415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.106+0000 7fc2ac314640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a4163010 0x7fc2a415d860 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000c700 tx=0x7fc2a000cbc0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.107+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 shutdown_connections 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.107+0000 7fc2ac314640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc288076440 0x7fc288078900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.107+0000 7fc2ac314640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a4163010 0x7fc2a415d860 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.107+0000 7fc2ac314640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2a40bae40 0x7fc2a41f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.107+0000 7fc2ac314640 1 --2- 172.21.15.16:0/1424532954 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2a40b7490 0x7fc2a40caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.107+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 >> 172.21.15.16:0/1424532954 conn(0x7fc2a4074140 msgr2=0x7fc2a4158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.107+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 shutdown_connections 2024-05-11T01:02:06.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.107+0000 7fc2ac314640 1 -- 172.21.15.16:0/1424532954 wait complete. 2024-05-11T01:02:06.117 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2024-05-11T01:02:06.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:06.118 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2024-05-11T01:02:06.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir5 1m 2024-05-11T01:02:06.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.283+0000 7fa14b59e640 1 Processor -- start 2024-05-11T01:02:06.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.283+0000 7fa14b59e640 1 -- start start 2024-05-11T01:02:06.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa14b59e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa14c156850 0x7fa14c0b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa14b59e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa14c15fc20 con 0x7fa14c156470 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa14b59e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa14c15fec0 con 0x7fa14c0d1170 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa14b59e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c1601a0 con 0x7fa14c156850 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa149d9b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa14c156850 0x7fa14c0b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa14a59c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa14c156470 0x7fa14c073b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58112/0 (socket says 172.21.15.16:58112) 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa14a59c640 1 -- 172.21.15.16:0/580366528 learned_addr learned my addr 172.21.15.16:0/580366528 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa149d9b640 1 -- 172.21.15.16:0/580366528 >> v1:172.21.15.174:6789/0 conn(0x7fa14c0d1170 legacy=0x7fa14c0afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.284+0000 7fa149d9b640 1 -- 172.21.15.16:0/580366528 >> v1:172.21.15.16:6789/0 conn(0x7fa14c156470 legacy=0x7fa14c073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.285+0000 7fa149d9b640 1 -- 172.21.15.16:0/580366528 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c160480 con 0x7fa14c156850 2024-05-11T01:02:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.285+0000 7fa14959a640 1 -- 172.21.15.16:0/580366528 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905524459 0 0) 0x7fa14c15fc20 con 0x7fa14c156470 2024-05-11T01:02:06.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.285+0000 7fa149d9b640 1 --2- 172.21.15.16:0/580366528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156850 0x7fa14c0b3cc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa1400097a0 tx=0x7fa14002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd410fb23ff020b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.285+0000 7fa14959a640 1 -- 172.21.15.16:0/580366528 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140037070 con 0x7fa14c156850 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.285+0000 7fa14959a640 1 -- 172.21.15.16:0/580366528 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa140032440 con 0x7fa14c156850 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.285+0000 7fa14959a640 1 -- 172.21.15.16:0/580366528 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140032810 con 0x7fa14c156850 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.286+0000 7fa14b59e640 1 -- 172.21.15.16:0/580366528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156850 msgr2=0x7fa14c0b3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.286+0000 7fa14b59e640 1 --2- 172.21.15.16:0/580366528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156850 0x7fa14c0b3cc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa1400097a0 tx=0x7fa14002a180 comp rx=0 tx=0).stop 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.286+0000 7fa14b59e640 1 -- 172.21.15.16:0/580366528 shutdown_connections 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.286+0000 7fa14b59e640 1 --2- 172.21.15.16:0/580366528 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156850 0x7fa14c0b3cc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.286+0000 7fa14b59e640 1 -- 172.21.15.16:0/580366528 >> 172.21.15.16:0/580366528 conn(0x7fa14c06c800 msgr2=0x7fa14c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.286+0000 7fa14b59e640 1 -- 172.21.15.16:0/580366528 shutdown_connections 2024-05-11T01:02:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.286+0000 7fa14b59e640 1 -- 172.21.15.16:0/580366528 wait complete. 2024-05-11T01:02:06.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.287+0000 7fa14b59e640 1 Processor -- start 2024-05-11T01:02:06.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.287+0000 7fa14b59e640 1 -- start start 2024-05-11T01:02:06.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa14b59e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14c0d1170 0x7fa14c148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa14b59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156470 0x7fa14c0ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa14b59e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa14c156850 0x7fa14c0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa14b59e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c074270 con 0x7fa14c156470 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa14b59e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c160a40 con 0x7fa14c156850 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa14b59e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c0743f0 con 0x7fa14c0d1170 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa149d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156470 0x7fa14c0ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa149d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156470 0x7fa14c0ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47860/0 (socket says 172.21.15.16:47860) 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa149d9b640 1 -- 172.21.15.16:0/3393464140 learned_addr learned my addr 172.21.15.16:0/3393464140 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa14ad9d640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa14c156850 0x7fa14c0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.288+0000 7fa14a59c640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14c0d1170 0x7fa14c148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa149d9b640 1 -- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14c0d1170 msgr2=0x7fa14c148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa149d9b640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14c0d1170 0x7fa14c148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa149d9b640 1 -- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa14c156850 msgr2=0x7fa14c0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa149d9b640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa14c156850 0x7fa14c0ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa149d9b640 1 -- 172.21.15.16:0/3393464140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c1e7f60 con 0x7fa14c156470 2024-05-11T01:02:06.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa149d9b640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156470 0x7fa14c0ce2a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa1400097a0 tx=0x7fa1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:06.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa13affd640 1 -- 172.21.15.16:0/3393464140 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140041070 con 0x7fa14c156470 2024-05-11T01:02:06.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa13affd640 1 -- 172.21.15.16:0/3393464140 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa14003c870 con 0x7fa14c156470 2024-05-11T01:02:06.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c1e8240 con 0x7fa14c156470 2024-05-11T01:02:06.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa13affd640 1 -- 172.21.15.16:0/3393464140 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa140037040 con 0x7fa14c156470 2024-05-11T01:02:06.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.289+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c1e8800 con 0x7fa14c156470 2024-05-11T01:02:06.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.290+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14c0508d0 con 0x7fa14c156470 2024-05-11T01:02:06.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.291+0000 7fa13affd640 1 -- 172.21.15.16:0/3393464140 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 9) ==== 98321+0+0 (secure 0 0 0) 0x7fa140044070 con 0x7fa14c156470 2024-05-11T01:02:06.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.291+0000 7fa13affd640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa12c076470 0x7fa12c078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.292+0000 7fa13affd640 1 -- 172.21.15.16:0/3393464140 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa1400b8390 con 0x7fa14c156470 2024-05-11T01:02:06.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.292+0000 7fa14a59c640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa12c076470 0x7fa12c078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.292+0000 7fa14a59c640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa12c076470 0x7fa12c078930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa13c000f60 tx=0x7fa13c009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:06.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.296+0000 7fa13affd640 1 -- 172.21.15.16:0/3393464140 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa140081490 con 0x7fa14c156470 2024-05-11T01:02:06.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.510+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir5", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa14c072f20 con 0x7fa12c076470 2024-05-11T01:02:06.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.575+0000 7fa13affd640 1 -- 172.21.15.16:0/3393464140 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa14c072f20 con 0x7fa12c076470 2024-05-11T01:02:06.575 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir5 2024-05-11T01:02:06.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa12c076470 msgr2=0x7fa12c078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa12c076470 0x7fa12c078930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa13c000f60 tx=0x7fa13c009040 comp rx=0 tx=0).stop 2024-05-11T01:02:06.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156470 msgr2=0x7fa14c0ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156470 0x7fa14c0ce2a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa1400097a0 tx=0x7fa1400046c0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 shutdown_connections 2024-05-11T01:02:06.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa12c076470 0x7fa12c078930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa14c156850 0x7fa14c0ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa14c156470 0x7fa14c0ce2a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 --2- 172.21.15.16:0/3393464140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa14c0d1170 0x7fa14c148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 >> 172.21.15.16:0/3393464140 conn(0x7fa14c06c800 msgr2=0x7fa14c0b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:06.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 shutdown_connections 2024-05-11T01:02:06.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.577+0000 7fa14b59e640 1 -- 172.21.15.16:0/3393464140 wait complete. 2024-05-11T01:02:06.588 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2024-05-11T01:02:06.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:06.588 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2024-05-11T01:02:06.606 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir6 1m 2024-05-11T01:02:06.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.753+0000 7f5c4cb0a640 1 Processor -- start 2024-05-11T01:02:06.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.753+0000 7f5c4cb0a640 1 -- start start 2024-05-11T01:02:06.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c4cb0a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5c4815f390 0x7f5c480af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c4cb0a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c480afd20 con 0x7f5c4806db00 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c4cb0a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4806ed60 con 0x7f5c480b54e0 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c4cb0a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4806f040 con 0x7f5c4815f390 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c46d9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5c4806db00 0x7f5c4806f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58124/0 (socket says 172.21.15.16:58124) 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c46d9d640 1 -- 172.21.15.16:0/2997385755 learned_addr learned my addr 172.21.15.16:0/2997385755 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c4659c640 1 --2- 172.21.15.16:0/2997385755 >> v2:172.21.15.174:3300/0 conn(0x7f5c4815f390 0x7f5c480af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c4559a640 1 -- 172.21.15.16:0/2997385755 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229063530 0 0) 0x7f5c480afd20 con 0x7f5c4806db00 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.754+0000 7f5c4559a640 1 -- 172.21.15.16:0/2997385755 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c30003520 con 0x7f5c4806db00 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.755+0000 7f5c4559a640 1 -- 172.21.15.16:0/2997385755 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370505916 0 0) 0x7f5c4806ed60 con 0x7f5c480b54e0 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.755+0000 7f5c4559a640 1 -- 172.21.15.16:0/2997385755 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c480afd20 con 0x7f5c480b54e0 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.755+0000 7f5c4659c640 1 -- 172.21.15.16:0/2997385755 >> v1:172.21.15.174:6789/0 conn(0x7f5c480b54e0 legacy=0x7f5c4806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.755+0000 7f5c4659c640 1 -- 172.21.15.16:0/2997385755 >> v1:172.21.15.16:6789/0 conn(0x7f5c4806db00 legacy=0x7f5c4806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.755+0000 7f5c4559a640 1 -- 172.21.15.16:0/2997385755 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 278310714 0 0) 0x7f5c30003520 con 0x7f5c4806db00 2024-05-11T01:02:06.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.755+0000 7f5c4659c640 1 -- 172.21.15.16:0/2997385755 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4806f320 con 0x7f5c4815f390 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.755+0000 7f5c4659c640 1 --2- 172.21.15.16:0/2997385755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 0x7f5c480af3d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5c400097a0 tx=0x7f5c4002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc74e79a0c523323 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4559a640 1 -- 172.21.15.16:0/2997385755 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40037070 con 0x7f5c4815f390 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4559a640 1 -- 172.21.15.16:0/2997385755 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4002abc0 con 0x7f5c4815f390 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4559a640 1 -- 172.21.15.16:0/2997385755 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38001a70 con 0x7f5c4815f390 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/2997385755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 msgr2=0x7f5c480af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4cb0a640 1 --2- 172.21.15.16:0/2997385755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 0x7f5c480af3d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5c400097a0 tx=0x7f5c4002a130 comp rx=0 tx=0).stop 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/2997385755 shutdown_connections 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4cb0a640 1 --2- 172.21.15.16:0/2997385755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 0x7f5c480af3d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/2997385755 >> 172.21.15.16:0/2997385755 conn(0x7f5c48072bd0 msgr2=0x7f5c48072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:06.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/2997385755 shutdown_connections 2024-05-11T01:02:06.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.756+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/2997385755 wait complete. 2024-05-11T01:02:06.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.758+0000 7f5c4cb0a640 1 Processor -- start 2024-05-11T01:02:06.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.758+0000 7f5c4cb0a640 1 -- start start 2024-05-11T01:02:06.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.758+0000 7f5c4cb0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4806db00 0x7f5c4813fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.758+0000 7f5c4cb0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c480b54e0 0x7f5c481561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.758+0000 7f5c4cb0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 0x7f5c481586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.758+0000 7f5c4cb0a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5c480afa90 con 0x7f5c480b54e0 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.758+0000 7f5c4cb0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5c480af910 con 0x7f5c4815f390 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.758+0000 7f5c4cb0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4815f770 con 0x7f5c4806db00 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c480b54e0 0x7f5c481561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c480b54e0 0x7f5c481561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47874/0 (socket says 172.21.15.16:47874) 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 -- 172.21.15.16:0/1895716876 learned_addr learned my addr 172.21.15.16:0/1895716876 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c46d9d640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 0x7f5c481586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c4659c640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4806db00 0x7f5c4813fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 -- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4806db00 msgr2=0x7f5c4813fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4806db00 0x7f5c4813fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 -- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 msgr2=0x7f5c481586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 0x7f5c481586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:06.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 -- 172.21.15.16:0/1895716876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c48156ba0 con 0x7f5c480b54e0 2024-05-11T01:02:06.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c46d9d640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 0x7f5c481586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:06.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c45d9b640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c480b54e0 0x7f5c481561c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c480 tx=0x7f5c3c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:06.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c36ffd640 1 -- 172.21.15.16:0/1895716876 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0052d0 con 0x7f5c480b54e0 2024-05-11T01:02:06.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c36ffd640 1 -- 172.21.15.16:0/1895716876 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c005490 con 0x7f5c480b54e0 2024-05-11T01:02:06.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c48156e80 con 0x7f5c480b54e0 2024-05-11T01:02:06.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c36ffd640 1 -- 172.21.15.16:0/1895716876 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c012870 con 0x7f5c480b54e0 2024-05-11T01:02:06.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.759+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c48157440 con 0x7f5c480b54e0 2024-05-11T01:02:06.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.760+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4806a5b0 con 0x7f5c480b54e0 2024-05-11T01:02:06.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.761+0000 7f5c36ffd640 1 -- 172.21.15.16:0/1895716876 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 9) ==== 98321+0+0 (secure 0 0 0) 0x7f5c3c012a10 con 0x7f5c480b54e0 2024-05-11T01:02:06.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.761+0000 7f5c36ffd640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5c28076440 0x7f5c28078900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:06.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.762+0000 7f5c36ffd640 1 -- 172.21.15.16:0/1895716876 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5c3c097620 con 0x7f5c480b54e0 2024-05-11T01:02:06.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.762+0000 7f5c4659c640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5c28076440 0x7f5c28078900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:06.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.762+0000 7f5c4659c640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5c28076440 0x7f5c28078900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5c40034000 tx=0x7f5c4002e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:06.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.766+0000 7f5c36ffd640 1 -- 172.21.15.16:0/1895716876 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5c3c060cd0 con 0x7f5c480b54e0 2024-05-11T01:02:06.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:06.980+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir6", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5c480b1a90 con 0x7f5c28076440 2024-05-11T01:02:07.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.040+0000 7f5c36ffd640 1 -- 172.21.15.16:0/1895716876 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5c480b1a90 con 0x7f5c28076440 2024-05-11T01:02:07.040 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir6 2024-05-11T01:02:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5c28076440 msgr2=0x7f5c28078900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5c28076440 0x7f5c28078900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5c40034000 tx=0x7f5c4002e000 comp rx=0 tx=0).stop 2024-05-11T01:02:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c480b54e0 msgr2=0x7f5c481561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c480b54e0 0x7f5c481561c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c480 tx=0x7f5c3c00c940 comp rx=0 tx=0).stop 2024-05-11T01:02:07.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 shutdown_connections 2024-05-11T01:02:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5c28076440 0x7f5c28078900 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c4815f390 0x7f5c481586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c480b54e0 0x7f5c481561c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 --2- 172.21.15.16:0/1895716876 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5c4806db00 0x7f5c4813fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 >> 172.21.15.16:0/1895716876 conn(0x7f5c48072bd0 msgr2=0x7f5c4806d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 shutdown_connections 2024-05-11T01:02:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.042+0000 7f5c4cb0a640 1 -- 172.21.15.16:0/1895716876 wait complete. 2024-05-11T01:02:07.053 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2024-05-11T01:02:07.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:07.053 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2024-05-11T01:02:07.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir7 1m 2024-05-11T01:02:07.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.220+0000 7f62d1d2b640 1 Processor -- start 2024-05-11T01:02:07.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.220+0000 7f62d1d2b640 1 -- start start 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62d1d2b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f62cc0707a0 0x7f62cc070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62d1d2b640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62cc149230 con 0x7f62cc148e50 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62d1d2b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62cc163290 con 0x7f62cc06db00 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62d1d2b640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f62cc163570 con 0x7f62cc0707a0 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62caffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f62cc0707a0 0x7f62cc070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62caffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f62cc0707a0 0x7f62cc070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47888/0 (socket says 172.21.15.16:47888) 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62caffd640 1 -- 172.21.15.16:0/2071912284 learned_addr learned my addr 172.21.15.16:0/2071912284 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62cb7fe640 1 --1- 172.21.15.16:0/2071912284 >> v1:172.21.15.16:6789/0 conn(0x7f62cc148e50 0x7f62cc0b66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58132/0 (socket says 172.21.15.16:58132) 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62caffd640 1 -- 172.21.15.16:0/2071912284 >> v1:172.21.15.174:6789/0 conn(0x7f62cc06db00 legacy=0x7f62cc06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62caffd640 1 -- 172.21.15.16:0/2071912284 >> v1:172.21.15.16:6789/0 conn(0x7f62cc148e50 legacy=0x7f62cc0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.221+0000 7f62caffd640 1 -- 172.21.15.16:0/2071912284 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc163850 con 0x7f62cc0707a0 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.222+0000 7f62caffd640 1 --2- 172.21.15.16:0/2071912284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0707a0 0x7f62cc070c30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009870 tx=0x7f62c002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6106952e6a76778 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.222+0000 7f62ca7fc640 1 -- 172.21.15.16:0/2071912284 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0037070 con 0x7f62cc0707a0 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.222+0000 7f62ca7fc640 1 -- 172.21.15.16:0/2071912284 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c002ae50 con 0x7f62cc0707a0 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.222+0000 7f62ca7fc640 1 -- 172.21.15.16:0/2071912284 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0032860 con 0x7f62cc0707a0 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.222+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2071912284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0707a0 msgr2=0x7f62cc070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.222+0000 7f62d1d2b640 1 --2- 172.21.15.16:0/2071912284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0707a0 0x7f62cc070c30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009870 tx=0x7f62c002a300 comp rx=0 tx=0).stop 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.223+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2071912284 shutdown_connections 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.223+0000 7f62d1d2b640 1 --2- 172.21.15.16:0/2071912284 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc0707a0 0x7f62cc070c30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.223+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2071912284 >> 172.21.15.16:0/2071912284 conn(0x7f62cc0b8510 msgr2=0x7f62cc0b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:07.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.223+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2071912284 shutdown_connections 2024-05-11T01:02:07.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.223+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2071912284 wait complete. 2024-05-11T01:02:07.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.224+0000 7f62d1d2b640 1 Processor -- start 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.224+0000 7f62d1d2b640 1 -- start start 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62d1d2b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06db00 0x7f62cc0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62d1d2b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62cc0707a0 0x7f62cc15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62d1d2b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62cc148e50 0x7f62cc0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62d1d2b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc0b62c0 con 0x7f62cc06db00 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62d1d2b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc0b6140 con 0x7f62cc148e50 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62d1d2b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f62cc06e640 con 0x7f62cc0707a0 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06db00 0x7f62cc0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06db00 0x7f62cc0cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47896/0 (socket says 172.21.15.16:47896) 2024-05-11T01:02:07.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 -- 172.21.15.16:0/2863009474 learned_addr learned my addr 172.21.15.16:0/2863009474 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cbfff640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62cc148e50 0x7f62cc0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62caffd640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62cc0707a0 0x7f62cc15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 -- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62cc0707a0 msgr2=0x7f62cc15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62cc0707a0 0x7f62cc15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 -- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62cc148e50 msgr2=0x7f62cc0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62cc148e50 0x7f62cc0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 -- 172.21.15.16:0/2863009474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc15f390 con 0x7f62cc06db00 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cbfff640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62cc148e50 0x7f62cc0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62caffd640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62cc0707a0 0x7f62cc15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.225+0000 7f62cb7fe640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06db00 0x7f62cc0cdd80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c460 tx=0x7f62bc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.226+0000 7f62b3fff640 1 -- 172.21.15.16:0/2863009474 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc018070 con 0x7f62cc06db00 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.226+0000 7f62b3fff640 1 -- 172.21.15.16:0/2863009474 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62bc007480 con 0x7f62cc06db00 2024-05-11T01:02:07.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.226+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62cc0ccce0 con 0x7f62cc06db00 2024-05-11T01:02:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.226+0000 7f62b3fff640 1 -- 172.21.15.16:0/2863009474 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0047e0 con 0x7f62cc06db00 2024-05-11T01:02:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.226+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62cc0cd2a0 con 0x7f62cc06db00 2024-05-11T01:02:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.227+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62cc06a5b0 con 0x7f62cc06db00 2024-05-11T01:02:07.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.227+0000 7f62b3fff640 1 -- 172.21.15.16:0/2863009474 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f62bc01b070 con 0x7f62cc06db00 2024-05-11T01:02:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.228+0000 7f62b3fff640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f62b80764d0 0x7f62b8078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.228+0000 7f62b3fff640 1 -- 172.21.15.16:0/2863009474 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f62bc096ce0 con 0x7f62cc06db00 2024-05-11T01:02:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.228+0000 7f62caffd640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f62b80764d0 0x7f62b8078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.229+0000 7f62caffd640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f62b80764d0 0x7f62b8078990 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f62c0034000 tx=0x7f62c002e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.232+0000 7f62b3fff640 1 -- 172.21.15.16:0/2863009474 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f62bc060220 con 0x7f62cc06db00 2024-05-11T01:02:07.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.446+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir7", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f62cc06f700 con 0x7f62b80764d0 2024-05-11T01:02:07.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.507+0000 7f62b3fff640 1 -- 172.21.15.16:0/2863009474 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f62cc06f700 con 0x7f62b80764d0 2024-05-11T01:02:07.507 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir7 2024-05-11T01:02:07.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f62b80764d0 msgr2=0x7f62b8078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f62b80764d0 0x7f62b8078990 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f62c0034000 tx=0x7f62c002e000 comp rx=0 tx=0).stop 2024-05-11T01:02:07.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06db00 msgr2=0x7f62cc0cdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06db00 0x7f62cc0cdd80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c460 tx=0x7f62bc00c920 comp rx=0 tx=0).stop 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 shutdown_connections 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f62b80764d0 0x7f62b8078990 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62cc148e50 0x7f62cc0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f62cc0707a0 0x7f62cc15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 --2- 172.21.15.16:0/2863009474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62cc06db00 0x7f62cc0cdd80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 >> 172.21.15.16:0/2863009474 conn(0x7f62cc0b8510 msgr2=0x7f62cc0b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 shutdown_connections 2024-05-11T01:02:07.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.509+0000 7f62d1d2b640 1 -- 172.21.15.16:0/2863009474 wait complete. 2024-05-11T01:02:07.520 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2024-05-11T01:02:07.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:07.521 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2024-05-11T01:02:07.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir8 1m 2024-05-11T01:02:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.685+0000 7f526075f640 1 Processor -- start 2024-05-11T01:02:07.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.685+0000 7f526075f640 1 -- start start 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.686+0000 7f526075f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5258148ba0 0x7f525806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.686+0000 7f526075f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5258148f80 0x7f525815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.686+0000 7f526075f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52581603c0 con 0x7f52580b5ff0 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.686+0000 7f526075f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f52581606a0 con 0x7f5258148ba0 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.686+0000 7f526075f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5258160980 con 0x7f5258148f80 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.686+0000 7f525e4fb640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5258148ba0 0x7f525806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.687+0000 7f525ecfc640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f52580b5ff0 0x7f5258071d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58144/0 (socket says 172.21.15.16:58144) 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.687+0000 7f525ecfc640 1 -- 172.21.15.16:0/1014092396 learned_addr learned my addr 172.21.15.16:0/1014092396 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.687+0000 7f525dcfa640 1 --2- 172.21.15.16:0/1014092396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5258148f80 0x7f525815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.687+0000 7f525e4fb640 1 -- 172.21.15.16:0/1014092396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5258148f80 msgr2=0x7f525815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.687+0000 7f525e4fb640 1 --2- 172.21.15.16:0/1014092396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5258148f80 0x7f525815fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.687+0000 7f525e4fb640 1 -- 172.21.15.16:0/1014092396 >> v1:172.21.15.16:6789/0 conn(0x7f52580b5ff0 legacy=0x7f5258071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.687+0000 7f525e4fb640 1 -- 172.21.15.16:0/1014092396 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5258160c60 con 0x7f5258148ba0 2024-05-11T01:02:07.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.687+0000 7f525d4f9640 1 -- 172.21.15.16:0/1014092396 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156649891 0 0) 0x7f52581603c0 con 0x7f52580b5ff0 2024-05-11T01:02:07.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f525e4fb640 1 --2- 172.21.15.16:0/1014092396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f525806eb70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f52500097a0 tx=0x7f525002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948ed81289de50c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:07.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f525d4f9640 1 -- 172.21.15.16:0/1014092396 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250037070 con 0x7f5258148ba0 2024-05-11T01:02:07.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f525d4f9640 1 -- 172.21.15.16:0/1014092396 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5250032440 con 0x7f5258148ba0 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f525d4f9640 1 -- 172.21.15.16:0/1014092396 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250032810 con 0x7f5258148ba0 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f526075f640 1 -- 172.21.15.16:0/1014092396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 msgr2=0x7f525806eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f526075f640 1 --2- 172.21.15.16:0/1014092396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f525806eb70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f52500097a0 tx=0x7f525002a180 comp rx=0 tx=0).stop 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f526075f640 1 -- 172.21.15.16:0/1014092396 shutdown_connections 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f526075f640 1 --2- 172.21.15.16:0/1014092396 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5258148f80 0x7f525815fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f526075f640 1 --2- 172.21.15.16:0/1014092396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f525806eb70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f526075f640 1 -- 172.21.15.16:0/1014092396 >> 172.21.15.16:0/1014092396 conn(0x7f5258070780 msgr2=0x7f5258070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f526075f640 1 -- 172.21.15.16:0/1014092396 shutdown_connections 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.688+0000 7f526075f640 1 -- 172.21.15.16:0/1014092396 wait complete. 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.690+0000 7f526075f640 1 Processor -- start 2024-05-11T01:02:07.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.690+0000 7f526075f640 1 -- start start 2024-05-11T01:02:07.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.690+0000 7f526075f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52580b5ff0 0x7f5258144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.692 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.690+0000 7f526075f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f52581f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.690+0000 7f526075f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52580724b0 0x7f52581f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.690+0000 7f526075f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5258162470 con 0x7f5258148ba0 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.690+0000 7f526075f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5258160080 con 0x7f52580724b0 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.690+0000 7f526075f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f52581625f0 con 0x7f52580b5ff0 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f52581f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f52581f8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47906/0 (socket says 172.21.15.16:47906) 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 -- 172.21.15.16:0/2370612754 learned_addr learned my addr 172.21.15.16:0/2370612754 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525e4fb640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52580b5ff0 0x7f5258144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525ecfc640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52580724b0 0x7f52581f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 -- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52580b5ff0 msgr2=0x7f5258144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52580b5ff0 0x7f5258144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 -- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52580724b0 msgr2=0x7f52581f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52580724b0 0x7f52581f5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 -- 172.21.15.16:0/2370612754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52581f8bc0 con 0x7f5258148ba0 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525ecfc640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52580724b0 0x7f52581f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f525dcfa640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f52581f8450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f524c00d830 tx=0x7f524c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f5256ffd640 1 -- 172.21.15.16:0/2370612754 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c00b6c0 con 0x7f5258148ba0 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f5256ffd640 1 -- 172.21.15.16:0/2370612754 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f524c019070 con 0x7f5258148ba0 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52581f8ea0 con 0x7f5258148ba0 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f5256ffd640 1 -- 172.21.15.16:0/2370612754 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c00ba80 con 0x7f5258148ba0 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.691+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52581f5120 con 0x7f5258148ba0 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.692+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525806a5b0 con 0x7f5258148ba0 2024-05-11T01:02:07.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.693+0000 7f5256ffd640 1 -- 172.21.15.16:0/2370612754 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f524c01e460 con 0x7f5258148ba0 2024-05-11T01:02:07.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.693+0000 7f5256ffd640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52440764d0 0x7f5244078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:07.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.693+0000 7f5256ffd640 1 -- 172.21.15.16:0/2370612754 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f524c0980c0 con 0x7f5258148ba0 2024-05-11T01:02:07.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.694+0000 7f525e4fb640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52440764d0 0x7f5244078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:07.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.694+0000 7f525e4fb640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52440764d0 0x7f5244078990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5250034000 tx=0x7f525002e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:07.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.698+0000 7f5256ffd640 1 -- 172.21.15.16:0/2370612754 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f524c061690 con 0x7f5258148ba0 2024-05-11T01:02:07.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.914+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir8", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f52580b5740 con 0x7f52440764d0 2024-05-11T01:02:07.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.973+0000 7f5256ffd640 1 -- 172.21.15.16:0/2370612754 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f52580b5740 con 0x7f52440764d0 2024-05-11T01:02:07.973 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir8 2024-05-11T01:02:07.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52440764d0 msgr2=0x7f5244078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52440764d0 0x7f5244078990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5250034000 tx=0x7f525002e000 comp rx=0 tx=0).stop 2024-05-11T01:02:07.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 msgr2=0x7f52581f8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:07.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f52581f8450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f524c00d830 tx=0x7f524c00dcf0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 shutdown_connections 2024-05-11T01:02:07.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52440764d0 0x7f5244078990 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52580724b0 0x7f52581f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5258148ba0 0x7f52581f8450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 --2- 172.21.15.16:0/2370612754 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52580b5ff0 0x7f5258144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 >> 172.21.15.16:0/2370612754 conn(0x7f5258070780 msgr2=0x7f52580b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 shutdown_connections 2024-05-11T01:02:07.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:07.975+0000 7f526075f640 1 -- 172.21.15.16:0/2370612754 wait complete. 2024-05-11T01:02:07.986 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2024-05-11T01:02:07.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:02:07.986 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2024-05-11T01:02:08.004 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir9 1m 2024-05-11T01:02:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.150+0000 7f055e3af640 1 Processor -- start 2024-05-11T01:02:08.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.150+0000 7f055e3af640 1 -- start start 2024-05-11T01:02:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f055e3af640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f055815b920 0x7f055815f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f055e3af640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055815ff60 con 0x7f055815fa50 2024-05-11T01:02:08.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f055e3af640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0558160240 con 0x7f05580d0ea0 2024-05-11T01:02:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f055e3af640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f05580b4490 con 0x7f055815b920 2024-05-11T01:02:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f0557fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f055815b920 0x7f055815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f05577fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f055815fa50 0x7f05580ce020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58160/0 (socket says 172.21.15.16:58160) 2024-05-11T01:02:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f05577fe640 1 -- 172.21.15.16:0/3979169508 learned_addr learned my addr 172.21.15.16:0/3979169508 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f0557fff640 1 -- 172.21.15.16:0/3979169508 >> v1:172.21.15.174:6789/0 conn(0x7f05580d0ea0 legacy=0x7f05580b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f0557fff640 1 -- 172.21.15.16:0/3979169508 >> v1:172.21.15.16:6789/0 conn(0x7f055815fa50 legacy=0x7f05580ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.151+0000 7f0557fff640 1 -- 172.21.15.16:0/3979169508 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05580b46e0 con 0x7f055815b920 2024-05-11T01:02:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.152+0000 7f0557fff640 1 --2- 172.21.15.16:0/3979169508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f055815b920 0x7f055815f510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f05480097a0 tx=0x7f054802c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdfaa97eaf3dcc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.152+0000 7f0556ffd640 1 -- 172.21.15.16:0/3979169508 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548039070 con 0x7f055815b920 2024-05-11T01:02:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.152+0000 7f0556ffd640 1 -- 172.21.15.16:0/3979169508 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0548034640 con 0x7f055815b920 2024-05-11T01:02:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.152+0000 7f0556ffd640 1 -- 172.21.15.16:0/3979169508 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548034a10 con 0x7f055815b920 2024-05-11T01:02:08.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.153+0000 7f055e3af640 1 -- 172.21.15.16:0/3979169508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f055815b920 msgr2=0x7f055815f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.153+0000 7f055e3af640 1 --2- 172.21.15.16:0/3979169508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f055815b920 0x7f055815f510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f05480097a0 tx=0x7f054802c3c0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.153+0000 7f055e3af640 1 -- 172.21.15.16:0/3979169508 shutdown_connections 2024-05-11T01:02:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.153+0000 7f055e3af640 1 --2- 172.21.15.16:0/3979169508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f055815b920 0x7f055815f510 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.153+0000 7f055e3af640 1 -- 172.21.15.16:0/3979169508 >> 172.21.15.16:0/3979169508 conn(0x7f055806c3e0 msgr2=0x7f055806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.153+0000 7f055e3af640 1 -- 172.21.15.16:0/3979169508 shutdown_connections 2024-05-11T01:02:08.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.153+0000 7f055e3af640 1 -- 172.21.15.16:0/3979169508 wait complete. 2024-05-11T01:02:08.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.154+0000 7f055e3af640 1 Processor -- start 2024-05-11T01:02:08.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.154+0000 7f055e3af640 1 -- start start 2024-05-11T01:02:08.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f055e3af640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05580d0ea0 0x7f0558141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f055e3af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f055815b920 0x7f0558072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f055e3af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f055815fa50 0x7f05580728c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f055e3af640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05580739f0 con 0x7f05580d0ea0 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f055e3af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f05580b4a50 con 0x7f055815b920 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f055e3af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0558073b70 con 0x7f055815fa50 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05580d0ea0 0x7f0558141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05580d0ea0 0x7f0558141af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47910/0 (socket says 172.21.15.16:47910) 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 -- 172.21.15.16:0/1872078732 learned_addr learned my addr 172.21.15.16:0/1872078732 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f05577fe640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f055815b920 0x7f0558072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f055c94c640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f055815fa50 0x7f05580728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 -- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f055815fa50 msgr2=0x7f05580728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f055815fa50 0x7f05580728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 -- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f055815b920 msgr2=0x7f0558072380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f055815b920 0x7f0558072380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 -- 172.21.15.16:0/1872078732 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0558145200 con 0x7f05580d0ea0 2024-05-11T01:02:08.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f05577fe640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f055815b920 0x7f0558072380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:08.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.155+0000 7f0557fff640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05580d0ea0 0x7f0558141af0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0548037040 tx=0x7f05480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.156+0000 7f0554ff9640 1 -- 172.21.15.16:0/1872078732 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548043030 con 0x7f05580d0ea0 2024-05-11T01:02:08.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.156+0000 7f0554ff9640 1 -- 172.21.15.16:0/1872078732 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0548032750 con 0x7f05580d0ea0 2024-05-11T01:02:08.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.156+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05581f4b30 con 0x7f05580d0ea0 2024-05-11T01:02:08.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.156+0000 7f0554ff9640 1 -- 172.21.15.16:0/1872078732 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548039040 con 0x7f05580d0ea0 2024-05-11T01:02:08.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.156+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05581f50f0 con 0x7f05580d0ea0 2024-05-11T01:02:08.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.157+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055806a5b0 con 0x7f05580d0ea0 2024-05-11T01:02:08.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.157+0000 7f0554ff9640 1 -- 172.21.15.16:0/1872078732 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f0548046070 con 0x7f05580d0ea0 2024-05-11T01:02:08.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.158+0000 7f0554ff9640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0544076500 0x7f05440789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.158+0000 7f0554ff9640 1 -- 172.21.15.16:0/1872078732 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f05480ba2d0 con 0x7f05580d0ea0 2024-05-11T01:02:08.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.158+0000 7f05577fe640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0544076500 0x7f05440789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.159+0000 7f05577fe640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0544076500 0x7f05440789c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f05580b2e60 tx=0x7f054c009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.163+0000 7f0554ff9640 1 -- 172.21.15.16:0/1872078732 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f05480838b0 con 0x7f05580d0ea0 2024-05-11T01:02:08.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.377+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir9", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f05580b2e90 con 0x7f0544076500 2024-05-11T01:02:08.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.447+0000 7f0554ff9640 1 -- 172.21.15.16:0/1872078732 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f05580b2e90 con 0x7f0544076500 2024-05-11T01:02:08.448 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule set for path /snap_test_dir1/dir9 2024-05-11T01:02:08.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0544076500 msgr2=0x7f05440789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0544076500 0x7f05440789c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f05580b2e60 tx=0x7f054c009040 comp rx=0 tx=0).stop 2024-05-11T01:02:08.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05580d0ea0 msgr2=0x7f0558141af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05580d0ea0 0x7f0558141af0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0548037040 tx=0x7f05480046c0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 shutdown_connections 2024-05-11T01:02:08.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0544076500 0x7f05440789c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f055815fa50 0x7f05580728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f055815b920 0x7f0558072380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 --2- 172.21.15.16:0/1872078732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05580d0ea0 0x7f0558141af0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 >> 172.21.15.16:0/1872078732 conn(0x7f055806c3e0 msgr2=0x7f0558155900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 shutdown_connections 2024-05-11T01:02:08.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.449+0000 7f055e3af640 1 -- 172.21.15.16:0/1872078732 wait complete. 2024-05-11T01:02:08.461 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2024-05-11T01:02:08.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir0 1m 2024-05-11T01:02:08.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.567+0000 7f4033951640 1 Processor -- start 2024-05-11T01:02:08.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.567+0000 7f4033951640 1 -- start start 2024-05-11T01:02:08.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f4033951640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f402c15f390 0x7f402c0af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f4033951640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f4033951640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f402c0afd20 con 0x7f402c15f770 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f4033951640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f402c06ed60 con 0x7f402c15f390 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f4033951640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f402c06f040 con 0x7f402c0b54e0 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f4030eec640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f40316ed640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f402c15f390 0x7f402c0af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f40316ed640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f402c15f390 0x7f402c0af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:50892/0 (socket says 172.21.15.16:50892) 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f40316ed640 1 -- 172.21.15.16:0/2517525668 learned_addr learned my addr 172.21.15.16:0/2517525668 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.568+0000 7f4031eee640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f402c15f770 0x7f402c0b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:54922/0 (socket says 172.21.15.16:54922) 2024-05-11T01:02:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.569+0000 7f40316ed640 1 -- 172.21.15.16:0/2517525668 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 msgr2=0x7f402c06d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.569+0000 7f40316ed640 1 --2- 172.21.15.16:0/2517525668 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c06d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.569+0000 7f40316ed640 1 -- 172.21.15.16:0/2517525668 >> v1:172.21.15.174:6789/0 conn(0x7f402c15f770 legacy=0x7f402c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.569+0000 7f40316ed640 1 -- 172.21.15.16:0/2517525668 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c06f320 con 0x7f402c15f390 2024-05-11T01:02:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.569+0000 7f4030eec640 1 --2- 172.21.15.16:0/2517525668 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c06d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:02:08.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.569+0000 7f40316ed640 1 --2- 172.21.15.16:0/2517525668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f390 0x7f402c0af3d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4028009e50 tx=0x7f402802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf295d578cbc26c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4023fff640 1 -- 172.21.15.16:0/2517525668 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028036070 con 0x7f402c15f390 2024-05-11T01:02:08.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4023fff640 1 -- 172.21.15.16:0/2517525668 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4028031600 con 0x7f402c15f390 2024-05-11T01:02:08.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4023fff640 1 -- 172.21.15.16:0/2517525668 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40280319d0 con 0x7f402c15f390 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4033951640 1 -- 172.21.15.16:0/2517525668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f390 msgr2=0x7f402c0af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4033951640 1 --2- 172.21.15.16:0/2517525668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f390 0x7f402c0af3d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4028009e50 tx=0x7f402802a710 comp rx=0 tx=0).stop 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4033951640 1 -- 172.21.15.16:0/2517525668 shutdown_connections 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4033951640 1 --2- 172.21.15.16:0/2517525668 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c06d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4033951640 1 --2- 172.21.15.16:0/2517525668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f390 0x7f402c0af3d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4033951640 1 -- 172.21.15.16:0/2517525668 >> 172.21.15.16:0/2517525668 conn(0x7f402c072bd0 msgr2=0x7f402c072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4033951640 1 -- 172.21.15.16:0/2517525668 shutdown_connections 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.570+0000 7f4033951640 1 -- 172.21.15.16:0/2517525668 wait complete. 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.571+0000 7f4033951640 1 Processor -- start 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4033951640 1 -- start start 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4033951640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4033951640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f402c15f390 0x7f402c0b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4033951640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f770 0x7f402c0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4033951640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f402c0afa90 con 0x7f402c15f390 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4033951640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f402c0af910 con 0x7f402c15f770 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4033951640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f402c070850 con 0x7f402c0b54e0 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4030eec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f402c15f390 0x7f402c0b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4030eec640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f402c15f390 0x7f402c0b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47916/0 (socket says 172.21.15.16:47916) 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.572+0000 7f4030eec640 1 -- 172.21.15.16:0/2559258716 learned_addr learned my addr 172.21.15.16:0/2559258716 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f40316ed640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4031eee640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f770 0x7f402c0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4030eec640 1 -- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 msgr2=0x7f402c148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4030eec640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4030eec640 1 -- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f770 msgr2=0x7f402c0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4030eec640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f770 0x7f402c0b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4030eec640 1 -- 172.21.15.16:0/2559258716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402c1587a0 con 0x7f402c15f390 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f40316ed640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4030eec640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f402c15f390 0x7f402c0b1580 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f401c00ebe0 tx=0x7f401c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4021ffb640 1 -- 172.21.15.16:0/2559258716 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c017070 con 0x7f402c15f390 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4021ffb640 1 -- 172.21.15.16:0/2559258716 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f401c00cc30 con 0x7f402c15f390 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402c158a80 con 0x7f402c15f390 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4021ffb640 1 -- 172.21.15.16:0/2559258716 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401c013470 con 0x7f402c15f390 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.573+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402c159040 con 0x7f402c15f390 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.574+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402c06a5b0 con 0x7f402c15f390 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.575+0000 7f4021ffb640 1 -- 172.21.15.16:0/2559258716 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f401c01a070 con 0x7f402c15f390 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.575+0000 7f4021ffb640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f40100764d0 0x7f4010078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.576+0000 7f4021ffb640 1 -- 172.21.15.16:0/2559258716 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f401c097930 con 0x7f402c15f390 2024-05-11T01:02:08.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.576+0000 7f40316ed640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f40100764d0 0x7f4010078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.576+0000 7f40316ed640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f40100764d0 0x7f4010078990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4028033000 tx=0x7f4028009000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.580+0000 7f4021ffb640 1 -- 172.21.15.16:0/2559258716 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f401c060fa0 con 0x7f402c15f390 2024-05-11T01:02:08.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.793+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f402c15ddb0 con 0x7f40100764d0 2024-05-11T01:02:08.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.842+0000 7f4021ffb640 1 -- 172.21.15.16:0/2559258716 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f402c15ddb0 con 0x7f40100764d0 2024-05-11T01:02:08.843 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir0 2024-05-11T01:02:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f40100764d0 msgr2=0x7f4010078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f40100764d0 0x7f4010078990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4028033000 tx=0x7f4028009000 comp rx=0 tx=0).stop 2024-05-11T01:02:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f402c15f390 msgr2=0x7f402c0b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f402c15f390 0x7f402c0b1580 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f401c00ebe0 tx=0x7f401c00c520 comp rx=0 tx=0).stop 2024-05-11T01:02:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 shutdown_connections 2024-05-11T01:02:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f40100764d0 0x7f4010078990 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f402c15f770 0x7f402c0b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f402c15f390 0x7f402c0b1580 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 --2- 172.21.15.16:0/2559258716 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f402c0b54e0 0x7f402c148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 >> 172.21.15.16:0/2559258716 conn(0x7f402c072bd0 msgr2=0x7f402c15e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:08.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 shutdown_connections 2024-05-11T01:02:08.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.844+0000 7f4033951640 1 -- 172.21.15.16:0/2559258716 wait complete. 2024-05-11T01:02:08.856 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2024-05-11T01:02:08.857 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir1 1m 2024-05-11T01:02:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.963+0000 7fe655e74640 1 Processor -- start 2024-05-11T01:02:08.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.963+0000 7fe655e74640 1 -- start start 2024-05-11T01:02:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe655e74640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6500bac80 0x7fe6500d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe655e74640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe6500d00e0 0x7fe6500d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe655e74640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe65015fa90 con 0x7fe65015f6b0 2024-05-11T01:02:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe655e74640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe6500d39f0 con 0x7fe6500d00e0 2024-05-11T01:02:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe655e74640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe6500d3cd0 con 0x7fe6500bac80 2024-05-11T01:02:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe64ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe6500d00e0 0x7fe6500d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe64ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe6500d00e0 0x7fe6500d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47928/0 (socket says 172.21.15.16:47928) 2024-05-11T01:02:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe64ffff640 1 -- 172.21.15.16:0/3368689633 learned_addr learned my addr 172.21.15.16:0/3368689633 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe64effd640 1 --2- 172.21.15.16:0/3368689633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6500bac80 0x7fe6500d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe64ffff640 1 -- 172.21.15.16:0/3368689633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6500bac80 msgr2=0x7fe6500d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe64ffff640 1 --2- 172.21.15.16:0/3368689633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6500bac80 0x7fe6500d4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe64ffff640 1 -- 172.21.15.16:0/3368689633 >> v1:172.21.15.174:6789/0 conn(0x7fe65015f6b0 legacy=0x7fe6500d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.964+0000 7fe64ffff640 1 -- 172.21.15.16:0/3368689633 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500d3fb0 con 0x7fe6500d00e0 2024-05-11T01:02:08.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.965+0000 7fe64ffff640 1 --2- 172.21.15.16:0/3368689633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6500d0570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe648009e50 tx=0x7fe64802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f725b43b3c245b59 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.965+0000 7fe64e7fc640 1 -- 172.21.15.16:0/3368689633 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648036070 con 0x7fe6500d00e0 2024-05-11T01:02:08.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.965+0000 7fe64e7fc640 1 -- 172.21.15.16:0/3368689633 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648031600 con 0x7fe6500d00e0 2024-05-11T01:02:08.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.965+0000 7fe64e7fc640 1 -- 172.21.15.16:0/3368689633 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6480319d0 con 0x7fe6500d00e0 2024-05-11T01:02:08.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.966+0000 7fe655e74640 1 -- 172.21.15.16:0/3368689633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 msgr2=0x7fe6500d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.966+0000 7fe655e74640 1 --2- 172.21.15.16:0/3368689633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6500d0570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe648009e50 tx=0x7fe64802a7a0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.966+0000 7fe655e74640 1 -- 172.21.15.16:0/3368689633 shutdown_connections 2024-05-11T01:02:08.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.966+0000 7fe655e74640 1 --2- 172.21.15.16:0/3368689633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6500d0570 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.966+0000 7fe655e74640 1 --2- 172.21.15.16:0/3368689633 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe6500bac80 0x7fe6500d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.966+0000 7fe655e74640 1 -- 172.21.15.16:0/3368689633 >> 172.21.15.16:0/3368689633 conn(0x7fe650073f00 msgr2=0x7fe650074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:08.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.966+0000 7fe655e74640 1 -- 172.21.15.16:0/3368689633 shutdown_connections 2024-05-11T01:02:08.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.966+0000 7fe655e74640 1 -- 172.21.15.16:0/3368689633 wait complete. 2024-05-11T01:02:08.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.967+0000 7fe655e74640 1 Processor -- start 2024-05-11T01:02:08.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.967+0000 7fe655e74640 1 -- start start 2024-05-11T01:02:08.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe655e74640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6500bac80 0x7fe6501593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe655e74640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6501f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe655e74640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65015f6b0 0x7fe6501f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe655e74640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe6500d4fd0 con 0x7fe6500d00e0 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe655e74640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe6500d4570 con 0x7fe6500bac80 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe655e74640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe6500cc3e0 con 0x7fe65015f6b0 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6501f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6501f8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47944/0 (socket says 172.21.15.16:47944) 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64effd640 1 -- 172.21.15.16:0/451586406 learned_addr learned my addr 172.21.15.16:0/451586406 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64f7fe640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6500bac80 0x7fe6501593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64ffff640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65015f6b0 0x7fe6501f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64effd640 1 -- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65015f6b0 msgr2=0x7fe6501f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64effd640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65015f6b0 0x7fe6501f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64effd640 1 -- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6500bac80 msgr2=0x7fe6501593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64effd640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6500bac80 0x7fe6501593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.968+0000 7fe64effd640 1 -- 172.21.15.16:0/451586406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6500b57b0 con 0x7fe6500d00e0 2024-05-11T01:02:08.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.969+0000 7fe64effd640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6501f8db0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe64400d830 tx=0x7fe64400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.969+0000 7fe637fff640 1 -- 172.21.15.16:0/451586406 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64400b6c0 con 0x7fe6500d00e0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.969+0000 7fe637fff640 1 -- 172.21.15.16:0/451586406 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe644019070 con 0x7fe6500d00e0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.969+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6500b5a90 con 0x7fe6500d00e0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.969+0000 7fe637fff640 1 -- 172.21.15.16:0/451586406 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64400bac0 con 0x7fe6500d00e0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.969+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6500cc630 con 0x7fe6500d00e0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.970+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe65006a5b0 con 0x7fe6500d00e0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.970+0000 7fe637fff640 1 -- 172.21.15.16:0/451586406 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7fe64401e460 con 0x7fe6500d00e0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.971+0000 7fe637fff640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe63c0764d0 0x7fe63c078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.971+0000 7fe637fff640 1 -- 172.21.15.16:0/451586406 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe644097fd0 con 0x7fe6500d00e0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.971+0000 7fe64f7fe640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe63c0764d0 0x7fe63c078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.972+0000 7fe64f7fe640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe63c0764d0 0x7fe63c078990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe640001720 tx=0x7fe640009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:08.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:08.975+0000 7fe637fff640 1 -- 172.21.15.16:0/451586406 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe644060ff0 con 0x7fe6500d00e0 2024-05-11T01:02:09.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.191+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fe6500cc800 con 0x7fe63c0764d0 2024-05-11T01:02:09.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.245+0000 7fe637fff640 1 -- 172.21.15.16:0/451586406 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe6500cc800 con 0x7fe63c0764d0 2024-05-11T01:02:09.247 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir1 2024-05-11T01:02:09.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe63c0764d0 msgr2=0x7fe63c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe63c0764d0 0x7fe63c078990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe640001720 tx=0x7fe640009040 comp rx=0 tx=0).stop 2024-05-11T01:02:09.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 msgr2=0x7fe6501f8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6501f8db0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe64400d830 tx=0x7fe64400dcf0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 shutdown_connections 2024-05-11T01:02:09.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe63c0764d0 0x7fe63c078990 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe65015f6b0 0x7fe6501f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6500d00e0 0x7fe6501f8db0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 --2- 172.21.15.16:0/451586406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe6500bac80 0x7fe6501593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 >> 172.21.15.16:0/451586406 conn(0x7fe650073f00 msgr2=0x7fe650161a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:09.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 shutdown_connections 2024-05-11T01:02:09.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.248+0000 7fe655e74640 1 -- 172.21.15.16:0/451586406 wait complete. 2024-05-11T01:02:09.260 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2024-05-11T01:02:09.260 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir2 1m 2024-05-11T01:02:09.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.368+0000 7f7549685640 1 Processor -- start 2024-05-11T01:02:09.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.368+0000 7f7549685640 1 -- start start 2024-05-11T01:02:09.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7549685640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7544146d30 0x7f75440d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7549685640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75440d2670 con 0x7f7544070eb0 2024-05-11T01:02:09.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7549685640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75440d2950 con 0x7f75440d20d0 2024-05-11T01:02:09.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7549685640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7544147110 con 0x7f7544146d30 2024-05-11T01:02:09.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f75437fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7544070eb0 0x7f75440b66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58168/0 (socket says 172.21.15.16:58168) 2024-05-11T01:02:09.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f75437fe640 1 -- 172.21.15.16:0/1184955401 learned_addr learned my addr 172.21.15.16:0/1184955401 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:09.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156568287 0 0) 0x7f75440d2670 con 0x7f7544070eb0 2024-05-11T01:02:09.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7530003520 con 0x7f7544070eb0 2024-05-11T01:02:09.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7542ffd640 1 --2- 172.21.15.16:0/1184955401 >> v2:172.21.15.174:3300/0 conn(0x7f7544146d30 0x7f75440d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 934929325 0 0) 0x7f7530003520 con 0x7f7544070eb0 2024-05-11T01:02:09.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 >> v2:172.21.15.174:3300/0 conn(0x7f7544146d30 msgr2=0x7f75440d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:09.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7541ffb640 1 --2- 172.21.15.16:0/1184955401 >> v2:172.21.15.174:3300/0 conn(0x7f7544146d30 0x7f75440d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 >> v1:172.21.15.174:6789/0 conn(0x7f75440d20d0 legacy=0x7f75440707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.369+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75440d2c30 con 0x7f7544070eb0 2024-05-11T01:02:09.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f753c0016f0 con 0x7f7544070eb0 2024-05-11T01:02:09.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 >> v1:172.21.15.16:6789/0 conn(0x7f7544070eb0 legacy=0x7f75440b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7541ffb640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7530003a50 0x7f7530003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7541ffb640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f7530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7541ffb640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75300051c0 0x7f753000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7544147110 con 0x7f7530004800 2024-05-11T01:02:09.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f753000c160 con 0x7f7530003a50 2024-05-11T01:02:09.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f753000c360 con 0x7f75300051c0 2024-05-11T01:02:09.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75427fc640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f7530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7542ffd640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7530003a50 0x7f7530003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75437fe640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75300051c0 0x7f753000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75427fc640 1 -- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75300051c0 msgr2=0x7f753000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:09.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75427fc640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75300051c0 0x7f753000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75427fc640 1 -- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7530003a50 msgr2=0x7f7530003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:09.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75427fc640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7530003a50 0x7f7530003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75427fc640 1 -- 172.21.15.16:0/1184955401 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7530003520 con 0x7f7530004800 2024-05-11T01:02:09.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75437fe640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f75300051c0 0x7f753000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:02:09.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f7542ffd640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7530003a50 0x7f7530003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:09.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.370+0000 7f75437fe640 1 -- 172.21.15.16:0/1184955401 reap_dead start 2024-05-11T01:02:09.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f75427fc640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f7530004c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f752c001790 tx=0x7f7530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e87533eb2cd8ac server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:09.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c0013b0 con 0x7f7530004800 2024-05-11T01:02:09.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c0052d0 con 0x7f7530004800 2024-05-11T01:02:09.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7541ffb640 1 -- 172.21.15.16:0/1184955401 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c02aac0 con 0x7f7530004800 2024-05-11T01:02:09.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7549685640 1 -- 172.21.15.16:0/1184955401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 msgr2=0x7f7530004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7549685640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f7530004c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f752c001790 tx=0x7f7530005830 comp rx=0 tx=0).stop 2024-05-11T01:02:09.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7549685640 1 -- 172.21.15.16:0/1184955401 shutdown_connections 2024-05-11T01:02:09.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7549685640 1 --2- 172.21.15.16:0/1184955401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f7530004c80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7549685640 1 -- 172.21.15.16:0/1184955401 >> 172.21.15.16:0/1184955401 conn(0x7f75440b8510 msgr2=0x7f75440b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:09.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7549685640 1 -- 172.21.15.16:0/1184955401 shutdown_connections 2024-05-11T01:02:09.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.371+0000 7f7549685640 1 -- 172.21.15.16:0/1184955401 wait complete. 2024-05-11T01:02:09.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.373+0000 7f7549685640 1 Processor -- start 2024-05-11T01:02:09.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.373+0000 7f7549685640 1 -- start start 2024-05-11T01:02:09.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7549685640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f754415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7549685640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f754413f8f0 0x7f754415b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7549685640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7544140e90 0x7f754415faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7549685640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f754415dbb0 con 0x7f7530004800 2024-05-11T01:02:09.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7549685640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f754415da30 con 0x7f754413f8f0 2024-05-11T01:02:09.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7549685640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f75440d1b90 con 0x7f7544140e90 2024-05-11T01:02:09.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f754415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f754415a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47960/0 (socket says 172.21.15.16:47960) 2024-05-11T01:02:09.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 -- 172.21.15.16:0/979017653 learned_addr learned my addr 172.21.15.16:0/979017653 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:09.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f75427fc640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f754413f8f0 0x7f754415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 -- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7544140e90 msgr2=0x7f754415faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7544140e90 0x7f754415faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 -- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f754413f8f0 msgr2=0x7f754415b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f754413f8f0 0x7f754415b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 -- 172.21.15.16:0/979017653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754413fdf0 con 0x7f7530004800 2024-05-11T01:02:09.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f75427fc640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f754413f8f0 0x7f754415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:02:09.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7542ffd640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f754415a4b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f75340101c0 tx=0x7f7534010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:09.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f753b7fe640 1 -- 172.21.15.16:0/979017653 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753401a030 con 0x7f7530004800 2024-05-11T01:02:09.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f753b7fe640 1 -- 172.21.15.16:0/979017653 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7534010e50 con 0x7f7530004800 2024-05-11T01:02:09.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f753b7fe640 1 -- 172.21.15.16:0/979017653 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534003bb0 con 0x7f7530004800 2024-05-11T01:02:09.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75441400d0 con 0x7f7530004800 2024-05-11T01:02:09.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.374+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7544140690 con 0x7f7530004800 2024-05-11T01:02:09.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.375+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754406a5b0 con 0x7f7530004800 2024-05-11T01:02:09.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.376+0000 7f753b7fe640 1 -- 172.21.15.16:0/979017653 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f753401d070 con 0x7f7530004800 2024-05-11T01:02:09.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.377+0000 7f753b7fe640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f75240764d0 0x7f7524078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.377+0000 7f753b7fe640 1 -- 172.21.15.16:0/979017653 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f7534098a90 con 0x7f7530004800 2024-05-11T01:02:09.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.377+0000 7f75427fc640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f75240764d0 0x7f7524078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.378+0000 7f75427fc640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f75240764d0 0x7f7524078990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f752c032000 tx=0x7f752c02e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:09.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.381+0000 7f753b7fe640 1 -- 172.21.15.16:0/979017653 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7534003d50 con 0x7f7530004800 2024-05-11T01:02:09.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.595+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f75440b4e30 con 0x7f75240764d0 2024-05-11T01:02:09.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.645+0000 7f753b7fe640 1 -- 172.21.15.16:0/979017653 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f75440b4e30 con 0x7f75240764d0 2024-05-11T01:02:09.646 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir2 2024-05-11T01:02:09.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.647+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f75240764d0 msgr2=0x7f7524078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.647+0000 7f7549685640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f75240764d0 0x7f7524078990 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f752c032000 tx=0x7f752c02e000 comp rx=0 tx=0).stop 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.647+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 msgr2=0x7f754415a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.647+0000 7f7549685640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f754415a4b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f75340101c0 tx=0x7f7534010680 comp rx=0 tx=0).stop 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.648+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 shutdown_connections 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.648+0000 7f7549685640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f75240764d0 0x7f7524078990 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.648+0000 7f7549685640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7544140e90 0x7f754415faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.648+0000 7f7549685640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f754413f8f0 0x7f754415b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.648+0000 7f7549685640 1 --2- 172.21.15.16:0/979017653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7530004800 0x7f754415a4b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.648+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 >> 172.21.15.16:0/979017653 conn(0x7f75440b8510 msgr2=0x7f75440b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:09.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.648+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 shutdown_connections 2024-05-11T01:02:09.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.648+0000 7f7549685640 1 -- 172.21.15.16:0/979017653 wait complete. 2024-05-11T01:02:09.659 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2024-05-11T01:02:09.660 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir3 1m 2024-05-11T01:02:09.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.766+0000 7f1f19245640 1 Processor -- start 2024-05-11T01:02:09.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.766+0000 7f1f19245640 1 -- start start 2024-05-11T01:02:09.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f19245640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1f140cd940 0x7f1f140cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f19245640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1415db00 con 0x7f1f141402d0 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f19245640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1415dde0 con 0x7f1f14140b00 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f19245640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1415e0c0 con 0x7f1f140cd940 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f12d9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1f141402d0 0x7f1f140b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58174/0 (socket says 172.21.15.16:58174) 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f12d9d640 1 -- 172.21.15.16:0/2645213159 learned_addr learned my addr 172.21.15.16:0/2645213159 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f0a59c640 1 --2- 172.21.15.16:0/2645213159 >> v2:172.21.15.174:3300/0 conn(0x7f1f140cd940 0x7f1f140cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293809858 0 0) 0x7f1f1415db00 con 0x7f1f141402d0 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f00003520 con 0x7f1f141402d0 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 673973199 0 0) 0x7f1f00003520 con 0x7f1f141402d0 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 >> v2:172.21.15.174:3300/0 conn(0x7f1f140cd940 msgr2=0x7f1f140cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 --2- 172.21.15.16:0/2645213159 >> v2:172.21.15.174:3300/0 conn(0x7f1f140cd940 0x7f1f140cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 >> v1:172.21.15.174:6789/0 conn(0x7f1f14140b00 legacy=0x7f1f14140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1415e3a0 con 0x7f1f141402d0 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f1f040016f0 con 0x7f1f141402d0 2024-05-11T01:02:09.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 >> v1:172.21.15.16:6789/0 conn(0x7f1f141402d0 legacy=0x7f1f140b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f00003a00 0x7f1f00003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f00004800 0x7f1f00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f000051c0 0x7f1f0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1415e0c0 con 0x7f1f000051c0 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0000c060 con 0x7f1f00004800 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.767+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0000c260 con 0x7f1f00003a00 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f1359e640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f000051c0 0x7f1f0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f12d9d640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f00003a00 0x7f1f00003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f0a59c640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f00004800 0x7f1f00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f1359e640 1 -- 172.21.15.16:0/2645213159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f00003a00 msgr2=0x7f1f00003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f1359e640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f00003a00 0x7f1f00003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f1359e640 1 -- 172.21.15.16:0/2645213159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f00004800 msgr2=0x7f1f00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f1359e640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f00004800 0x7f1f00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f1359e640 1 -- 172.21.15.16:0/2645213159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f00003520 con 0x7f1f000051c0 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.768+0000 7f1f1359e640 1 -- 172.21.15.16:0/2645213159 reap_dead start 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f1359e640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f000051c0 0x7f1f0000b9c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c001f10 tx=0x7f1f00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9328c6da67c5114 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c036070 con 0x7f1f000051c0 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0c031600 con 0x7f1f000051c0 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f1259c640 1 -- 172.21.15.16:0/2645213159 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c001b30 con 0x7f1f000051c0 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f19245640 1 -- 172.21.15.16:0/2645213159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f000051c0 msgr2=0x7f1f0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f19245640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f000051c0 0x7f1f0000b9c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c001f10 tx=0x7f1f00005830 comp rx=0 tx=0).stop 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f19245640 1 -- 172.21.15.16:0/2645213159 shutdown_connections 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f19245640 1 --2- 172.21.15.16:0/2645213159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f000051c0 0x7f1f0000b9c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f19245640 1 -- 172.21.15.16:0/2645213159 >> 172.21.15.16:0/2645213159 conn(0x7f1f1406c3e0 msgr2=0x7f1f1406c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f19245640 1 -- 172.21.15.16:0/2645213159 shutdown_connections 2024-05-11T01:02:09.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.769+0000 7f1f19245640 1 -- 172.21.15.16:0/2645213159 wait complete. 2024-05-11T01:02:09.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.771+0000 7f1f19245640 1 Processor -- start 2024-05-11T01:02:09.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.771+0000 7f1f19245640 1 -- start start 2024-05-11T01:02:09.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f19245640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f000051c0 0x7f1f1415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f19245640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f14158f20 0x7f1f141f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f19245640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f141534b0 0x7f1f140b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f19245640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f140b2d40 con 0x7f1f141534b0 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f19245640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f141406b0 con 0x7f1f14158f20 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f19245640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f1f140b2ec0 con 0x7f1f000051c0 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f141534b0 0x7f1f140b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f141534b0 0x7f1f140b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47980/0 (socket says 172.21.15.16:47980) 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 -- 172.21.15.16:0/2654062337 learned_addr learned my addr 172.21.15.16:0/2654062337 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f0a59c640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f14158f20 0x7f1f141f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f12d9d640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f000051c0 0x7f1f1415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 -- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f000051c0 msgr2=0x7f1f1415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f000051c0 0x7f1f1415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 -- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f14158f20 msgr2=0x7f1f141f6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f14158f20 0x7f1f141f6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:09.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 -- 172.21.15.16:0/2654062337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f14155e30 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f1359e640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f141534b0 0x7f1f140b4d40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c002030 tx=0x7f1f0c001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f0bfff640 1 -- 172.21.15.16:0/2654062337 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c036040 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f0bfff640 1 -- 172.21.15.16:0/2654062337 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0c032b70 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f14156110 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.772+0000 7f1f0bfff640 1 -- 172.21.15.16:0/2654062337 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c007d90 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.773+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f141566d0 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.773+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1406a5b0 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.774+0000 7f1f0bfff640 1 -- 172.21.15.16:0/2654062337 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f1f0c0050e0 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.775+0000 7f1f0bfff640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f1ef40764d0 0x7f1ef4078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.775+0000 7f1f0bfff640 1 -- 172.21.15.16:0/2654062337 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f1f0c0b7100 con 0x7f1f141534b0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.775+0000 7f1f12d9d640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f1ef40764d0 0x7f1ef4078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:09.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.775+0000 7f1f12d9d640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f1ef40764d0 0x7f1ef4078990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1f04001240 tx=0x7f1f04001110 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:09.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.779+0000 7f1f0bfff640 1 -- 172.21.15.16:0/2654062337 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1f0c080790 con 0x7f1f141534b0 2024-05-11T01:02:09.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:09.992+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f1f140b3ad0 con 0x7f1ef40764d0 2024-05-11T01:02:10.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.040+0000 7f1f0bfff640 1 -- 172.21.15.16:0/2654062337 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f1f140b3ad0 con 0x7f1ef40764d0 2024-05-11T01:02:10.042 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir3 2024-05-11T01:02:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f1ef40764d0 msgr2=0x7f1ef4078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f1ef40764d0 0x7f1ef4078990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1f04001240 tx=0x7f1f04001110 comp rx=0 tx=0).stop 2024-05-11T01:02:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f141534b0 msgr2=0x7f1f140b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f141534b0 0x7f1f140b4d40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c002030 tx=0x7f1f0c001490 comp rx=0 tx=0).stop 2024-05-11T01:02:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 shutdown_connections 2024-05-11T01:02:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f1ef40764d0 0x7f1ef4078990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f141534b0 0x7f1f140b4d40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f14158f20 0x7f1f141f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 --2- 172.21.15.16:0/2654062337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f1f000051c0 0x7f1f1415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 >> 172.21.15.16:0/2654062337 conn(0x7f1f1406c3e0 msgr2=0x7f1f140b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 shutdown_connections 2024-05-11T01:02:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.043+0000 7f1f19245640 1 -- 172.21.15.16:0/2654062337 wait complete. 2024-05-11T01:02:10.055 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2024-05-11T01:02:10.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir4 1m 2024-05-11T01:02:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.161+0000 7f95ae28c640 1 Processor -- start 2024-05-11T01:02:10.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.161+0000 7f95ae28c640 1 -- start start 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.162+0000 7f95ae28c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f95a80bae40 0x7f95a81604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.162+0000 7f95ae28c640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a81609e0 con 0x7f95a8163010 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.162+0000 7f95ae28c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a81635d0 con 0x7f95a80b7490 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.162+0000 7f95ae28c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f95a81638b0 con 0x7f95a80bae40 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.162+0000 7f959ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f95a8163010 0x7f95a80b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58188/0 (socket says 172.21.15.16:58188) 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.162+0000 7f959ffff640 1 -- 172.21.15.16:0/4037202431 learned_addr learned my addr 172.21.15.16:0/4037202431 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.162+0000 7f95a7fff640 1 --2- 172.21.15.16:0/4037202431 >> v2:172.21.15.174:3300/0 conn(0x7f95a80bae40 0x7f95a81604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.162+0000 7f95a77fe640 1 -- 172.21.15.16:0/4037202431 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176884681 0 0) 0x7f9590001110 con 0x7f95a8163010 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.163+0000 7f95a77fe640 1 -- 172.21.15.16:0/4037202431 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9594003520 con 0x7f95a8163010 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.163+0000 7f95a77fe640 1 -- 172.21.15.16:0/4037202431 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 99669941 0 0) 0x7f9594003520 con 0x7f95a8163010 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.163+0000 7f95a7fff640 1 -- 172.21.15.16:0/4037202431 >> v1:172.21.15.174:6789/0 conn(0x7f95a80b7490 legacy=0x7f95a80b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.163+0000 7f95a7fff640 1 -- 172.21.15.16:0/4037202431 >> v1:172.21.15.16:6789/0 conn(0x7f95a8163010 legacy=0x7f95a80b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.163+0000 7f95a7fff640 1 -- 172.21.15.16:0/4037202431 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a8163b90 con 0x7f95a80bae40 2024-05-11T01:02:10.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95a7fff640 1 --2- 172.21.15.16:0/4037202431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 0x7f95a81604a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95980097a0 tx=0x7f959802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ac3d93fd4caa4bc server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95a77fe640 1 -- 172.21.15.16:0/4037202431 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598037070 con 0x7f95a80bae40 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95a77fe640 1 -- 172.21.15.16:0/4037202431 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959802abc0 con 0x7f95a80bae40 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95a77fe640 1 -- 172.21.15.16:0/4037202431 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95900018c0 con 0x7f95a80bae40 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95ae28c640 1 -- 172.21.15.16:0/4037202431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 msgr2=0x7f95a81604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95ae28c640 1 --2- 172.21.15.16:0/4037202431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 0x7f95a81604a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95980097a0 tx=0x7f959802a130 comp rx=0 tx=0).stop 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95ae28c640 1 -- 172.21.15.16:0/4037202431 shutdown_connections 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95ae28c640 1 --2- 172.21.15.16:0/4037202431 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 0x7f95a81604a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95ae28c640 1 -- 172.21.15.16:0/4037202431 >> 172.21.15.16:0/4037202431 conn(0x7f95a8074140 msgr2=0x7f95a80d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95ae28c640 1 -- 172.21.15.16:0/4037202431 shutdown_connections 2024-05-11T01:02:10.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.164+0000 7f95ae28c640 1 -- 172.21.15.16:0/4037202431 wait complete. 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95ae28c640 1 Processor -- start 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95ae28c640 1 -- start start 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95ae28c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95a80b7490 0x7f95a8158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95ae28c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 0x7f95a814d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95ae28c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95a8163010 0x7f95a814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95ae28c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f95a80d46f0 con 0x7f95a80b7490 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95ae28c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95a80bb220 con 0x7f95a80bae40 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95ae28c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f95a80d4870 con 0x7f95a8163010 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.166+0000 7f95a7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95a80b7490 0x7f95a8158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95a80b7490 0x7f95a8158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47996/0 (socket says 172.21.15.16:47996) 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a7fff640 1 -- 172.21.15.16:0/2857587473 learned_addr learned my addr 172.21.15.16:0/2857587473 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a7fff640 1 -- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95a8163010 msgr2=0x7f95a814d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f959ffff640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 0x7f95a814d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95ac829640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95a8163010 0x7f95a814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a7fff640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95a8163010 0x7f95a814d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a7fff640 1 -- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 msgr2=0x7f95a814d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a7fff640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 0x7f95a814d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a7fff640 1 -- 172.21.15.16:0/2857587473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a815be90 con 0x7f95a80b7490 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f959ffff640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 0x7f95a814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95ac829640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95a8163010 0x7f95a814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a7fff640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95a80b7490 0x7f95a8158940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9598035040 tx=0x7f95980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a57fa640 1 -- 172.21.15.16:0/2857587473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598042020 con 0x7f95a80b7490 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a57fa640 1 -- 172.21.15.16:0/2857587473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959803d670 con 0x7f95a80b7490 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a815c170 con 0x7f95a80b7490 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95a57fa640 1 -- 172.21.15.16:0/2857587473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598037040 con 0x7f95a80b7490 2024-05-11T01:02:10.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.167+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a815c730 con 0x7f95a80b7490 2024-05-11T01:02:10.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.168+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a806a5b0 con 0x7f95a80b7490 2024-05-11T01:02:10.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.169+0000 7f95a57fa640 1 -- 172.21.15.16:0/2857587473 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f9598045020 con 0x7f95a80b7490 2024-05-11T01:02:10.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.169+0000 7f95a57fa640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f95880764d0 0x7f9588078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.169+0000 7f95a57fa640 1 -- 172.21.15.16:0/2857587473 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f95980b83e0 con 0x7f95a80b7490 2024-05-11T01:02:10.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.169+0000 7f959ffff640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f95880764d0 0x7f9588078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.170+0000 7f959ffff640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f95880764d0 0x7f9588078990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9590001eb0 tx=0x7f9590009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.173+0000 7f95a57fa640 1 -- 172.21.15.16:0/2857587473 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f959804c030 con 0x7f95a80b7490 2024-05-11T01:02:10.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.393+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f95a80d2fa0 con 0x7f95880764d0 2024-05-11T01:02:10.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.442+0000 7f95a57fa640 1 -- 172.21.15.16:0/2857587473 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f95a80d2fa0 con 0x7f95880764d0 2024-05-11T01:02:10.443 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir4 2024-05-11T01:02:10.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f95880764d0 msgr2=0x7f9588078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f95880764d0 0x7f9588078990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9590001eb0 tx=0x7f9590009040 comp rx=0 tx=0).stop 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95a80b7490 msgr2=0x7f95a8158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95a80b7490 0x7f95a8158940 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9598035040 tx=0x7f95980046c0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 shutdown_connections 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f95880764d0 0x7f9588078990 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f95a8163010 0x7f95a814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95a80bae40 0x7f95a814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 --2- 172.21.15.16:0/2857587473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95a80b7490 0x7f95a8158940 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 >> 172.21.15.16:0/2857587473 conn(0x7f95a8074140 msgr2=0x7f95a8160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:10.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 shutdown_connections 2024-05-11T01:02:10.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.444+0000 7f95ae28c640 1 -- 172.21.15.16:0/2857587473 wait complete. 2024-05-11T01:02:10.456 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2024-05-11T01:02:10.456 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir5 1m 2024-05-11T01:02:10.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.562+0000 7f5f10be5640 1 Processor -- start 2024-05-11T01:02:10.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.562+0000 7f5f10be5640 1 -- start start 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f10be5640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f0c15f680 0x7f5f0c0d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f10be5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f0c0d0e40 0x7f5f0c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f10be5640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0c06d600 con 0x7f5f0c0b5230 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f10be5640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f5f0c0b5680 con 0x7f5f0c15f680 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f10be5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0c0ce7f0 con 0x7f5f0c0d0e40 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f0ad9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5f0c0b5230 0x7f5f0c163340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58200/0 (socket says 172.21.15.16:58200) 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f0ad9d640 1 -- 172.21.15.16:0/1782519740 learned_addr learned my addr 172.21.15.16:0/1782519740 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 728155843 0 0) 0x7f5f0c06d600 con 0x7f5f0c0b5230 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ef4003520 con 0x7f5f0c0b5230 2024-05-11T01:02:10.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.563+0000 7f5f09d9b640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f0c0d0e40 0x7f5f0c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0a59c640 1 --2- 172.21.15.16:0/1782519740 >> v2:172.21.15.174:3300/0 conn(0x7f5f0c15f680 0x7f5f0c0d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3073833183 0 0) 0x7f5ef4003520 con 0x7f5f0c0b5230 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f0c0d0e40 msgr2=0x7f5f0c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f0c0d0e40 0x7f5f0c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 >> v2:172.21.15.174:3300/0 conn(0x7f5f0c15f680 msgr2=0x7f5f0c0d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 --2- 172.21.15.16:0/1782519740 >> v2:172.21.15.174:3300/0 conn(0x7f5f0c15f680 0x7f5f0c0d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0c06d8e0 con 0x7f5f0c0b5230 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f5f04001a70 con 0x7f5f0c0b5230 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 >> v1:172.21.15.16:6789/0 conn(0x7f5f0c0b5230 legacy=0x7f5f0c163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f0c0d0e40 0x7f5ef4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef4003fd0 0x7f5ef4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ef4004d40 0x7f5ef40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c0b5680 con 0x7f5ef4003fd0 2024-05-11T01:02:10.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c0ce7f0 con 0x7f5ef4004d40 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef400ba10 con 0x7f5f0c0d0e40 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f09d9b640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef4003fd0 0x7f5ef4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0a59c640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f0c0d0e40 0x7f5ef4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f0ad9d640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ef4004d40 0x7f5ef40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f09d9b640 1 -- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f0c0d0e40 msgr2=0x7f5ef4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f09d9b640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5f0c0d0e40 0x7f5ef4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f09d9b640 1 -- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ef4004d40 msgr2=0x7f5ef40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f09d9b640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ef4004d40 0x7f5ef40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.564+0000 7f5f09d9b640 1 -- 172.21.15.16:0/1782519740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef4003520 con 0x7f5ef4003fd0 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.565+0000 7f5f09d9b640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef4003fd0 0x7f5ef4004800 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009af0 tx=0x7f5ef4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879d10ea931139ef server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.565+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00036070 con 0x7f5ef4003fd0 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.565+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f00031400 con 0x7f5ef4003fd0 2024-05-11T01:02:10.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.565+0000 7f5f0959a640 1 -- 172.21.15.16:0/1782519740 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00009690 con 0x7f5ef4003fd0 2024-05-11T01:02:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.566+0000 7f5f10be5640 1 -- 172.21.15.16:0/1782519740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef4003fd0 msgr2=0x7f5ef4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.566+0000 7f5f10be5640 1 --2- 172.21.15.16:0/1782519740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef4003fd0 0x7f5ef4004800 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009af0 tx=0x7f5ef4005830 comp rx=0 tx=0).stop 2024-05-11T01:02:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.566+0000 7f5f0ad9d640 1 -- 172.21.15.16:0/1782519740 reap_dead start 2024-05-11T01:02:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.566+0000 7f5f10be5640 1 -- 172.21.15.16:0/1782519740 shutdown_connections 2024-05-11T01:02:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.566+0000 7f5f10be5640 1 -- 172.21.15.16:0/1782519740 >> 172.21.15.16:0/1782519740 conn(0x7f5f0c0681c0 msgr2=0x7f5f0c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.566+0000 7f5f10be5640 1 -- 172.21.15.16:0/1782519740 shutdown_connections 2024-05-11T01:02:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.566+0000 7f5f10be5640 1 -- 172.21.15.16:0/1782519740 wait complete. 2024-05-11T01:02:10.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.567+0000 7f5f10be5640 1 Processor -- start 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.567+0000 7f5f10be5640 1 -- start start 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f10be5640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef4003fd0 0x7f5f0c0b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f10be5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f0c0ae8f0 0x7f5f0c0b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f10be5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f0c15a500 0x7f5f0c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f10be5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c06e180 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f10be5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c06dea0 con 0x7f5f0c15a500 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f10be5640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0c0d3e50 con 0x7f5ef4003fd0 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f09d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f0c0ae8f0 0x7f5f0c0b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f09d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f0c0ae8f0 0x7f5f0c0b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48014/0 (socket says 172.21.15.16:48014) 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f09d9b640 1 -- 172.21.15.16:0/2041175077 learned_addr learned my addr 172.21.15.16:0/2041175077 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f0ad9d640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f0c15a500 0x7f5f0c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f0a59c640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef4003fd0 0x7f5f0c0b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f09d9b640 1 -- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef4003fd0 msgr2=0x7f5f0c0b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f09d9b640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef4003fd0 0x7f5f0c0b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f09d9b640 1 -- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f0c15a500 msgr2=0x7f5f0c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f09d9b640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f0c15a500 0x7f5f0c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.568+0000 7f5f09d9b640 1 -- 172.21.15.16:0/2041175077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0c0aff00 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.569+0000 7f5f09d9b640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f0c0ae8f0 0x7f5f0c0b7780 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009af0 tx=0x7f5f00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.569+0000 7f5efaffd640 1 -- 172.21.15.16:0/2041175077 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00040020 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.569+0000 7f5efaffd640 1 -- 172.21.15.16:0/2041175077 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f00003810 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.569+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f0c0aee60 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.569+0000 7f5efaffd640 1 -- 172.21.15.16:0/2041175077 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00036040 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.569+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f0c0af700 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.570+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f0c06a5b0 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.570+0000 7f5efaffd640 1 -- 172.21.15.16:0/2041175077 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f5f00043020 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.571+0000 7f5efaffd640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5eec076500 0x7f5eec0789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.571+0000 7f5efaffd640 1 -- 172.21.15.16:0/2041175077 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f5f000b7970 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.571+0000 7f5f0a59c640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5eec076500 0x7f5eec0789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.572+0000 7f5f0a59c640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5eec076500 0x7f5eec0789c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009c40 tx=0x7f5efc009190 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.575+0000 7f5efaffd640 1 -- 172.21.15.16:0/2041175077 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5f0004a070 con 0x7f5f0c0ae8f0 2024-05-11T01:02:10.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.795+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5f0c0d0740 con 0x7f5eec076500 2024-05-11T01:02:10.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.844+0000 7f5efaffd640 1 -- 172.21.15.16:0/2041175077 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f5f0c0d0740 con 0x7f5eec076500 2024-05-11T01:02:10.845 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir5 2024-05-11T01:02:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5eec076500 msgr2=0x7f5eec0789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5eec076500 0x7f5eec0789c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009c40 tx=0x7f5efc009190 comp rx=0 tx=0).stop 2024-05-11T01:02:10.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f0c0ae8f0 msgr2=0x7f5f0c0b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f0c0ae8f0 0x7f5f0c0b7780 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009af0 tx=0x7f5f00004730 comp rx=0 tx=0).stop 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 shutdown_connections 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5eec076500 0x7f5eec0789c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f0c15a500 0x7f5f0c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f0c0ae8f0 0x7f5f0c0b7780 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 --2- 172.21.15.16:0/2041175077 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ef4003fd0 0x7f5f0c0b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 >> 172.21.15.16:0/2041175077 conn(0x7f5f0c0681c0 msgr2=0x7f5f0c0b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 shutdown_connections 2024-05-11T01:02:10.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.846+0000 7f5f10be5640 1 -- 172.21.15.16:0/2041175077 wait complete. 2024-05-11T01:02:10.858 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2024-05-11T01:02:10.858 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir6 1m 2024-05-11T01:02:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.964+0000 7fc83d464640 1 Processor -- start 2024-05-11T01:02:10.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.964+0000 7fc83d464640 1 -- start start 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc83d464640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc838148e50 0x7fc8380b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc83d464640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8380707a0 0x7fc838070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc83d464640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc838149230 con 0x7fc8380b4c80 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc83d464640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc838071140 con 0x7fc8380707a0 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc83d464640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc838163290 con 0x7fc838148e50 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc8367fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8380707a0 0x7fc838070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc8377fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc8380b4c80 0x7fc8380b5110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58212/0 (socket says 172.21.15.16:58212) 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc8377fe640 1 -- 172.21.15.16:0/924612932 learned_addr learned my addr 172.21.15.16:0/924612932 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:10.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc836ffd640 1 --2- 172.21.15.16:0/924612932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc838148e50 0x7fc8380b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc8367fc640 1 -- 172.21.15.16:0/924612932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc838148e50 msgr2=0x7fc8380b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc8367fc640 1 --2- 172.21.15.16:0/924612932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc838148e50 0x7fc8380b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc8367fc640 1 -- 172.21.15.16:0/924612932 >> v1:172.21.15.16:6789/0 conn(0x7fc8380b4c80 legacy=0x7fc8380b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc835ffb640 1 -- 172.21.15.16:0/924612932 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354961590 0 0) 0x7fc838149230 con 0x7fc8380b4c80 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.965+0000 7fc8367fc640 1 -- 172.21.15.16:0/924612932 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc838163570 con 0x7fc8380707a0 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.966+0000 7fc8367fc640 1 --2- 172.21.15.16:0/924612932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380707a0 0x7fc838070c00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0097a0 tx=0x7fc82c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29686f826940b0ff server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.966+0000 7fc835ffb640 1 -- 172.21.15.16:0/924612932 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c037070 con 0x7fc8380707a0 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.966+0000 7fc835ffb640 1 -- 172.21.15.16:0/924612932 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c032440 con 0x7fc8380707a0 2024-05-11T01:02:10.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.966+0000 7fc835ffb640 1 -- 172.21.15.16:0/924612932 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c032810 con 0x7fc8380707a0 2024-05-11T01:02:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.967+0000 7fc83d464640 1 -- 172.21.15.16:0/924612932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380707a0 msgr2=0x7fc838070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.967+0000 7fc83d464640 1 --2- 172.21.15.16:0/924612932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380707a0 0x7fc838070c00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0097a0 tx=0x7fc82c02a180 comp rx=0 tx=0).stop 2024-05-11T01:02:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.967+0000 7fc83d464640 1 -- 172.21.15.16:0/924612932 shutdown_connections 2024-05-11T01:02:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.967+0000 7fc83d464640 1 --2- 172.21.15.16:0/924612932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380707a0 0x7fc838070c00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.967+0000 7fc83d464640 1 --2- 172.21.15.16:0/924612932 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc838148e50 0x7fc8380b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.967+0000 7fc83d464640 1 -- 172.21.15.16:0/924612932 >> 172.21.15.16:0/924612932 conn(0x7fc8380b8510 msgr2=0x7fc8380b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.967+0000 7fc83d464640 1 -- 172.21.15.16:0/924612932 shutdown_connections 2024-05-11T01:02:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.967+0000 7fc83d464640 1 -- 172.21.15.16:0/924612932 wait complete. 2024-05-11T01:02:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.968+0000 7fc83d464640 1 Processor -- start 2024-05-11T01:02:10.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.968+0000 7fc83d464640 1 -- start start 2024-05-11T01:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc83d464640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8380707a0 0x7fc8380d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc83d464640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380b4c80 0x7fc8380aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc83d464640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc838148e50 0x7fc83815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc83d464640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8380b6be0 con 0x7fc8380b4c80 2024-05-11T01:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc83d464640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc838163b30 con 0x7fc838148e50 2024-05-11T01:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc83d464640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc8380b6d60 con 0x7fc8380707a0 2024-05-11T01:02:10.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc8367fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380b4c80 0x7fc8380aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc8367fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380b4c80 0x7fc8380aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48044/0 (socket says 172.21.15.16:48044) 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc8367fc640 1 -- 172.21.15.16:0/1361395180 learned_addr learned my addr 172.21.15.16:0/1361395180 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc836ffd640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8380707a0 0x7fc8380d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.969+0000 7fc8377fe640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc838148e50 0x7fc83815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc8367fc640 1 -- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8380707a0 msgr2=0x7fc8380d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc8367fc640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8380707a0 0x7fc8380d2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc8367fc640 1 -- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc838148e50 msgr2=0x7fc83815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc8367fc640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc838148e50 0x7fc83815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc8367fc640 1 -- 172.21.15.16:0/1361395180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8381464c0 con 0x7fc8380b4c80 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc8377fe640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc838148e50 0x7fc83815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc8367fc640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380b4c80 0x7fc8380aad50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0098c0 tx=0x7fc82c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc81f7fe640 1 -- 172.21.15.16:0/1361395180 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c037040 con 0x7fc8380b4c80 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc81f7fe640 1 -- 172.21.15.16:0/1361395180 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82c030770 con 0x7fc8380b4c80 2024-05-11T01:02:10.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8380d1960 con 0x7fc8380b4c80 2024-05-11T01:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc81f7fe640 1 -- 172.21.15.16:0/1361395180 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c030b40 con 0x7fc8380b4c80 2024-05-11T01:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.970+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8380d1f20 con 0x7fc8380b4c80 2024-05-11T01:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.971+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8380b7e40 con 0x7fc8380b4c80 2024-05-11T01:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.972+0000 7fc81f7fe640 1 -- 172.21.15.16:0/1361395180 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7fc82c044020 con 0x7fc8380b4c80 2024-05-11T01:02:10.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.972+0000 7fc81f7fe640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc8240764d0 0x7fc824078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:10.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.972+0000 7fc81f7fe640 1 -- 172.21.15.16:0/1361395180 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc82c0b7ed0 con 0x7fc8380b4c80 2024-05-11T01:02:10.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.972+0000 7fc836ffd640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc8240764d0 0x7fc824078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:10.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.973+0000 7fc836ffd640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc8240764d0 0x7fc824078990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc8381f87e0 tx=0x7fc8280039b0 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:10.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:10.977+0000 7fc81f7fe640 1 -- 172.21.15.16:0/1361395180 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc8380b7e40 con 0x7fc8380b4c80 2024-05-11T01:02:11.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.193+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc83806a5b0 con 0x7fc8240764d0 2024-05-11T01:02:11.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.243+0000 7fc81f7fe640 1 -- 172.21.15.16:0/1361395180 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc83806a5b0 con 0x7fc8240764d0 2024-05-11T01:02:11.244 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir6 2024-05-11T01:02:11.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc8240764d0 msgr2=0x7fc824078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc8240764d0 0x7fc824078990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc8381f87e0 tx=0x7fc8280039b0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380b4c80 msgr2=0x7fc8380aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380b4c80 0x7fc8380aad50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0098c0 tx=0x7fc82c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 shutdown_connections 2024-05-11T01:02:11.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc8240764d0 0x7fc824078990 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc838148e50 0x7fc83815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8380b4c80 0x7fc8380aad50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 --2- 172.21.15.16:0/1361395180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8380707a0 0x7fc8380d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 >> 172.21.15.16:0/1361395180 conn(0x7fc8380b8510 msgr2=0x7fc838146930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:11.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 shutdown_connections 2024-05-11T01:02:11.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.245+0000 7fc83d464640 1 -- 172.21.15.16:0/1361395180 wait complete. 2024-05-11T01:02:11.257 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2024-05-11T01:02:11.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir7 1m 2024-05-11T01:02:11.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.363+0000 7fea9f274640 1 Processor -- start 2024-05-11T01:02:11.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.364+0000 7fea9f274640 1 -- start start 2024-05-11T01:02:11.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.364+0000 7fea9f274640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea980ce020 0x7fea980ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.364+0000 7fea9f274640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980d0ea0 0x7fea980d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.364+0000 7fea9f274640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9815ff60 con 0x7fea9815b920 2024-05-11T01:02:11.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.364+0000 7fea9f274640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fea980d1850 con 0x7fea980ce020 2024-05-11T01:02:11.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.364+0000 7fea9f274640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fea980b4490 con 0x7fea980d0ea0 2024-05-11T01:02:11.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9c80f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea980ce020 0x7fea980ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9c80f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea980ce020 0x7fea980ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48048/0 (socket says 172.21.15.16:48048) 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9c80f640 1 -- 172.21.15.16:0/1397220107 learned_addr learned my addr 172.21.15.16:0/1397220107 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9d010640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fea9815b920 0x7fea9815f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58224/0 (socket says 172.21.15.16:58224) 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9d811640 1 --2- 172.21.15.16:0/1397220107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980d0ea0 0x7fea980d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9c80f640 1 -- 172.21.15.16:0/1397220107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980d0ea0 msgr2=0x7fea980d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9c80f640 1 --2- 172.21.15.16:0/1397220107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980d0ea0 0x7fea980d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9c80f640 1 -- 172.21.15.16:0/1397220107 >> v1:172.21.15.16:6789/0 conn(0x7fea9815b920 legacy=0x7fea9815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9c80f640 1 -- 172.21.15.16:0/1397220107 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea98160240 con 0x7fea980ce020 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea8ffff640 1 -- 172.21.15.16:0/1397220107 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008940604 0 0) 0x7fea9815ff60 con 0x7fea9815b920 2024-05-11T01:02:11.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.365+0000 7fea9d811640 1 --2- 172.21.15.16:0/1397220107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980d0ea0 0x7fea980d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea9c80f640 1 --2- 172.21.15.16:0/1397220107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980ce020 0x7fea980ce490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea88009870 tx=0x7fea8802b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb72d7ae9396540 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea8ffff640 1 -- 172.21.15.16:0/1397220107 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88038070 con 0x7fea980ce020 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea8ffff640 1 -- 172.21.15.16:0/1397220107 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea88033640 con 0x7fea980ce020 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea8ffff640 1 -- 172.21.15.16:0/1397220107 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88033a10 con 0x7fea980ce020 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea9f274640 1 -- 172.21.15.16:0/1397220107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980ce020 msgr2=0x7fea980ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea9f274640 1 --2- 172.21.15.16:0/1397220107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980ce020 0x7fea980ce490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fea88009870 tx=0x7fea8802b2d0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea9f274640 1 -- 172.21.15.16:0/1397220107 shutdown_connections 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea9f274640 1 --2- 172.21.15.16:0/1397220107 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980d0ea0 0x7fea980d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea9f274640 1 --2- 172.21.15.16:0/1397220107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980ce020 0x7fea980ce490 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.366+0000 7fea9f274640 1 -- 172.21.15.16:0/1397220107 >> 172.21.15.16:0/1397220107 conn(0x7fea9806c3e0 msgr2=0x7fea9806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.367+0000 7fea9f274640 1 -- 172.21.15.16:0/1397220107 shutdown_connections 2024-05-11T01:02:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.367+0000 7fea9f274640 1 -- 172.21.15.16:0/1397220107 wait complete. 2024-05-11T01:02:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.368+0000 7fea9f274640 1 Processor -- start 2024-05-11T01:02:11.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.368+0000 7fea9f274640 1 -- start start 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9f274640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980ce020 0x7fea981f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9f274640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980d0ea0 0x7fea981f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9f274640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea9815b920 0x7fea98159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9f274640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea9815fc20 con 0x7fea980d0ea0 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9f274640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fea980b4a50 con 0x7fea9815b920 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9f274640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fea9815bd00 con 0x7fea980ce020 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980d0ea0 0x7fea981f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980d0ea0 0x7fea981f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48052/0 (socket says 172.21.15.16:48052) 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 -- 172.21.15.16:0/653360331 learned_addr learned my addr 172.21.15.16:0/653360331 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:11.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9d010640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980ce020 0x7fea981f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9d811640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea9815b920 0x7fea98159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 -- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980ce020 msgr2=0x7fea981f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980ce020 0x7fea981f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 -- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea9815b920 msgr2=0x7fea98159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea9815b920 0x7fea98159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 -- 172.21.15.16:0/653360331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9814bfb0 con 0x7fea980d0ea0 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9d811640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea9815b920 0x7fea98159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9c80f640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980d0ea0 0x7fea981f25c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fea880090b0 tx=0x7fea880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea8dffb640 1 -- 172.21.15.16:0/653360331 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88038040 con 0x7fea980d0ea0 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea8dffb640 1 -- 172.21.15.16:0/653360331 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea88004030 con 0x7fea980d0ea0 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9814c290 con 0x7fea980d0ea0 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.369+0000 7fea8dffb640 1 -- 172.21.15.16:0/653360331 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88004420 con 0x7fea980d0ea0 2024-05-11T01:02:11.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.370+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9814c850 con 0x7fea980d0ea0 2024-05-11T01:02:11.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.371+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9806a5b0 con 0x7fea980d0ea0 2024-05-11T01:02:11.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.371+0000 7fea8dffb640 1 -- 172.21.15.16:0/653360331 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7fea88031770 con 0x7fea980d0ea0 2024-05-11T01:02:11.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.372+0000 7fea8dffb640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fea7c0764d0 0x7fea7c078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.372+0000 7fea8dffb640 1 -- 172.21.15.16:0/653360331 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fea880b8230 con 0x7fea980d0ea0 2024-05-11T01:02:11.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.372+0000 7fea9d010640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fea7c0764d0 0x7fea7c078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.373+0000 7fea9d010640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fea7c0764d0 0x7fea7c078990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea94000f60 tx=0x7fea94007c00 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:11.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.376+0000 7fea8dffb640 1 -- 172.21.15.16:0/653360331 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fea8802be20 con 0x7fea980d0ea0 2024-05-11T01:02:11.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.591+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fea980cd910 con 0x7fea7c0764d0 2024-05-11T01:02:11.644 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.643+0000 7fea8dffb640 1 -- 172.21.15.16:0/653360331 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fea980cd910 con 0x7fea7c0764d0 2024-05-11T01:02:11.644 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir7 2024-05-11T01:02:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fea7c0764d0 msgr2=0x7fea7c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fea7c0764d0 0x7fea7c078990 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea94000f60 tx=0x7fea94007c00 comp rx=0 tx=0).stop 2024-05-11T01:02:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980d0ea0 msgr2=0x7fea981f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980d0ea0 0x7fea981f25c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fea880090b0 tx=0x7fea880046c0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 shutdown_connections 2024-05-11T01:02:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fea7c0764d0 0x7fea7c078990 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea9815b920 0x7fea98159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980d0ea0 0x7fea981f25c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 --2- 172.21.15.16:0/653360331 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fea980ce020 0x7fea981f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 >> 172.21.15.16:0/653360331 conn(0x7fea9806c3e0 msgr2=0x7fea980cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 shutdown_connections 2024-05-11T01:02:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.645+0000 7fea9f274640 1 -- 172.21.15.16:0/653360331 wait complete. 2024-05-11T01:02:11.657 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2024-05-11T01:02:11.657 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir8 1m 2024-05-11T01:02:11.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.764+0000 7f3d852d3640 1 Processor -- start 2024-05-11T01:02:11.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.764+0000 7f3d852d3640 1 -- start start 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d852d3640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3d800d16c0 0x7f3d800d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d852d3640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d8015fd00 0x7f3d800b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d852d3640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d800d2e30 con 0x7f3d80160180 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d852d3640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3d800d3460 con 0x7f3d800d16c0 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d852d3640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3d80160750 con 0x7f3d8015fd00 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d7effd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3d800d16c0 0x7f3d800d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d7effd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3d800d16c0 0x7f3d800d38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48060/0 (socket says 172.21.15.16:48060) 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d7effd640 1 -- 172.21.15.16:0/4060240515 learned_addr learned my addr 172.21.15.16:0/4060240515 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:11.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d77fff640 1 --2- 172.21.15.16:0/4060240515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d8015fd00 0x7f3d800b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d7effd640 1 -- 172.21.15.16:0/4060240515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d8015fd00 msgr2=0x7f3d800b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:11.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d7effd640 1 --2- 172.21.15.16:0/4060240515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d8015fd00 0x7f3d800b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d7effd640 1 -- 172.21.15.16:0/4060240515 >> v1:172.21.15.174:6789/0 conn(0x7f3d80160180 legacy=0x7f3d8006d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:11.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.765+0000 7f3d7effd640 1 -- 172.21.15.16:0/4060240515 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d80160a30 con 0x7f3d800d16c0 2024-05-11T01:02:11.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.766+0000 7f3d7effd640 1 --2- 172.21.15.16:0/4060240515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d800d38f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009870 tx=0x7f3d7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4761e60bbb05b1a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:11.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.766+0000 7f3d7e7fc640 1 -- 172.21.15.16:0/4060240515 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70037070 con 0x7f3d800d16c0 2024-05-11T01:02:11.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.766+0000 7f3d7e7fc640 1 -- 172.21.15.16:0/4060240515 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d70032440 con 0x7f3d800d16c0 2024-05-11T01:02:11.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.766+0000 7f3d7e7fc640 1 -- 172.21.15.16:0/4060240515 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70032810 con 0x7f3d800d16c0 2024-05-11T01:02:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.767+0000 7f3d852d3640 1 -- 172.21.15.16:0/4060240515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 msgr2=0x7f3d800d38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.767+0000 7f3d852d3640 1 --2- 172.21.15.16:0/4060240515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d800d38f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009870 tx=0x7f3d7002a270 comp rx=0 tx=0).stop 2024-05-11T01:02:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.767+0000 7f3d852d3640 1 -- 172.21.15.16:0/4060240515 shutdown_connections 2024-05-11T01:02:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.767+0000 7f3d852d3640 1 --2- 172.21.15.16:0/4060240515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d8015fd00 0x7f3d800b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.767+0000 7f3d852d3640 1 --2- 172.21.15.16:0/4060240515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d800d38f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.767+0000 7f3d852d3640 1 -- 172.21.15.16:0/4060240515 >> 172.21.15.16:0/4060240515 conn(0x7f3d800681c0 msgr2=0x7f3d800685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.767+0000 7f3d852d3640 1 -- 172.21.15.16:0/4060240515 shutdown_connections 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.767+0000 7f3d852d3640 1 -- 172.21.15.16:0/4060240515 wait complete. 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.768+0000 7f3d852d3640 1 Processor -- start 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.768+0000 7f3d852d3640 1 -- start start 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d852d3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d801590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d852d3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d8015fd00 0x7f3d801555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d852d3640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d80160180 0x7f3d800b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d852d3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8006f3d0 con 0x7f3d800d16c0 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d852d3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8006f250 con 0x7f3d8015fd00 2024-05-11T01:02:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d852d3640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3d800d3e30 con 0x7f3d80160180 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d801590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d801590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48068/0 (socket says 172.21.15.16:48068) 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 -- 172.21.15.16:0/984919277 learned_addr learned my addr 172.21.15.16:0/984919277 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 -- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d80160180 msgr2=0x7f3d800b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d80160180 0x7f3d800b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 -- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d8015fd00 msgr2=0x7f3d801555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d8015fd00 0x7f3d801555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 -- 172.21.15.16:0/984919277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d80159620 con 0x7f3d800d16c0 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d7effd640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d801590e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3d70000c00 tx=0x7f3d700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.769+0000 7f3d777fe640 1 -- 172.21.15.16:0/984919277 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70041020 con 0x7f3d800d16c0 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.770+0000 7f3d777fe640 1 -- 172.21.15.16:0/984919277 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d700306c0 con 0x7f3d800d16c0 2024-05-11T01:02:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.770+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d80155b20 con 0x7f3d800d16c0 2024-05-11T01:02:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.770+0000 7f3d777fe640 1 -- 172.21.15.16:0/984919277 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70037040 con 0x7f3d800d16c0 2024-05-11T01:02:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.770+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d800c7bc0 con 0x7f3d800d16c0 2024-05-11T01:02:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.770+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8006a5b0 con 0x7f3d800d16c0 2024-05-11T01:02:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.771+0000 7f3d777fe640 1 -- 172.21.15.16:0/984919277 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f3d70044020 con 0x7f3d800d16c0 2024-05-11T01:02:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.772+0000 7f3d777fe640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3d600764d0 0x7f3d60078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.772+0000 7f3d777fe640 1 -- 172.21.15.16:0/984919277 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3d700b7f90 con 0x7f3d800d16c0 2024-05-11T01:02:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.772+0000 7f3d77fff640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3d600764d0 0x7f3d60078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:11.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.773+0000 7f3d77fff640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3d600764d0 0x7f3d60078990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d800c65d0 tx=0x7f3d68008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:11.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.776+0000 7f3d777fe640 1 -- 172.21.15.16:0/984919277 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3d7004b070 con 0x7f3d800d16c0 2024-05-11T01:02:11.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:11.990+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f3d800d06f0 con 0x7f3d600764d0 2024-05-11T01:02:12.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.038+0000 7f3d777fe640 1 -- 172.21.15.16:0/984919277 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f3d800d06f0 con 0x7f3d600764d0 2024-05-11T01:02:12.041 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir8 2024-05-11T01:02:12.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3d600764d0 msgr2=0x7f3d60078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3d600764d0 0x7f3d60078990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d800c65d0 tx=0x7f3d68008040 comp rx=0 tx=0).stop 2024-05-11T01:02:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 msgr2=0x7f3d801590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d801590e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3d70000c00 tx=0x7f3d700046c0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 shutdown_connections 2024-05-11T01:02:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3d600764d0 0x7f3d60078990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3d80160180 0x7f3d800b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d8015fd00 0x7f3d801555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 --2- 172.21.15.16:0/984919277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d800d16c0 0x7f3d801590e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.040+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 >> 172.21.15.16:0/984919277 conn(0x7f3d800681c0 msgr2=0x7f3d8015bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.041+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 shutdown_connections 2024-05-11T01:02:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.041+0000 7f3d852d3640 1 -- 172.21.15.16:0/984919277 wait complete. 2024-05-11T01:02:12.054 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2024-05-11T01:02:12.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir9 1m 2024-05-11T01:02:12.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.162+0000 7f127d533640 1 Processor -- start 2024-05-11T01:02:12.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.162+0000 7f127d533640 1 -- start start 2024-05-11T01:02:12.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f127d533640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f127815d170 0x7f127806c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:12.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f127d533640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f12780b14b0 0x7f1278073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:12.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f127d533640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127815d550 con 0x7f12780b1020 2024-05-11T01:02:12.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f127d533640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1278163f10 con 0x7f127815d170 2024-05-11T01:02:12.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f127d533640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f1278163300 con 0x7f12780b14b0 2024-05-11T01:02:12.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f1276ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f127815d170 0x7f127806c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f126ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f12780b1020 0x7f12780733d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58230/0 (socket says 172.21.15.16:58230) 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f126ffff640 1 -- 172.21.15.16:0/4215420569 learned_addr learned my addr 172.21.15.16:0/4215420569 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f12777fe640 1 --2- 172.21.15.16:0/4215420569 >> v2:172.21.15.174:3300/0 conn(0x7f12780b14b0 0x7f1278073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f1276ffd640 1 -- 172.21.15.16:0/4215420569 >> v2:172.21.15.174:3300/0 conn(0x7f12780b14b0 msgr2=0x7f1278073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f1276ffd640 1 --2- 172.21.15.16:0/4215420569 >> v2:172.21.15.174:3300/0 conn(0x7f12780b14b0 0x7f1278073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f1276ffd640 1 -- 172.21.15.16:0/4215420569 >> v1:172.21.15.16:6789/0 conn(0x7f12780b1020 legacy=0x7f12780733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f12767fc640 1 -- 172.21.15.16:0/4215420569 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826461997 0 0) 0x7f127815d550 con 0x7f12780b1020 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f1276ffd640 1 -- 172.21.15.16:0/4215420569 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12781635e0 con 0x7f127815d170 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.163+0000 7f12777fe640 1 --2- 172.21.15.16:0/4215420569 >> v2:172.21.15.174:3300/0 conn(0x7f12780b14b0 0x7f1278073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.164+0000 7f1276ffd640 1 --2- 172.21.15.16:0/4215420569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f127806c9a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1278164090 tx=0x7f126802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b54409ca36c7913 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.164+0000 7f12767fc640 1 -- 172.21.15.16:0/4215420569 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268037070 con 0x7f127815d170 2024-05-11T01:02:12.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.164+0000 7f12767fc640 1 -- 172.21.15.16:0/4215420569 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126802add0 con 0x7f127815d170 2024-05-11T01:02:12.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.164+0000 7f12767fc640 1 -- 172.21.15.16:0/4215420569 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268032660 con 0x7f127815d170 2024-05-11T01:02:12.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.165+0000 7f127d533640 1 -- 172.21.15.16:0/4215420569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 msgr2=0x7f127806c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.165+0000 7f127d533640 1 --2- 172.21.15.16:0/4215420569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f127806c9a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1278164090 tx=0x7f126802a080 comp rx=0 tx=0).stop 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.165+0000 7f127d533640 1 -- 172.21.15.16:0/4215420569 shutdown_connections 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.165+0000 7f127d533640 1 --2- 172.21.15.16:0/4215420569 >> v2:172.21.15.174:3300/0 conn(0x7f12780b14b0 0x7f1278073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.165+0000 7f127d533640 1 --2- 172.21.15.16:0/4215420569 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f127806c9a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.165+0000 7f127d533640 1 -- 172.21.15.16:0/4215420569 >> 172.21.15.16:0/4215420569 conn(0x7f12780d1fe0 msgr2=0x7f12780d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.165+0000 7f127d533640 1 -- 172.21.15.16:0/4215420569 shutdown_connections 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.165+0000 7f127d533640 1 -- 172.21.15.16:0/4215420569 wait complete. 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.166+0000 7f127d533640 1 Processor -- start 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.166+0000 7f127d533640 1 -- start start 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f127d533640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12780b1020 0x7f1278156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f127d533640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12780b14b0 0x7f12780b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f127d533640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f12781f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f127d533640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f127806cee0 con 0x7f127815d170 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f127d533640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1278163ba0 con 0x7f12780b14b0 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f127d533640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f12780b18e0 con 0x7f12780b1020 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f12781f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f12781f6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48094/0 (socket says 172.21.15.16:48094) 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 -- 172.21.15.16:0/1027061439 learned_addr learned my addr 172.21.15.16:0/1027061439 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f126ffff640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12780b14b0 0x7f12780b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f1276ffd640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12780b1020 0x7f1278156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 -- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12780b1020 msgr2=0x7f1278156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12780b1020 0x7f1278156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 -- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12780b14b0 msgr2=0x7f12780b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12780b14b0 0x7f12780b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 -- 172.21.15.16:0/1027061439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12780b2660 con 0x7f127815d170 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f1276ffd640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12780b1020 0x7f1278156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.167+0000 7f12777fe640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f12781f6260 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f127000cd50 tx=0x7f127000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.168+0000 7f126f7fe640 1 -- 172.21.15.16:0/1027061439 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127000f680 con 0x7f127815d170 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.168+0000 7f126f7fe640 1 -- 172.21.15.16:0/1027061439 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127000f840 con 0x7f127815d170 2024-05-11T01:02:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.168+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12780b2380 con 0x7f127815d170 2024-05-11T01:02:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.168+0000 7f126f7fe640 1 -- 172.21.15.16:0/1027061439 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127000fc30 con 0x7f127815d170 2024-05-11T01:02:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.168+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12781f5a60 con 0x7f127815d170 2024-05-11T01:02:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.169+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127806a5b0 con 0x7f127815d170 2024-05-11T01:02:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.169+0000 7f126f7fe640 1 -- 172.21.15.16:0/1027061439 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 10) ==== 98377+0+0 (secure 0 0 0) 0x7f12700213f0 con 0x7f127815d170 2024-05-11T01:02:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.170+0000 7f126f7fe640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f12580764d0 0x7f1258078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:02:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.170+0000 7f126f7fe640 1 -- 172.21.15.16:0/1027061439 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f12700988f0 con 0x7f127815d170 2024-05-11T01:02:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.170+0000 7f1276ffd640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f12580764d0 0x7f1258078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:02:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.171+0000 7f1276ffd640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f12580764d0 0x7f1258078990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f126802e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:02:12.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.174+0000 7f126f7fe640 1 -- 172.21.15.16:0/1027061439 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1270014030 con 0x7f127815d170 2024-05-11T01:02:12.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.394+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f127806d130 con 0x7f12580764d0 2024-05-11T01:02:12.448 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.447+0000 7f126f7fe640 1 -- 172.21.15.16:0/1027061439 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f127806d130 con 0x7f12580764d0 2024-05-11T01:02:12.449 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule activated for path /snap_test_dir1/dir9 2024-05-11T01:02:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f12580764d0 msgr2=0x7f1258078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f12580764d0 0x7f1258078990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1268034000 tx=0x7f126802e000 comp rx=0 tx=0).stop 2024-05-11T01:02:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 msgr2=0x7f12781f6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:02:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f12781f6260 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f127000cd50 tx=0x7f127000a650 comp rx=0 tx=0).stop 2024-05-11T01:02:12.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 shutdown_connections 2024-05-11T01:02:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f12580764d0 0x7f1258078990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f127815d170 0x7f12781f6260 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f12780b14b0 0x7f12780b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 --2- 172.21.15.16:0/1027061439 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f12780b1020 0x7f1278156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:02:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 >> 172.21.15.16:0/1027061439 conn(0x7f12780d1fe0 msgr2=0x7f1278160f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:02:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 shutdown_connections 2024-05-11T01:02:12.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:02:12.449+0000 7f127d533640 1 -- 172.21.15.16:0/1027061439 wait complete. 2024-05-11T01:02:12.461 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2024-05-11T01:02:19.255 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:02:19.258 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:02:49.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:02:49.536 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:03:00.050 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:03:00.049+0000 7fb2320c8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:03:00.050 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:03:00.049+0000 7fb2320c8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:03:00.050 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:03:00.049+0000 7fb2320c8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:03:00.050 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:03:00.049+0000 7fb2320c8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:03:00.051 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:03:00.049+0000 7fb2320c8640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:03:19.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:03:19.598 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:03:49.676 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:03:49.679 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:04:19.956 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:04:19.961 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:04:50.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:04:50.091 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:05:20.158 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:05:20.162 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:05:50.430 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:05:50.435 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:06:20.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:06:20.516 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:06:50.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:06:50.595 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:07:00.215 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:07:00.215+0000 7fb2318c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:07:00.215 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:07:00.215+0000 7fb2318c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:07:00.216 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:07:00.215+0000 7fb2318c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:07:00.216 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:07:00.215+0000 7fb2318c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:07:00.216 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:07:00.215+0000 7fb2318c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:07:20.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:07:20.707 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:07:50.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:07:50.847 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:08:20.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:08:20.926 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:08:51.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:08:51.040 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:09:21.158 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:09:21.162 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:09:51.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:09:51.291 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:10:21.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:10:21.355 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:10:51.498 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:10:51.502 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:11:21.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:11:21.616 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:11:51.674 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:11:51.677 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:12:21.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:12:21.808 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:12:51.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:12:51.947 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:13:19.466 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir0 1m 2024-05-11T01:13:19.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.589+0000 7f39c6bf7640 1 Processor -- start 2024-05-11T01:13:19.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.589+0000 7f39c6bf7640 1 -- start start 2024-05-11T01:13:19.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39c6bf7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f39c00707a0 0x7f39c0070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:19.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39c6bf7640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c0149230 con 0x7f39c006db00 2024-05-11T01:13:19.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39c6bf7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c0163290 con 0x7f39c0148e50 2024-05-11T01:13:19.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39c6bf7640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f39c0163570 con 0x7f39c00707a0 2024-05-11T01:13:19.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39b7fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f39c00707a0 0x7f39c0070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:19.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39c5194640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f39c006db00 0x7f39c006df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36834/0 (socket says 172.21.15.16:36834) 2024-05-11T01:13:19.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39c5194640 1 -- 172.21.15.16:0/2004909766 learned_addr learned my addr 172.21.15.16:0/2004909766 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:19.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39b7fff640 1 --2- 172.21.15.16:0/2004909766 >> v2:172.21.15.16:3300/0 conn(0x7f39c00707a0 0x7f39c0070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37128/0 (socket says 172.21.15.16:37128) 2024-05-11T01:13:19.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39b7fff640 1 -- 172.21.15.16:0/2004909766 >> v1:172.21.15.174:6789/0 conn(0x7f39c0148e50 legacy=0x7f39c00b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:19.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39b7fff640 1 -- 172.21.15.16:0/2004909766 >> v1:172.21.15.16:6789/0 conn(0x7f39c006db00 legacy=0x7f39c006df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:19.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39b77fe640 1 -- 172.21.15.16:0/2004909766 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923898747 0 0) 0x7f39c0149230 con 0x7f39c006db00 2024-05-11T01:13:19.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.590+0000 7f39b7fff640 1 -- 172.21.15.16:0/2004909766 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c0163850 con 0x7f39c00707a0 2024-05-11T01:13:19.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.591+0000 7f39b7fff640 1 --2- 172.21.15.16:0/2004909766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c00707a0 0x7f39c0070c30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097a0 tx=0x7f39b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a524b5a4059223fe server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:19.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.591+0000 7f39b77fe640 1 -- 172.21.15.16:0/2004909766 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0037070 con 0x7f39c00707a0 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.591+0000 7f39b77fe640 1 -- 172.21.15.16:0/2004909766 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b0032440 con 0x7f39c00707a0 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.591+0000 7f39b77fe640 1 -- 172.21.15.16:0/2004909766 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0032810 con 0x7f39c00707a0 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.592+0000 7f39c6bf7640 1 -- 172.21.15.16:0/2004909766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c00707a0 msgr2=0x7f39c0070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.592+0000 7f39c6bf7640 1 --2- 172.21.15.16:0/2004909766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c00707a0 0x7f39c0070c30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097a0 tx=0x7f39b002a230 comp rx=0 tx=0).stop 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.592+0000 7f39c6bf7640 1 -- 172.21.15.16:0/2004909766 shutdown_connections 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.592+0000 7f39c6bf7640 1 --2- 172.21.15.16:0/2004909766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c00707a0 0x7f39c0070c30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.592+0000 7f39c6bf7640 1 -- 172.21.15.16:0/2004909766 >> 172.21.15.16:0/2004909766 conn(0x7f39c00b8510 msgr2=0x7f39c00b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.592+0000 7f39c6bf7640 1 -- 172.21.15.16:0/2004909766 shutdown_connections 2024-05-11T01:13:19.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.592+0000 7f39c6bf7640 1 -- 172.21.15.16:0/2004909766 wait complete. 2024-05-11T01:13:19.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.594+0000 7f39c6bf7640 1 Processor -- start 2024-05-11T01:13:19.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.594+0000 7f39c6bf7640 1 -- start start 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c6bf7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39c006db00 0x7f39c0143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c6bf7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39c00707a0 0x7f39c0145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c6bf7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c0148e50 0x7f39c015e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c6bf7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00b62c0 con 0x7f39c0148e50 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c6bf7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00b6140 con 0x7f39c00707a0 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c6bf7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f39c006e640 con 0x7f39c006db00 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c0148e50 0x7f39c015e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c0148e50 0x7f39c015e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37134/0 (socket says 172.21.15.16:37134) 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 -- 172.21.15.16:0/205933408 learned_addr learned my addr 172.21.15.16:0/205933408 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39b7fff640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39c00707a0 0x7f39c0145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:19.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c4993640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39c006db00 0x7f39c0143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 -- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39c006db00 msgr2=0x7f39c0143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39c006db00 0x7f39c0143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 -- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39c00707a0 msgr2=0x7f39c0145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39c00707a0 0x7f39c0145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 -- 172.21.15.16:0/205933408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c015f4a0 con 0x7f39c0148e50 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.595+0000 7f39c5194640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c0148e50 0x7f39c015e0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c7a0 tx=0x7f39b800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.596+0000 7f39b57fa640 1 -- 172.21.15.16:0/205933408 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8018070 con 0x7f39c0148e50 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.596+0000 7f39b57fa640 1 -- 172.21.15.16:0/205933408 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b800a5e0 con 0x7f39c0148e50 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.596+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c013e8c0 con 0x7f39c0148e50 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.596+0000 7f39b57fa640 1 -- 172.21.15.16:0/205933408 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b800aa50 con 0x7f39c0148e50 2024-05-11T01:13:19.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.596+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c013ee80 con 0x7f39c0148e50 2024-05-11T01:13:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.597+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c006a5b0 con 0x7f39c0148e50 2024-05-11T01:13:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.597+0000 7f39b57fa640 1 -- 172.21.15.16:0/205933408 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f39b801b070 con 0x7f39c0148e50 2024-05-11T01:13:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.598+0000 7f39b57fa640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f39ac0764d0 0x7f39ac078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:19.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.598+0000 7f39b57fa640 1 -- 172.21.15.16:0/205933408 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f39b8096f50 con 0x7f39c0148e50 2024-05-11T01:13:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.598+0000 7f39c4993640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f39ac0764d0 0x7f39ac078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:19.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.599+0000 7f39c4993640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f39ac0764d0 0x7f39ac078990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:19.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.602+0000 7f39b57fa640 1 -- 172.21.15.16:0/205933408 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f39b805ff80 con 0x7f39c0148e50 2024-05-11T01:13:19.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.819+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f39c00d3d50 con 0x7f39ac0764d0 2024-05-11T01:13:19.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.892+0000 7f39b57fa640 1 -- 172.21.15.16:0/205933408 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f39c00d3d50 con 0x7f39ac0764d0 2024-05-11T01:13:19.892 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f39ac0764d0 msgr2=0x7f39ac078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f39ac0764d0 0x7f39ac078990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc009040 comp rx=0 tx=0).stop 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c0148e50 msgr2=0x7f39c015e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c0148e50 0x7f39c015e0d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c7a0 tx=0x7f39b800cc60 comp rx=0 tx=0).stop 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 shutdown_connections 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f39ac0764d0 0x7f39ac078990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39c0148e50 0x7f39c015e0d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f39c00707a0 0x7f39c0145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:19.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 --2- 172.21.15.16:0/205933408 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f39c006db00 0x7f39c0143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 >> 172.21.15.16:0/205933408 conn(0x7f39c00b8510 msgr2=0x7f39c0160cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 shutdown_connections 2024-05-11T01:13:19.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:19.894+0000 7f39c6bf7640 1 -- 172.21.15.16:0/205933408 wait complete. 2024-05-11T01:13:19.904 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2024-05-11T01:13:19.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir1 1m 2024-05-11T01:13:20.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.012+0000 7fc0ff2b0640 1 Processor -- start 2024-05-11T01:13:20.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.012+0000 7fc0ff2b0640 1 -- start start 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0ff2b0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0f80707a0 0x7fc0f8070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0ff2b0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f806db00 0x7fc0f806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0ff2b0640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f8149230 con 0x7fc0f8148e50 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0ff2b0640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc0f8163290 con 0x7fc0f80707a0 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0ff2b0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f8163570 con 0x7fc0f806db00 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0fc84b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0f80707a0 0x7fc0f8070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0fd04c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc0f8148e50 0x7fc0f80b66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36850/0 (socket says 172.21.15.16:36850) 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0fd04c640 1 -- 172.21.15.16:0/119397032 learned_addr learned my addr 172.21.15.16:0/119397032 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:20.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.013+0000 7fc0fc84b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0f80707a0 0x7fc0f8070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37148/0 (socket says 172.21.15.16:37148) 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.014+0000 7fc0fd84d640 1 --2- 172.21.15.16:0/119397032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f806db00 0x7fc0f806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.014+0000 7fc0fc84b640 1 -- 172.21.15.16:0/119397032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f806db00 msgr2=0x7fc0f806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.014+0000 7fc0fc84b640 1 --2- 172.21.15.16:0/119397032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f806db00 0x7fc0f806df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.014+0000 7fc0fc84b640 1 -- 172.21.15.16:0/119397032 >> v1:172.21.15.16:6789/0 conn(0x7fc0f8148e50 legacy=0x7fc0f80b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.014+0000 7fc0fc84b640 1 -- 172.21.15.16:0/119397032 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f8163850 con 0x7fc0f80707a0 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.014+0000 7fc0f7fff640 1 -- 172.21.15.16:0/119397032 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434300267 0 0) 0x7fc0f8149230 con 0x7fc0f8148e50 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.014+0000 7fc0fc84b640 1 --2- 172.21.15.16:0/119397032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f80707a0 0x7fc0f8070c30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0097a0 tx=0x7fc0ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5fdee22cc4c52b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0f7fff640 1 -- 172.21.15.16:0/119397032 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec037070 con 0x7fc0f80707a0 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0f7fff640 1 -- 172.21.15.16:0/119397032 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ec032440 con 0x7fc0f80707a0 2024-05-11T01:13:20.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0f7fff640 1 -- 172.21.15.16:0/119397032 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec032810 con 0x7fc0f80707a0 2024-05-11T01:13:20.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/119397032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f80707a0 msgr2=0x7fc0f8070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/119397032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f80707a0 0x7fc0f8070c30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0097a0 tx=0x7fc0ec02a180 comp rx=0 tx=0).stop 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/119397032 shutdown_connections 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/119397032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f806db00 0x7fc0f806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/119397032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f80707a0 0x7fc0f8070c30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/119397032 >> 172.21.15.16:0/119397032 conn(0x7fc0f80b8510 msgr2=0x7fc0f80b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/119397032 shutdown_connections 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.015+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/119397032 wait complete. 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.016+0000 7fc0ff2b0640 1 Processor -- start 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0ff2b0640 1 -- start start 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0ff2b0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f806db00 0x7fc0f81476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0ff2b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0f80707a0 0x7fc0f815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0ff2b0640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f8148e50 0x7fc0f813e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0ff2b0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f80b62c0 con 0x7fc0f806db00 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0ff2b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f80b6140 con 0x7fc0f80707a0 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0ff2b0640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc0f806e4b0 con 0x7fc0f8148e50 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0fd04c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f806db00 0x7fc0f81476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0fd04c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f806db00 0x7fc0f81476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37164/0 (socket says 172.21.15.16:37164) 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.017+0000 7fc0fd04c640 1 -- 172.21.15.16:0/2170293164 learned_addr learned my addr 172.21.15.16:0/2170293164 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0fd84d640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f8148e50 0x7fc0f813e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0fd04c640 1 -- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f8148e50 msgr2=0x7fc0f813e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0fd04c640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f8148e50 0x7fc0f813e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0fd04c640 1 -- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0f80707a0 msgr2=0x7fc0f815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0fd04c640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0f80707a0 0x7fc0f815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0fd04c640 1 -- 172.21.15.16:0/2170293164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f813f5b0 con 0x7fc0f806db00 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0fd84d640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f8148e50 0x7fc0f813e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0fd04c640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f806db00 0x7fc0f81476d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000c3e0 tx=0x7fc0f000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0f5ffb640 1 -- 172.21.15.16:0/2170293164 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f00074e0 con 0x7fc0f806db00 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0f5ffb640 1 -- 172.21.15.16:0/2170293164 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f00047e0 con 0x7fc0f806db00 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f813ed10 con 0x7fc0f806db00 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0f5ffb640 1 -- 172.21.15.16:0/2170293164 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0004bd0 con 0x7fc0f806db00 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.018+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f813f2d0 con 0x7fc0f806db00 2024-05-11T01:13:20.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.019+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f806a5b0 con 0x7fc0f806db00 2024-05-11T01:13:20.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.020+0000 7fc0f5ffb640 1 -- 172.21.15.16:0/2170293164 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7fc0f0011070 con 0x7fc0f806db00 2024-05-11T01:13:20.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.021+0000 7fc0f5ffb640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc0e40764d0 0x7fc0e4078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.021+0000 7fc0f5ffb640 1 -- 172.21.15.16:0/2170293164 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fc0f0097780 con 0x7fc0f806db00 2024-05-11T01:13:20.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.021+0000 7fc0fc84b640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc0e40764d0 0x7fc0e4078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.021+0000 7fc0fc84b640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc0e40764d0 0x7fc0e4078990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec034000 tx=0x7fc0ec02c000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.025+0000 7fc0f5ffb640 1 -- 172.21.15.16:0/2170293164 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc0f0060cc0 con 0x7fc0f806db00 2024-05-11T01:13:20.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.238+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc0f81483c0 con 0x7fc0e40764d0 2024-05-11T01:13:20.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.312+0000 7fc0f5ffb640 1 -- 172.21.15.16:0/2170293164 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fc0f81483c0 con 0x7fc0e40764d0 2024-05-11T01:13:20.312 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2024-05-11T01:13:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.314+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc0e40764d0 msgr2=0x7fc0e4078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc0e40764d0 0x7fc0e4078990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec034000 tx=0x7fc0ec02c000 comp rx=0 tx=0).stop 2024-05-11T01:13:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f806db00 msgr2=0x7fc0f81476d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f806db00 0x7fc0f81476d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000c3e0 tx=0x7fc0f000c8a0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 shutdown_connections 2024-05-11T01:13:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fc0e40764d0 0x7fc0e4078990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc0f8148e50 0x7fc0f813e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0f80707a0 0x7fc0f815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 --2- 172.21.15.16:0/2170293164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0f806db00 0x7fc0f81476d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 >> 172.21.15.16:0/2170293164 conn(0x7fc0f80b8510 msgr2=0x7fc0f80b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:20.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 shutdown_connections 2024-05-11T01:13:20.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.315+0000 7fc0ff2b0640 1 -- 172.21.15.16:0/2170293164 wait complete. 2024-05-11T01:13:20.324 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2024-05-11T01:13:20.324 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir2 1m 2024-05-11T01:13:20.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.432+0000 7f37afb0a640 1 Processor -- start 2024-05-11T01:13:20.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.432+0000 7f37afb0a640 1 -- start start 2024-05-11T01:13:20.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37afb0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a80cd940 0x7f37a80cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37afb0a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37a8140b00 0x7f37a8140f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37afb0a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a815db00 con 0x7f37a81402d0 2024-05-11T01:13:20.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37afb0a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f37a815dde0 con 0x7f37a8140b00 2024-05-11T01:13:20.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37afb0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f37a815e0c0 con 0x7f37a80cd940 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ae0a7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37a8140b00 0x7f37a8140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ae0a7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37a8140b00 0x7f37a8140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37176/0 (socket says 172.21.15.16:37176) 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ad8a6640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f37a81402d0 0x7f37a80b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36866/0 (socket says 172.21.15.16:36866) 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ae0a7640 1 -- 172.21.15.16:0/1789767148 learned_addr learned my addr 172.21.15.16:0/1789767148 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ad0a5640 1 --2- 172.21.15.16:0/1789767148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a80cd940 0x7f37a80cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ae0a7640 1 -- 172.21.15.16:0/1789767148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a80cd940 msgr2=0x7f37a80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ae0a7640 1 --2- 172.21.15.16:0/1789767148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a80cd940 0x7f37a80cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ae0a7640 1 -- 172.21.15.16:0/1789767148 >> v1:172.21.15.16:6789/0 conn(0x7f37a81402d0 legacy=0x7f37a80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ae0a7640 1 -- 172.21.15.16:0/1789767148 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a815e3a0 con 0x7f37a8140b00 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ac8a4640 1 -- 172.21.15.16:0/1789767148 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405133834 0 0) 0x7f37a815db00 con 0x7f37a81402d0 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.433+0000 7f37ad0a5640 1 --2- 172.21.15.16:0/1789767148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a80cd940 0x7f37a80cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.434+0000 7f37ae0a7640 1 --2- 172.21.15.16:0/1789767148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a8140b00 0x7f37a8140f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009e50 tx=0x7f37a002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1502aaf4709373 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.434+0000 7f37ac8a4640 1 -- 172.21.15.16:0/1789767148 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a0036070 con 0x7f37a8140b00 2024-05-11T01:13:20.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.434+0000 7f37ac8a4640 1 -- 172.21.15.16:0/1789767148 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a0031600 con 0x7f37a8140b00 2024-05-11T01:13:20.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.434+0000 7f37ac8a4640 1 -- 172.21.15.16:0/1789767148 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a00319d0 con 0x7f37a8140b00 2024-05-11T01:13:20.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.435+0000 7f37afb0a640 1 -- 172.21.15.16:0/1789767148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a8140b00 msgr2=0x7f37a8140f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.435+0000 7f37afb0a640 1 --2- 172.21.15.16:0/1789767148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a8140b00 0x7f37a8140f30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009e50 tx=0x7f37a002a710 comp rx=0 tx=0).stop 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.435+0000 7f37afb0a640 1 -- 172.21.15.16:0/1789767148 shutdown_connections 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.435+0000 7f37afb0a640 1 --2- 172.21.15.16:0/1789767148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a8140b00 0x7f37a8140f30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.435+0000 7f37afb0a640 1 --2- 172.21.15.16:0/1789767148 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a80cd940 0x7f37a80cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.435+0000 7f37afb0a640 1 -- 172.21.15.16:0/1789767148 >> 172.21.15.16:0/1789767148 conn(0x7f37a806c3e0 msgr2=0x7f37a806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.435+0000 7f37afb0a640 1 -- 172.21.15.16:0/1789767148 shutdown_connections 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.435+0000 7f37afb0a640 1 -- 172.21.15.16:0/1789767148 wait complete. 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.436+0000 7f37afb0a640 1 Processor -- start 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.436+0000 7f37afb0a640 1 -- start start 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37afb0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a80cd940 0x7f37a813fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37afb0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a81402d0 0x7f37a80ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37afb0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37a8140b00 0x7f37a80aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37afb0a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f37a80b2d40 con 0x7f37a80cd940 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37afb0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f37a81406b0 con 0x7f37a8140b00 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37afb0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f37a80b2ec0 con 0x7f37a81402d0 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a80cd940 0x7f37a813fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a80cd940 0x7f37a813fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37192/0 (socket says 172.21.15.16:37192) 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 -- 172.21.15.16:0/2018959360 learned_addr learned my addr 172.21.15.16:0/2018959360 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad0a5640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a81402d0 0x7f37a80ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 -- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a81402d0 msgr2=0x7f37a80ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a81402d0 0x7f37a80ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 -- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37a8140b00 msgr2=0x7f37a80aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37a8140b00 0x7f37a80aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 -- 172.21.15.16:0/2018959360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a80af020 con 0x7f37a80cd940 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad0a5640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a81402d0 0x7f37a80ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:20.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.437+0000 7f37ad8a6640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a80cd940 0x7f37a813fab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c4c0 tx=0x7f37a400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.438+0000 7f379e7fc640 1 -- 172.21.15.16:0/2018959360 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4018070 con 0x7f37a80cd940 2024-05-11T01:13:20.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.438+0000 7f379e7fc640 1 -- 172.21.15.16:0/2018959360 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a4007500 con 0x7f37a80cd940 2024-05-11T01:13:20.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.438+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a80af300 con 0x7f37a80cd940 2024-05-11T01:13:20.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.438+0000 7f379e7fc640 1 -- 172.21.15.16:0/2018959360 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a4004a20 con 0x7f37a80cd940 2024-05-11T01:13:20.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.438+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a80af8c0 con 0x7f37a80cd940 2024-05-11T01:13:20.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.439+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a806a5b0 con 0x7f37a80cd940 2024-05-11T01:13:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.439+0000 7f379e7fc640 1 -- 172.21.15.16:0/2018959360 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f37a401b070 con 0x7f37a80cd940 2024-05-11T01:13:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.440+0000 7f379e7fc640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f378c076500 0x7f378c0789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.440+0000 7f379e7fc640 1 -- 172.21.15.16:0/2018959360 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f37a4096d10 con 0x7f37a80cd940 2024-05-11T01:13:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.440+0000 7f37ad0a5640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f378c076500 0x7f378c0789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.441+0000 7f37ad0a5640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f378c076500 0x7f378c0789c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3798006fd0 tx=0x7f3798008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.446+0000 7f379e7fc640 1 -- 172.21.15.16:0/2018959360 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f37a4060380 con 0x7f37a80cd940 2024-05-11T01:13:20.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.663+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f37a8141bb0 con 0x7f378c076500 2024-05-11T01:13:20.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.736+0000 7f379e7fc640 1 -- 172.21.15.16:0/2018959360 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f37a8141bb0 con 0x7f378c076500 2024-05-11T01:13:20.735 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2024-05-11T01:13:20.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f378c076500 msgr2=0x7f378c0789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f378c076500 0x7f378c0789c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3798006fd0 tx=0x7f3798008040 comp rx=0 tx=0).stop 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a80cd940 msgr2=0x7f37a813fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a80cd940 0x7f37a813fab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f37a400c4c0 tx=0x7f37a400c980 comp rx=0 tx=0).stop 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 shutdown_connections 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f378c076500 0x7f378c0789c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f37a8140b00 0x7f37a80aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f37a81402d0 0x7f37a80ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 --2- 172.21.15.16:0/2018959360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37a80cd940 0x7f37a813fab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 >> 172.21.15.16:0/2018959360 conn(0x7f37a806c3e0 msgr2=0x7f37a80b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 shutdown_connections 2024-05-11T01:13:20.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.738+0000 7f37afb0a640 1 -- 172.21.15.16:0/2018959360 wait complete. 2024-05-11T01:13:20.748 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2024-05-11T01:13:20.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir3 1m 2024-05-11T01:13:20.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.855+0000 7f8adfb5f640 1 Processor -- start 2024-05-11T01:13:20.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.855+0000 7f8adfb5f640 1 -- start start 2024-05-11T01:13:20.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adfb5f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ad815f6b0 0x7f8ad80d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adfb5f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80bac80 0x7f8ad80d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adfb5f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad815fa90 con 0x7f8ad80d00e0 2024-05-11T01:13:20.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adfb5f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad80d3750 con 0x7f8ad815f6b0 2024-05-11T01:13:20.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adfb5f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad80d39f0 con 0x7f8ad80bac80 2024-05-11T01:13:20.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8ade0fc640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8ad80d00e0 0x7f8ad80b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36868/0 (socket says 172.21.15.16:36868) 2024-05-11T01:13:20.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8ade0fc640 1 -- 172.21.15.16:0/4247598678 learned_addr learned my addr 172.21.15.16:0/4247598678 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:20.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945481561 0 0) 0x7f8ad815fa90 con 0x7f8ad80d00e0 2024-05-11T01:13:20.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8add0fa640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80bac80 0x7f8ad80d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8add8fb640 1 --2- 172.21.15.16:0/4247598678 >> v2:172.21.15.174:3300/0 conn(0x7f8ad815f6b0 0x7f8ad80d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac4003520 con 0x7f8ad80d00e0 2024-05-11T01:13:20.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2749083949 0 0) 0x7f8ac4003520 con 0x7f8ad80d00e0 2024-05-11T01:13:20.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80bac80 msgr2=0x7f8ad80d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80bac80 0x7f8ad80d4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 >> v2:172.21.15.174:3300/0 conn(0x7f8ad815f6b0 msgr2=0x7f8ad80d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 --2- 172.21.15.16:0/4247598678 >> v2:172.21.15.174:3300/0 conn(0x7f8ad815f6b0 0x7f8ad80d3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad80d3cd0 con 0x7f8ad80d00e0 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f8ad0001a70 con 0x7f8ad80d00e0 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.856+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 >> v1:172.21.15.16:6789/0 conn(0x7f8ad80d00e0 legacy=0x7f8ad80b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8adc8f9640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80bac80 0x7f8ac4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8adc8f9640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4003fd0 0x7f8ac4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8adc8f9640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4004d40 0x7f8ac40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80d3750 con 0x7f8ac4003fd0 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80d39f0 con 0x7f8ac4004d40 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac400baa0 con 0x7f8ad80bac80 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8add0fa640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4003fd0 0x7f8ac4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8add8fb640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80bac80 0x7f8ac4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8ade0fc640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4004d40 0x7f8ac40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8add0fa640 1 -- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80bac80 msgr2=0x7f8ac4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8add0fa640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad80bac80 0x7f8ac4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8add0fa640 1 -- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4004d40 msgr2=0x7f8ac40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8add0fa640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4004d40 0x7f8ac40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.857+0000 7f8add0fa640 1 -- 172.21.15.16:0/4247598678 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac4003520 con 0x7f8ac4003fd0 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8add0fa640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4003fd0 0x7f8ac4004800 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009ac0 tx=0x7f8ac4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cb6b4270b06f17 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8036070 con 0x7f8ac4003fd0 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac8031400 con 0x7f8ac4003fd0 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8adc8f9640 1 -- 172.21.15.16:0/4247598678 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac8009690 con 0x7f8ac4003fd0 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8adfb5f640 1 -- 172.21.15.16:0/4247598678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4003fd0 msgr2=0x7f8ac4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8adfb5f640 1 --2- 172.21.15.16:0/4247598678 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ac4003fd0 0x7f8ac4004800 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ac8009ac0 tx=0x7f8ac4005830 comp rx=0 tx=0).stop 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8ade0fc640 1 -- 172.21.15.16:0/4247598678 reap_dead start 2024-05-11T01:13:20.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8adfb5f640 1 -- 172.21.15.16:0/4247598678 shutdown_connections 2024-05-11T01:13:20.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.858+0000 7f8adfb5f640 1 -- 172.21.15.16:0/4247598678 >> 172.21.15.16:0/4247598678 conn(0x7f8ad8073f00 msgr2=0x7f8ad8074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:20.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.859+0000 7f8adfb5f640 1 -- 172.21.15.16:0/4247598678 shutdown_connections 2024-05-11T01:13:20.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.859+0000 7f8adfb5f640 1 -- 172.21.15.16:0/4247598678 wait complete. 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.860+0000 7f8adfb5f640 1 Processor -- start 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.860+0000 7f8adfb5f640 1 -- start start 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.860+0000 7f8adfb5f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003fd0 0x7f8ad81f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.860+0000 7f8adfb5f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad814d9e0 0x7f8ad80ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.860+0000 7f8adfb5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad814de40 0x7f8ad80b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.860+0000 7f8adfb5f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80d4570 con 0x7f8ad814de40 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8adfb5f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad80d4290 con 0x7f8ac4003fd0 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8adfb5f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad80d0570 con 0x7f8ad814d9e0 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad814de40 0x7f8ad80b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad814de40 0x7f8ad80b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37220/0 (socket says 172.21.15.16:37220) 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 -- 172.21.15.16:0/668527476 learned_addr learned my addr 172.21.15.16:0/668527476 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:20.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8add8fb640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003fd0 0x7f8ad81f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8add0fa640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad814d9e0 0x7f8ad80ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 -- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad814d9e0 msgr2=0x7f8ad80ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad814d9e0 0x7f8ad80ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 -- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003fd0 msgr2=0x7f8ad81f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003fd0 0x7f8ad81f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 -- 172.21.15.16:0/668527476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad814eaa0 con 0x7f8ad814de40 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8add8fb640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003fd0 0x7f8ad81f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ade0fc640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad814de40 0x7f8ad80b6810 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80d1140 tx=0x7f8ad0007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ace7fc640 1 -- 172.21.15.16:0/668527476 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0017020 con 0x7f8ad814de40 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ace7fc640 1 -- 172.21.15.16:0/668527476 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad000ac80 con 0x7f8ad814de40 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8ace7fc640 1 -- 172.21.15.16:0/668527476 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad0013610 con 0x7f8ad814de40 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad8159560 con 0x7f8ad814de40 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.861+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad8159b20 con 0x7f8ad814de40 2024-05-11T01:13:20.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.862+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad806a5b0 con 0x7f8ad814de40 2024-05-11T01:13:20.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.863+0000 7f8ace7fc640 1 -- 172.21.15.16:0/668527476 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f8ad001a020 con 0x7f8ad814de40 2024-05-11T01:13:20.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.863+0000 7f8ace7fc640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8abc0764d0 0x7f8abc078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:20.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.864+0000 7f8ace7fc640 1 -- 172.21.15.16:0/668527476 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8ad00981d0 con 0x7f8ad814de40 2024-05-11T01:13:20.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.864+0000 7f8add8fb640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8abc0764d0 0x7f8abc078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:20.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.864+0000 7f8add8fb640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8abc0764d0 0x7f8abc078990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009b30 tx=0x7f8ad4008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:20.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:20.868+0000 7f8ace7fc640 1 -- 172.21.15.16:0/668527476 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ad0021020 con 0x7f8ad814de40 2024-05-11T01:13:21.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.086+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f8ad8162920 con 0x7f8abc0764d0 2024-05-11T01:13:21.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.155+0000 7f8ace7fc640 1 -- 172.21.15.16:0/668527476 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f8ad8162920 con 0x7f8abc0764d0 2024-05-11T01:13:21.154 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2024-05-11T01:13:21.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8abc0764d0 msgr2=0x7f8abc078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8abc0764d0 0x7f8abc078990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009b30 tx=0x7f8ad4008040 comp rx=0 tx=0).stop 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad814de40 msgr2=0x7f8ad80b6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad814de40 0x7f8ad80b6810 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80d1140 tx=0x7f8ad0007b20 comp rx=0 tx=0).stop 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 shutdown_connections 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8abc0764d0 0x7f8abc078990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad814de40 0x7f8ad80b6810 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ad814d9e0 0x7f8ad80ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 --2- 172.21.15.16:0/668527476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ac4003fd0 0x7f8ad81f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 >> 172.21.15.16:0/668527476 conn(0x7f8ad8073f00 msgr2=0x7f8ad80b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 shutdown_connections 2024-05-11T01:13:21.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.157+0000 7f8adfb5f640 1 -- 172.21.15.16:0/668527476 wait complete. 2024-05-11T01:13:21.167 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2024-05-11T01:13:21.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir4 1m 2024-05-11T01:13:21.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.274+0000 7fd253faf640 1 Processor -- start 2024-05-11T01:13:21.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.274+0000 7fd253faf640 1 -- start start 2024-05-11T01:13:21.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd253faf640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd24c15f680 0x7fd24c0d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd253faf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd24c0d0e40 0x7fd24c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd253faf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24c0b5230 0x7fd24c163340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd253faf640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd24c0b56a0 con 0x7fd24c0d0e40 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd253faf640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fd24c06d600 con 0x7fd24c15f680 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd253faf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd24c06d8e0 con 0x7fd24c0b5230 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd25154a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd24c0d0e40 0x7fd24c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd25154a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd24c0d0e40 0x7fd24c0b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37228/0 (socket says 172.21.15.16:37228) 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd25154a640 1 -- 172.21.15.16:0/1206596311 learned_addr learned my addr 172.21.15.16:0/1206596311 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd25154a640 1 -- 172.21.15.16:0/1206596311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24c0b5230 msgr2=0x7fd24c163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd251d4b640 1 --2- 172.21.15.16:0/1206596311 >> v2:172.21.15.174:3300/0 conn(0x7fd24c15f680 0x7fd24c0d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd25154a640 1 --2- 172.21.15.16:0/1206596311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24c0b5230 0x7fd24c163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd25154a640 1 -- 172.21.15.16:0/1206596311 >> v2:172.21.15.174:3300/0 conn(0x7fd24c15f680 msgr2=0x7fd24c0d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd25154a640 1 --2- 172.21.15.16:0/1206596311 >> v2:172.21.15.174:3300/0 conn(0x7fd24c15f680 0x7fd24c0d3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.275+0000 7fd25154a640 1 -- 172.21.15.16:0/1206596311 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c06dbc0 con 0x7fd24c0d0e40 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.276+0000 7fd25154a640 1 --2- 172.21.15.16:0/1206596311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0d0e40 0x7fd24c0b4cf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd24c06cee0 tx=0x7fd23c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac887e0537f3ba9c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.276+0000 7fd250d49640 1 -- 172.21.15.16:0/1206596311 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c037070 con 0x7fd24c0d0e40 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.276+0000 7fd250d49640 1 -- 172.21.15.16:0/1206596311 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23c032440 con 0x7fd24c0d0e40 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.276+0000 7fd250d49640 1 -- 172.21.15.16:0/1206596311 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c032810 con 0x7fd24c0d0e40 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.276+0000 7fd253faf640 1 -- 172.21.15.16:0/1206596311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0d0e40 msgr2=0x7fd24c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.276+0000 7fd253faf640 1 --2- 172.21.15.16:0/1206596311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0d0e40 0x7fd24c0b4cf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd24c06cee0 tx=0x7fd23c02a1e0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.277+0000 7fd253faf640 1 -- 172.21.15.16:0/1206596311 shutdown_connections 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.277+0000 7fd253faf640 1 --2- 172.21.15.16:0/1206596311 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24c0b5230 0x7fd24c163340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.277+0000 7fd253faf640 1 --2- 172.21.15.16:0/1206596311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0d0e40 0x7fd24c0b4cf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.277+0000 7fd253faf640 1 --2- 172.21.15.16:0/1206596311 >> v2:172.21.15.174:3300/0 conn(0x7fd24c15f680 0x7fd24c0d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.277+0000 7fd253faf640 1 -- 172.21.15.16:0/1206596311 >> 172.21.15.16:0/1206596311 conn(0x7fd24c0681c0 msgr2=0x7fd24c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:21.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.277+0000 7fd253faf640 1 -- 172.21.15.16:0/1206596311 shutdown_connections 2024-05-11T01:13:21.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.277+0000 7fd253faf640 1 -- 172.21.15.16:0/1206596311 wait complete. 2024-05-11T01:13:21.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.278+0000 7fd253faf640 1 Processor -- start 2024-05-11T01:13:21.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.278+0000 7fd253faf640 1 -- start start 2024-05-11T01:13:21.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd253faf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0b5230 0x7fd24c1f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd253faf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24c0d0e40 0x7fd24c0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd253faf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24c15f680 0x7fd24c1f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd253faf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c0d3e50 con 0x7fd24c0b5230 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd253faf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c06e180 con 0x7fd24c0d0e40 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd253faf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd24c0d3fd0 con 0x7fd24c15f680 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0b5230 0x7fd24c1f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0b5230 0x7fd24c1f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37238/0 (socket says 172.21.15.16:37238) 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 -- 172.21.15.16:0/1763691534 learned_addr learned my addr 172.21.15.16:0/1763691534 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 -- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24c15f680 msgr2=0x7fd24c1f8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24c15f680 0x7fd24c1f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 -- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24c0d0e40 msgr2=0x7fd24c0c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24c0d0e40 0x7fd24c0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 -- 172.21.15.16:0/1763691534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c1f9620 con 0x7fd24c0b5230 2024-05-11T01:13:21.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd251d4b640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0b5230 0x7fd24c1f60a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c7f0 tx=0x7fd24800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:21.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd2427fc640 1 -- 172.21.15.16:0/1763691534 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248015070 con 0x7fd24c0b5230 2024-05-11T01:13:21.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd2427fc640 1 -- 172.21.15.16:0/1763691534 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd248004240 con 0x7fd24c0b5230 2024-05-11T01:13:21.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd2427fc640 1 -- 172.21.15.16:0/1763691534 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248007620 con 0x7fd24c0b5230 2024-05-11T01:13:21.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.279+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c1f9900 con 0x7fd24c0b5230 2024-05-11T01:13:21.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.280+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c1f5580 con 0x7fd24c0b5230 2024-05-11T01:13:21.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.280+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24c06a5b0 con 0x7fd24c0b5230 2024-05-11T01:13:21.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.281+0000 7fd2427fc640 1 -- 172.21.15.16:0/1763691534 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7fd2480079d0 con 0x7fd24c0b5230 2024-05-11T01:13:21.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.282+0000 7fd2427fc640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd2300764d0 0x7fd230078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.282+0000 7fd2427fc640 1 -- 172.21.15.16:0/1763691534 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fd248098030 con 0x7fd24c0b5230 2024-05-11T01:13:21.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.282+0000 7fd25154a640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd2300764d0 0x7fd230078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.283+0000 7fd25154a640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd2300764d0 0x7fd230078990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd23c034000 tx=0x7fd23c02c000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:21.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.286+0000 7fd2427fc640 1 -- 172.21.15.16:0/1763691534 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd2480614f0 con 0x7fd24c0b5230 2024-05-11T01:13:21.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.500+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fd24c0d37a0 con 0x7fd2300764d0 2024-05-11T01:13:21.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.572+0000 7fd2427fc640 1 -- 172.21.15.16:0/1763691534 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fd24c0d37a0 con 0x7fd2300764d0 2024-05-11T01:13:21.571 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2024-05-11T01:13:21.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd2300764d0 msgr2=0x7fd230078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd2300764d0 0x7fd230078990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd23c034000 tx=0x7fd23c02c000 comp rx=0 tx=0).stop 2024-05-11T01:13:21.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0b5230 msgr2=0x7fd24c1f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0b5230 0x7fd24c1f60a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c7f0 tx=0x7fd24800ccb0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 shutdown_connections 2024-05-11T01:13:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd2300764d0 0x7fd230078990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd24c15f680 0x7fd24c1f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd24c0d0e40 0x7fd24c0c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 --2- 172.21.15.16:0/1763691534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd24c0b5230 0x7fd24c1f60a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 >> 172.21.15.16:0/1763691534 conn(0x7fd24c0681c0 msgr2=0x7fd24c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 shutdown_connections 2024-05-11T01:13:21.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.574+0000 7fd253faf640 1 -- 172.21.15.16:0/1763691534 wait complete. 2024-05-11T01:13:21.584 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2024-05-11T01:13:21.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir5 1m 2024-05-11T01:13:21.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.691+0000 7ffa5b7f9640 1 Processor -- start 2024-05-11T01:13:21.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.691+0000 7ffa5b7f9640 1 -- start start 2024-05-11T01:13:21.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa5b7f9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa540b14b0 0x7ffa540b5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa5b7f9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa540b1920 con 0x7ffa5415d170 2024-05-11T01:13:21.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa5b7f9640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa5415d550 con 0x7ffa540b1020 2024-05-11T01:13:21.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa5b7f9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffa54163f10 con 0x7ffa540b14b0 2024-05-11T01:13:21.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa59595640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ffa5415d170 0x7ffa5406c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36870/0 (socket says 172.21.15.16:36870) 2024-05-11T01:13:21.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa59595640 1 -- 172.21.15.16:0/176519517 learned_addr learned my addr 172.21.15.16:0/176519517 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:21.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa59d96640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa540b14b0 0x7ffa540b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189191026 0 0) 0x7ffa540b1920 con 0x7ffa5415d170 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa40003520 con 0x7ffa5415d170 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2187385230 0 0) 0x7ffa40003520 con 0x7ffa5415d170 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa540b14b0 msgr2=0x7ffa540b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa4bfff640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa540b14b0 0x7ffa540b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 >> v1:172.21.15.174:6789/0 conn(0x7ffa540b1020 legacy=0x7ffa540b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.692+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa54163300 con 0x7ffa5415d170 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7ffa500016f0 con 0x7ffa5415d170 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 >> v1:172.21.15.16:6789/0 conn(0x7ffa5415d170 legacy=0x7ffa5406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa4bfff640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa40003a30 0x7ffa40003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa4bfff640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa540b14b0 0x7ffa40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa4bfff640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa40004d90 0x7ffa40005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffa54163f10 con 0x7ffa40003a30 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4000bc20 con 0x7ffa40004d90 2024-05-11T01:13:21.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4000be20 con 0x7ffa540b14b0 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa59595640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa40003a30 0x7ffa40003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa58d94640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa540b14b0 0x7ffa40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa59d96640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa40004d90 0x7ffa40005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa59595640 1 -- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa540b14b0 msgr2=0x7ffa40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa59595640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa540b14b0 0x7ffa40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa59595640 1 -- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa40004d90 msgr2=0x7ffa40005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa59595640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa40004d90 0x7ffa40005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.693+0000 7ffa59595640 1 -- 172.21.15.16:0/176519517 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa40003520 con 0x7ffa40003a30 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa59595640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa40003a30 0x7ffa40003e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffa50007fd0 tx=0x7ffa40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e1bab4ddcbe9b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50007ca0 con 0x7ffa40003a30 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa50005af0 con 0x7ffa40003a30 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa4bfff640 1 -- 172.21.15.16:0/176519517 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50007070 con 0x7ffa40003a30 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/176519517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa40003a30 msgr2=0x7ffa40003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa5b7f9640 1 --2- 172.21.15.16:0/176519517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa40003a30 0x7ffa40003e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffa50007fd0 tx=0x7ffa40005830 comp rx=0 tx=0).stop 2024-05-11T01:13:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa59d96640 1 -- 172.21.15.16:0/176519517 reap_dead start 2024-05-11T01:13:21.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/176519517 shutdown_connections 2024-05-11T01:13:21.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.694+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/176519517 >> 172.21.15.16:0/176519517 conn(0x7ffa540d1fe0 msgr2=0x7ffa540d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:21.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.695+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/176519517 shutdown_connections 2024-05-11T01:13:21.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.695+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/176519517 wait complete. 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.696+0000 7ffa5b7f9640 1 Processor -- start 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.696+0000 7ffa5b7f9640 1 -- start start 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa5b7f9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa40003a30 0x7ffa540ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa5b7f9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa540cf030 0x7ffa5415e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa5b7f9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa5415ec10 0x7ffa540d0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa5b7f9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffa54163ba0 con 0x7ffa5415ec10 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa5b7f9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa541638c0 con 0x7ffa540cf030 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa5b7f9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffa54070800 con 0x7ffa40003a30 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa5415ec10 0x7ffa540d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa5415ec10 0x7ffa540d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37266/0 (socket says 172.21.15.16:37266) 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 -- 172.21.15.16:0/2062536560 learned_addr learned my addr 172.21.15.16:0/2062536560 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59595640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa40003a30 0x7ffa540ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa58d94640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa540cf030 0x7ffa5415e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 -- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa40003a30 msgr2=0x7ffa540ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa40003a30 0x7ffa540ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 -- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa540cf030 msgr2=0x7ffa5415e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa540cf030 0x7ffa5415e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 -- 172.21.15.16:0/2062536560 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa541f8ce0 con 0x7ffa5415ec10 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa58d94640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa540cf030 0x7ffa5415e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa59d96640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa5415ec10 0x7ffa540d0160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ffa54073360 tx=0x7ffa4c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa49ffb640 1 -- 172.21.15.16:0/2062536560 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00fdb0 con 0x7ffa5415ec10 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa49ffb640 1 -- 172.21.15.16:0/2062536560 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4c01d070 con 0x7ffa5415ec10 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa49ffb640 1 -- 172.21.15.16:0/2062536560 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c015670 con 0x7ffa5415ec10 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.697+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa541f8f80 con 0x7ffa5415ec10 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.698+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa541f9540 con 0x7ffa5415ec10 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.698+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa540d23c0 con 0x7ffa5415ec10 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.699+0000 7ffa49ffb640 1 -- 172.21.15.16:0/2062536560 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7ffa4c015810 con 0x7ffa5415ec10 2024-05-11T01:13:21.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.700+0000 7ffa49ffb640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ffa380764d0 0x7ffa38078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.700+0000 7ffa49ffb640 1 -- 172.21.15.16:0/2062536560 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ffa4c0983b0 con 0x7ffa5415ec10 2024-05-11T01:13:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.700+0000 7ffa59595640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ffa380764d0 0x7ffa38078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.700+0000 7ffa59595640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ffa380764d0 0x7ffa38078990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffa50032000 tx=0x7ffa50009030 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.704+0000 7ffa49ffb640 1 -- 172.21.15.16:0/2062536560 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa540d23c0 con 0x7ffa5415ec10 2024-05-11T01:13:21.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.921+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7ffa5406c530 con 0x7ffa380764d0 2024-05-11T01:13:21.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.991+0000 7ffa49ffb640 1 -- 172.21.15.16:0/2062536560 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ffa5406c530 con 0x7ffa380764d0 2024-05-11T01:13:21.991 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2024-05-11T01:13:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ffa380764d0 msgr2=0x7ffa38078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ffa380764d0 0x7ffa38078990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffa50032000 tx=0x7ffa50009030 comp rx=0 tx=0).stop 2024-05-11T01:13:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa5415ec10 msgr2=0x7ffa540d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa5415ec10 0x7ffa540d0160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ffa54073360 tx=0x7ffa4c00f580 comp rx=0 tx=0).stop 2024-05-11T01:13:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 shutdown_connections 2024-05-11T01:13:21.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ffa380764d0 0x7ffa38078990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa5415ec10 0x7ffa540d0160 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa540cf030 0x7ffa5415e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 --2- 172.21.15.16:0/2062536560 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa40003a30 0x7ffa540ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 >> 172.21.15.16:0/2062536560 conn(0x7ffa540d1fe0 msgr2=0x7ffa54160e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 shutdown_connections 2024-05-11T01:13:21.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:21.993+0000 7ffa5b7f9640 1 -- 172.21.15.16:0/2062536560 wait complete. 2024-05-11T01:13:22.003 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2024-05-11T01:13:22.003 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir6 1m 2024-05-11T01:13:22.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:13:22.049 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:13:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.112+0000 7faab4f46640 1 Processor -- start 2024-05-11T01:13:22.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.112+0000 7faab4f46640 1 -- start start 2024-05-11T01:13:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faab4f46640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faab00bae40 0x7faab01604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faab4f46640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab01609e0 con 0x7faab0163010 2024-05-11T01:13:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faab4f46640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab01635d0 con 0x7faab00b7490 2024-05-11T01:13:22.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faab4f46640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7faab01638b0 con 0x7faab00bae40 2024-05-11T01:13:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faaae59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faab00bae40 0x7faab01604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faaadd9b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faab0163010 0x7faab00b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36886/0 (socket says 172.21.15.16:36886) 2024-05-11T01:13:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faaadd9b640 1 -- 172.21.15.16:0/1006452929 learned_addr learned my addr 172.21.15.16:0/1006452929 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faaae59c640 1 --2- 172.21.15.16:0/1006452929 >> v2:172.21.15.16:3300/0 conn(0x7faab00bae40 0x7faab01604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37278/0 (socket says 172.21.15.16:37278) 2024-05-11T01:13:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faaae59c640 1 -- 172.21.15.16:0/1006452929 >> v1:172.21.15.174:6789/0 conn(0x7faab00b7490 legacy=0x7faab00b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faaae59c640 1 -- 172.21.15.16:0/1006452929 >> v1:172.21.15.16:6789/0 conn(0x7faab0163010 legacy=0x7faab00b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faaae59c640 1 -- 172.21.15.16:0/1006452929 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab0163b90 con 0x7faab00bae40 2024-05-11T01:13:22.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.113+0000 7faaad59a640 1 -- 172.21.15.16:0/1006452929 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224143432 0 0) 0x7faa98001110 con 0x7faab0163010 2024-05-11T01:13:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.114+0000 7faaae59c640 1 --2- 172.21.15.16:0/1006452929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab00bae40 0x7faab01604a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009d90 tx=0x7faaa802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f866c141629c325e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.114+0000 7faaad59a640 1 -- 172.21.15.16:0/1006452929 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8007740 con 0x7faab00bae40 2024-05-11T01:13:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.114+0000 7faaad59a640 1 -- 172.21.15.16:0/1006452929 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa80078e0 con 0x7faab00bae40 2024-05-11T01:13:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.114+0000 7faaad59a640 1 -- 172.21.15.16:0/1006452929 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8007cb0 con 0x7faab00bae40 2024-05-11T01:13:22.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.114+0000 7faab4f46640 1 -- 172.21.15.16:0/1006452929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab00bae40 msgr2=0x7faab01604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.114+0000 7faab4f46640 1 --2- 172.21.15.16:0/1006452929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab00bae40 0x7faab01604a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009d90 tx=0x7faaa802a660 comp rx=0 tx=0).stop 2024-05-11T01:13:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.115+0000 7faab4f46640 1 -- 172.21.15.16:0/1006452929 shutdown_connections 2024-05-11T01:13:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.115+0000 7faab4f46640 1 --2- 172.21.15.16:0/1006452929 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab00bae40 0x7faab01604a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.115+0000 7faab4f46640 1 -- 172.21.15.16:0/1006452929 >> 172.21.15.16:0/1006452929 conn(0x7faab0074140 msgr2=0x7faab00d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.115+0000 7faab4f46640 1 -- 172.21.15.16:0/1006452929 shutdown_connections 2024-05-11T01:13:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.115+0000 7faab4f46640 1 -- 172.21.15.16:0/1006452929 wait complete. 2024-05-11T01:13:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.116+0000 7faab4f46640 1 Processor -- start 2024-05-11T01:13:22.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.116+0000 7faab4f46640 1 -- start start 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faab4f46640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab00b7490 0x7faab00cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faab4f46640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab00bae40 0x7faab0155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faab4f46640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab0163010 0x7faab01ea700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faab4f46640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faab00d46f0 con 0x7faab0163010 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faab4f46640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faab00bb220 con 0x7faab00bae40 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faab4f46640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7faab00d4870 con 0x7faab00b7490 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab0163010 0x7faab01ea700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab0163010 0x7faab01ea700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37282/0 (socket says 172.21.15.16:37282) 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 -- 172.21.15.16:0/1478888720 learned_addr learned my addr 172.21.15.16:0/1478888720 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaadd9b640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab00bae40 0x7faab0155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaae59c640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab00b7490 0x7faab00cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 -- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab00b7490 msgr2=0x7faab00cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab00b7490 0x7faab00cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 -- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab00bae40 msgr2=0x7faab0155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab00bae40 0x7faab0155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 -- 172.21.15.16:0/1478888720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab00cce50 con 0x7faab0163010 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.117+0000 7faaaed9d640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab0163010 0x7faab01ea700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faaa000c430 tx=0x7faaa000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.118+0000 7faaa6ffd640 1 -- 172.21.15.16:0/1478888720 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0017070 con 0x7faab0163010 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.118+0000 7faaa6ffd640 1 -- 172.21.15.16:0/1478888720 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa00052d0 con 0x7faab0163010 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.118+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab0155dc0 con 0x7faab0163010 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.118+0000 7faaa6ffd640 1 -- 172.21.15.16:0/1478888720 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa00037f0 con 0x7faab0163010 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.118+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab00ca010 con 0x7faab0163010 2024-05-11T01:13:22.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.119+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab006a5b0 con 0x7faab0163010 2024-05-11T01:13:22.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.119+0000 7faaa6ffd640 1 -- 172.21.15.16:0/1478888720 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7faaa001a070 con 0x7faab0163010 2024-05-11T01:13:22.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.120+0000 7faaa6ffd640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7faa900764d0 0x7faa90078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.120+0000 7faaa6ffd640 1 -- 172.21.15.16:0/1478888720 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7faaa0096c60 con 0x7faab0163010 2024-05-11T01:13:22.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.120+0000 7faaae59c640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7faa900764d0 0x7faa90078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.121+0000 7faaae59c640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7faa900764d0 0x7faa90078990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faaa8034000 tx=0x7faaa802f000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:22.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.124+0000 7faaa6ffd640 1 -- 172.21.15.16:0/1478888720 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faab00cce50 con 0x7faab0163010 2024-05-11T01:13:22.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.338+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7faab00d2fa0 con 0x7faa900764d0 2024-05-11T01:13:22.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.413+0000 7faaa6ffd640 1 -- 172.21.15.16:0/1478888720 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7faab00d2fa0 con 0x7faa900764d0 2024-05-11T01:13:22.412 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2024-05-11T01:13:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7faa900764d0 msgr2=0x7faa90078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7faa900764d0 0x7faa90078990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faaa8034000 tx=0x7faaa802f000 comp rx=0 tx=0).stop 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab0163010 msgr2=0x7faab01ea700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab0163010 0x7faab01ea700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faaa000c430 tx=0x7faaa000c8f0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 shutdown_connections 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7faa900764d0 0x7faa90078990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faab0163010 0x7faab01ea700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faab00bae40 0x7faab0155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 --2- 172.21.15.16:0/1478888720 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7faab00b7490 0x7faab00cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 >> 172.21.15.16:0/1478888720 conn(0x7faab0074140 msgr2=0x7faab00cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 shutdown_connections 2024-05-11T01:13:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.415+0000 7faab4f46640 1 -- 172.21.15.16:0/1478888720 wait complete. 2024-05-11T01:13:22.425 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2024-05-11T01:13:22.425 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir7 1m 2024-05-11T01:13:22.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.572+0000 7f0196b38640 1 Processor -- start 2024-05-11T01:13:22.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.572+0000 7f0196b38640 1 -- start start 2024-05-11T01:13:22.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f0196b38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0190145ba0 0x7f0190160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f0196b38640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01900b4670 0x7f01900b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f0196b38640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0190073ca0 con 0x7f01900b2bf0 2024-05-11T01:13:22.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f0196b38640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f01900b3590 con 0x7f01900b4670 2024-05-11T01:13:22.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f0196b38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f01900b4e20 con 0x7f0190145ba0 2024-05-11T01:13:22.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f01950d5640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01900b4670 0x7f01900b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f01948d4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0190145ba0 0x7f0190160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f01948d4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0190145ba0 0x7f0190160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:51660/0 (socket says 172.21.15.16:51660) 2024-05-11T01:13:22.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.573+0000 7f01948d4640 1 -- 172.21.15.16:0/4177889337 learned_addr learned my addr 172.21.15.16:0/4177889337 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:22.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.574+0000 7f01950d5640 1 -- 172.21.15.16:0/4177889337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0190145ba0 msgr2=0x7f0190160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:22.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.574+0000 7f01950d5640 1 --2- 172.21.15.16:0/4177889337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0190145ba0 0x7f0190160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.574+0000 7f01950d5640 1 -- 172.21.15.16:0/4177889337 >> v1:172.21.15.174:6789/0 conn(0x7f01900b2bf0 legacy=0x7f01900b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.574+0000 7f01877fe640 1 -- 172.21.15.16:0/4177889337 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314966546 0 0) 0x7f0180001110 con 0x7f01900b2bf0 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.574+0000 7f01950d5640 1 -- 172.21.15.16:0/4177889337 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01900b4b40 con 0x7f01900b4670 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.574+0000 7f01948d4640 1 --2- 172.21.15.16:0/4177889337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0190145ba0 0x7f0190160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.574+0000 7f01950d5640 1 --2- 172.21.15.16:0/4177889337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01900b4670 0x7f01900b3050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f01880097a0 tx=0x7f018802a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=271c97deeffbaee1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f01877fe640 1 -- 172.21.15.16:0/4177889337 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0188037070 con 0x7f01900b4670 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f01877fe640 1 -- 172.21.15.16:0/4177889337 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018802ae30 con 0x7f01900b4670 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f01877fe640 1 -- 172.21.15.16:0/4177889337 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0188032640 con 0x7f01900b4670 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f0196b38640 1 -- 172.21.15.16:0/4177889337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01900b4670 msgr2=0x7f01900b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f0196b38640 1 --2- 172.21.15.16:0/4177889337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01900b4670 0x7f01900b3050 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f01880097a0 tx=0x7f018802a0e0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f0196b38640 1 -- 172.21.15.16:0/4177889337 shutdown_connections 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f0196b38640 1 --2- 172.21.15.16:0/4177889337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01900b4670 0x7f01900b3050 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f0196b38640 1 --2- 172.21.15.16:0/4177889337 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0190145ba0 0x7f0190160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f0196b38640 1 -- 172.21.15.16:0/4177889337 >> 172.21.15.16:0/4177889337 conn(0x7f019006c3e0 msgr2=0x7f019006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:22.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f0196b38640 1 -- 172.21.15.16:0/4177889337 shutdown_connections 2024-05-11T01:13:22.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.575+0000 7f0196b38640 1 -- 172.21.15.16:0/4177889337 wait complete. 2024-05-11T01:13:22.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.576+0000 7f0196b38640 1 Processor -- start 2024-05-11T01:13:22.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.576+0000 7f0196b38640 1 -- start start 2024-05-11T01:13:22.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f0196b38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01900b2bf0 0x7f0190072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f0196b38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01900b4670 0x7f01900728c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f0196b38640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0190145ba0 0x7f019015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f0196b38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0190160400 con 0x7f01900b2bf0 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f0196b38640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0190160120 con 0x7f0190145ba0 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f0196b38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f01900ce810 con 0x7f01900b4670 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f01948d4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01900b2bf0 0x7f0190072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f01948d4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01900b2bf0 0x7f0190072380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37298/0 (socket says 172.21.15.16:37298) 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f01948d4640 1 -- 172.21.15.16:0/2482878314 learned_addr learned my addr 172.21.15.16:0/2482878314 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f01950d5640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0190145ba0 0x7f019015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.577+0000 7f0187fff640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01900b4670 0x7f01900728c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01948d4640 1 -- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01900b4670 msgr2=0x7f01900728c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01948d4640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01900b4670 0x7f01900728c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01948d4640 1 -- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0190145ba0 msgr2=0x7f019015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01948d4640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0190145ba0 0x7f019015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01948d4640 1 -- 172.21.15.16:0/2482878314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01900d1360 con 0x7f01900b2bf0 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01950d5640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0190145ba0 0x7f019015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f0187fff640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01900b4670 0x7f01900728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01948d4640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01900b2bf0 0x7f0190072380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f018c00efc0 tx=0x7f018c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01857fa640 1 -- 172.21.15.16:0/2482878314 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c00ce60 con 0x7f01900b2bf0 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01857fa640 1 -- 172.21.15.16:0/2482878314 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c019070 con 0x7f01900b2bf0 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f01857fa640 1 -- 172.21.15.16:0/2482878314 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c014680 con 0x7f01900b2bf0 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01900d1640 con 0x7f01900b2bf0 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.578+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01900d1c00 con 0x7f01900b2bf0 2024-05-11T01:13:22.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.579+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01900b3cd0 con 0x7f01900b2bf0 2024-05-11T01:13:22.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.580+0000 7f01857fa640 1 -- 172.21.15.16:0/2482878314 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f018c005d10 con 0x7f01900b2bf0 2024-05-11T01:13:22.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.580+0000 7f01857fa640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f017c0764d0 0x7f017c078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.581+0000 7f01857fa640 1 -- 172.21.15.16:0/2482878314 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f018c097fb0 con 0x7f01900b2bf0 2024-05-11T01:13:22.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.581+0000 7f0187fff640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f017c0764d0 0x7f017c078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.581+0000 7f0187fff640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f017c0764d0 0x7f017c078990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01900ced40 tx=0x7f0180009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:22.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.585+0000 7f01857fa640 1 -- 172.21.15.16:0/2482878314 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f018c010040 con 0x7f01900b2bf0 2024-05-11T01:13:22.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.801+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f019006a5b0 con 0x7f017c0764d0 2024-05-11T01:13:22.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.876+0000 7f01857fa640 1 -- 172.21.15.16:0/2482878314 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f019006a5b0 con 0x7f017c0764d0 2024-05-11T01:13:22.875 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f017c0764d0 msgr2=0x7f017c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f017c0764d0 0x7f017c078990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f01900ced40 tx=0x7f0180009040 comp rx=0 tx=0).stop 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01900b2bf0 msgr2=0x7f0190072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01900b2bf0 0x7f0190072380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f018c00efc0 tx=0x7f018c00c490 comp rx=0 tx=0).stop 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 shutdown_connections 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f017c0764d0 0x7f017c078990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0190145ba0 0x7f019015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f01900b4670 0x7f01900728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 --2- 172.21.15.16:0/2482878314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01900b2bf0 0x7f0190072380 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:22.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 >> 172.21.15.16:0/2482878314 conn(0x7f019006c3e0 msgr2=0x7f019015f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:22.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 shutdown_connections 2024-05-11T01:13:22.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.878+0000 7f0196b38640 1 -- 172.21.15.16:0/2482878314 wait complete. 2024-05-11T01:13:22.888 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2024-05-11T01:13:22.888 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir8 1m 2024-05-11T01:13:22.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.996+0000 7f0db6ec8640 1 Processor -- start 2024-05-11T01:13:22.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.996+0000 7f0db6ec8640 1 -- start start 2024-05-11T01:13:22.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.997+0000 7f0db6ec8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db015f6b0 0x7f0db00d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:22.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.997+0000 7f0db6ec8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db015fa90 con 0x7f0db00bac80 2024-05-11T01:13:22.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.997+0000 7f0db6ec8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0db00d3750 con 0x7f0db00d00e0 2024-05-11T01:13:22.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.997+0000 7f0db6ec8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0db00d39f0 con 0x7f0db015f6b0 2024-05-11T01:13:22.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.997+0000 7f0daffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0db00bac80 0x7f0db00d4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52564/0 (socket says 172.21.15.16:52564) 2024-05-11T01:13:22.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.997+0000 7f0daffff640 1 -- 172.21.15.16:0/3738347227 learned_addr learned my addr 172.21.15.16:0/3738347227 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:22.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.997+0000 7f0db4c64640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db015f6b0 0x7f0db00d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:22.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737076918 0 0) 0x7f0db015fa90 con 0x7f0db00bac80 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d98003520 con 0x7f0db00bac80 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1019515041 0 0) 0x7f0d98003520 con 0x7f0db00bac80 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db015f6b0 msgr2=0x7f0db00d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db015f6b0 0x7f0db00d3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 >> v1:172.21.15.174:6789/0 conn(0x7f0db00d00e0 legacy=0x7f0db00b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db00d3cd0 con 0x7f0db00bac80 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f0da40016f0 con 0x7f0db00bac80 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 >> v1:172.21.15.16:6789/0 conn(0x7f0db00bac80 legacy=0x7f0db00d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d980039e0 0x7f0d98003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d98004800 0x7f0d98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db015f6b0 0x7f0d980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00d39f0 con 0x7f0d98004800 2024-05-11T01:13:23.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9800ba70 con 0x7f0d980039e0 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9800bc70 con 0x7f0db015f6b0 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daffff640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d98004800 0x7f0d98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0db4c64640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d980039e0 0x7f0d98003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0db5465640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db015f6b0 0x7f0d980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daffff640 1 -- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db015f6b0 msgr2=0x7f0d980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daffff640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0db015f6b0 0x7f0d980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daffff640 1 -- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d980039e0 msgr2=0x7f0d98003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daffff640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d980039e0 0x7f0d98003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.998+0000 7f0daffff640 1 -- 172.21.15.16:0/3738347227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d98003520 con 0x7f0d98004800 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.999+0000 7f0daffff640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d98004800 0x7f0d98004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0da4001eb0 tx=0x7f0d98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811b6b5859dd5f69 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.999+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4007d10 con 0x7f0d98004800 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.999+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da4005ad0 con 0x7f0d98004800 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:22.999+0000 7f0daf7fe640 1 -- 172.21.15.16:0/3738347227 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4007070 con 0x7f0d98004800 2024-05-11T01:13:23.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.000+0000 7f0db6ec8640 1 -- 172.21.15.16:0/3738347227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d98004800 msgr2=0x7f0d98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.000+0000 7f0db6ec8640 1 --2- 172.21.15.16:0/3738347227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d98004800 0x7f0d98004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0da4001eb0 tx=0x7f0d98005830 comp rx=0 tx=0).stop 2024-05-11T01:13:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.000+0000 7f0db5465640 1 -- 172.21.15.16:0/3738347227 reap_dead start 2024-05-11T01:13:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.000+0000 7f0db6ec8640 1 -- 172.21.15.16:0/3738347227 shutdown_connections 2024-05-11T01:13:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.000+0000 7f0db6ec8640 1 -- 172.21.15.16:0/3738347227 >> 172.21.15.16:0/3738347227 conn(0x7f0db0073f00 msgr2=0x7f0db0074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.000+0000 7f0db6ec8640 1 -- 172.21.15.16:0/3738347227 shutdown_connections 2024-05-11T01:13:23.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.000+0000 7f0db6ec8640 1 -- 172.21.15.16:0/3738347227 wait complete. 2024-05-11T01:13:23.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.001+0000 7f0db6ec8640 1 Processor -- start 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.001+0000 7f0db6ec8640 1 -- start start 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db6ec8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d98004800 0x7f0db015bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db6ec8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db01f8440 0x7f0db01f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db6ec8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0db00ce040 0x7f0db00ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db6ec8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00d4570 con 0x7f0db00ce040 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db6ec8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0db00d4290 con 0x7f0db01f8440 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db6ec8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0db00d3210 con 0x7f0d98004800 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0db00ce040 0x7f0db00ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0db00ce040 0x7f0db00ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42548/0 (socket says 172.21.15.16:42548) 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 -- 172.21.15.16:0/860307907 learned_addr learned my addr 172.21.15.16:0/860307907 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0daffff640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db01f8440 0x7f0db01f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db4c64640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d98004800 0x7f0db015bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 -- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d98004800 msgr2=0x7f0db015bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d98004800 0x7f0db015bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 -- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db01f8440 msgr2=0x7f0db01f88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db01f8440 0x7f0db01f88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 -- 172.21.15.16:0/860307907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db01f60b0 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.002+0000 7f0db5465640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0db00ce040 0x7f0db00ce4f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0da8001520 tx=0x7f0da800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.003+0000 7f0dad7fa640 1 -- 172.21.15.16:0/860307907 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8003b80 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.003+0000 7f0dad7fa640 1 -- 172.21.15.16:0/860307907 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da8018070 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.003+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db01f6390 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.003+0000 7f0dad7fa640 1 -- 172.21.15.16:0/860307907 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da80050d0 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.003+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db01f6950 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.004+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0db01f6b50 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.004+0000 7f0dad7fa640 1 -- 172.21.15.16:0/860307907 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f0da8005270 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.005+0000 7f0dad7fa640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0d9c076500 0x7f0d9c0789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.005+0000 7f0dad7fa640 1 -- 172.21.15.16:0/860307907 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f0da8097930 con 0x7f0db00ce040 2024-05-11T01:13:23.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.005+0000 7f0db4c64640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0d9c076500 0x7f0d9c0789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.006+0000 7f0db4c64640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0d9c076500 0x7f0d9c0789c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0da00099e0 tx=0x7f0da0008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.009+0000 7f0dad7fa640 1 -- 172.21.15.16:0/860307907 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0db01f6b50 con 0x7f0db00ce040 2024-05-11T01:13:23.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.223+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f0db00cedc0 con 0x7f0d9c076500 2024-05-11T01:13:23.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.295+0000 7f0dad7fa640 1 -- 172.21.15.16:0/860307907 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f0db00cedc0 con 0x7f0d9c076500 2024-05-11T01:13:23.294 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2024-05-11T01:13:23.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0d9c076500 msgr2=0x7f0d9c0789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0d9c076500 0x7f0d9c0789c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0da00099e0 tx=0x7f0da0008040 comp rx=0 tx=0).stop 2024-05-11T01:13:23.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0db00ce040 msgr2=0x7f0db00ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0db00ce040 0x7f0db00ce4f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0da8001520 tx=0x7f0da800ff70 comp rx=0 tx=0).stop 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 shutdown_connections 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f0d9c076500 0x7f0d9c0789c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0db00ce040 0x7f0db00ce4f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0db01f8440 0x7f0db01f88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 --2- 172.21.15.16:0/860307907 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0d98004800 0x7f0db015bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 >> 172.21.15.16:0/860307907 conn(0x7f0db0073f00 msgr2=0x7f0db00ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 shutdown_connections 2024-05-11T01:13:23.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.297+0000 7f0db6ec8640 1 -- 172.21.15.16:0/860307907 wait complete. 2024-05-11T01:13:23.307 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2024-05-11T01:13:23.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir9 1m 2024-05-11T01:13:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.415+0000 7f04c0714640 1 Processor -- start 2024-05-11T01:13:23.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.415+0000 7f04c0714640 1 -- start start 2024-05-11T01:13:23.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04c0714640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f04b815f6b0 0x7f04b80d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04c0714640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f04b80d00e0 0x7f04b80d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04c0714640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b815fa90 con 0x7f04b80bac80 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04c0714640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f04b80d3750 con 0x7f04b815f6b0 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04c0714640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f04b80d39f0 con 0x7f04b80d00e0 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04be4b0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f04b815f6b0 0x7f04b80d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04be4b0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f04b815f6b0 0x7f04b80d3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42564/0 (socket says 172.21.15.16:42564) 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04be4b0640 1 -- 172.21.15.16:0/2388274785 learned_addr learned my addr 172.21.15.16:0/2388274785 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.416+0000 7f04bdcaf640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f04b80bac80 0x7f04b80d4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52572/0 (socket says 172.21.15.16:52572) 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04be4b0640 1 -- 172.21.15.16:0/2388274785 >> v2:172.21.15.174:3300/0 conn(0x7f04b80d00e0 msgr2=0x7f04b80d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04be4b0640 1 --2- 172.21.15.16:0/2388274785 >> v2:172.21.15.174:3300/0 conn(0x7f04b80d00e0 0x7f04b80d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04be4b0640 1 -- 172.21.15.16:0/2388274785 >> v1:172.21.15.16:6789/0 conn(0x7f04b80bac80 legacy=0x7f04b80d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04bd4ae640 1 -- 172.21.15.16:0/2388274785 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680570097 0 0) 0x7f04b815fa90 con 0x7f04b80bac80 2024-05-11T01:13:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04be4b0640 1 -- 172.21.15.16:0/2388274785 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b80d3cd0 con 0x7f04b815f6b0 2024-05-11T01:13:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04be4b0640 1 --2- 172.21.15.16:0/2388274785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b815f6b0 0x7f04b80d3210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f04b80cfb30 tx=0x7f04b402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbb1eca6edae1ef server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04bd4ae640 1 -- 172.21.15.16:0/2388274785 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4037070 con 0x7f04b815f6b0 2024-05-11T01:13:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04bd4ae640 1 -- 172.21.15.16:0/2388274785 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b402ae50 con 0x7f04b815f6b0 2024-05-11T01:13:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.417+0000 7f04bd4ae640 1 -- 172.21.15.16:0/2388274785 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4032860 con 0x7f04b815f6b0 2024-05-11T01:13:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.418+0000 7f04c0714640 1 -- 172.21.15.16:0/2388274785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b815f6b0 msgr2=0x7f04b80d3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.418+0000 7f04c0714640 1 --2- 172.21.15.16:0/2388274785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b815f6b0 0x7f04b80d3210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f04b80cfb30 tx=0x7f04b402a300 comp rx=0 tx=0).stop 2024-05-11T01:13:23.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.418+0000 7f04c0714640 1 -- 172.21.15.16:0/2388274785 shutdown_connections 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.418+0000 7f04c0714640 1 --2- 172.21.15.16:0/2388274785 >> v2:172.21.15.174:3300/0 conn(0x7f04b80d00e0 0x7f04b80d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.418+0000 7f04c0714640 1 --2- 172.21.15.16:0/2388274785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b815f6b0 0x7f04b80d3210 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.418+0000 7f04c0714640 1 -- 172.21.15.16:0/2388274785 >> 172.21.15.16:0/2388274785 conn(0x7f04b8073f00 msgr2=0x7f04b8074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.418+0000 7f04c0714640 1 -- 172.21.15.16:0/2388274785 shutdown_connections 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.418+0000 7f04c0714640 1 -- 172.21.15.16:0/2388274785 wait complete. 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.419+0000 7f04c0714640 1 Processor -- start 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.419+0000 7f04c0714640 1 -- start start 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04c0714640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b80bac80 0x7f04b81f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04c0714640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b80d00e0 0x7f04b815d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04c0714640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b815f6b0 0x7f04b80cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04c0714640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80d4570 con 0x7f04b80d00e0 2024-05-11T01:13:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04c0714640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f04b80d4290 con 0x7f04b80bac80 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04c0714640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f04b80b8400 con 0x7f04b815f6b0 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04bdcaf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b80d00e0 0x7f04b815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04bdcaf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b80d00e0 0x7f04b815d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42578/0 (socket says 172.21.15.16:42578) 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04bdcaf640 1 -- 172.21.15.16:0/211613406 learned_addr learned my addr 172.21.15.16:0/211613406 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04be4b0640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b80bac80 0x7f04b81f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.420+0000 7f04becb1640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b815f6b0 0x7f04b80cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04bdcaf640 1 -- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b815f6b0 msgr2=0x7f04b80cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04bdcaf640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b815f6b0 0x7f04b80cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04bdcaf640 1 -- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b80bac80 msgr2=0x7f04b81f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04bdcaf640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b80bac80 0x7f04b81f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04bdcaf640 1 -- 172.21.15.16:0/211613406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b80ce440 con 0x7f04b80d00e0 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04becb1640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b815f6b0 0x7f04b80cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04bdcaf640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b80d00e0 0x7f04b815d930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c490 tx=0x7f04a800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04aeffd640 1 -- 172.21.15.16:0/211613406 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8018070 con 0x7f04b80d00e0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04aeffd640 1 -- 172.21.15.16:0/211613406 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a8007500 con 0x7f04b80d00e0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04aeffd640 1 -- 172.21.15.16:0/211613406 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8004a20 con 0x7f04b80d00e0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b80cdba0 con 0x7f04b80d00e0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.421+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b80ce160 con 0x7f04b80d00e0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.422+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b806a5b0 con 0x7f04b80d00e0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.423+0000 7f04aeffd640 1 -- 172.21.15.16:0/211613406 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f04a801b070 con 0x7f04b80d00e0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.423+0000 7f04aeffd640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f049c0764d0 0x7f049c078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.423+0000 7f04aeffd640 1 -- 172.21.15.16:0/211613406 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f04a8096c00 con 0x7f04b80d00e0 2024-05-11T01:13:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.423+0000 7f04be4b0640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f049c0764d0 0x7f049c078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.424+0000 7f04be4b0640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f049c0764d0 0x7f049c078990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04b4034000 tx=0x7f04b402e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.428+0000 7f04aeffd640 1 -- 172.21.15.16:0/211613406 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f04a809d080 con 0x7f04b80d00e0 2024-05-11T01:13:23.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.643+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f04b806e440 con 0x7f049c0764d0 2024-05-11T01:13:23.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.716+0000 7f04aeffd640 1 -- 172.21.15.16:0/211613406 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f04b806e440 con 0x7f049c0764d0 2024-05-11T01:13:23.716 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.718+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f049c0764d0 msgr2=0x7f049c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.718+0000 7f04c0714640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f049c0764d0 0x7f049c078990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04b4034000 tx=0x7f04b402e000 comp rx=0 tx=0).stop 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.718+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b80d00e0 msgr2=0x7f04b815d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.718+0000 7f04c0714640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b80d00e0 0x7f04b815d930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c490 tx=0x7f04a800c950 comp rx=0 tx=0).stop 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.719+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 shutdown_connections 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.719+0000 7f04c0714640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f049c0764d0 0x7f049c078990 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.719+0000 7f04c0714640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f04b815f6b0 0x7f04b80cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.719+0000 7f04c0714640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f04b80d00e0 0x7f04b815d930 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.719+0000 7f04c0714640 1 --2- 172.21.15.16:0/211613406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b80bac80 0x7f04b81f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.719+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 >> 172.21.15.16:0/211613406 conn(0x7f04b8073f00 msgr2=0x7f04b80d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:23.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.719+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 shutdown_connections 2024-05-11T01:13:23.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.719+0000 7f04c0714640 1 -- 172.21.15.16:0/211613406 wait complete. 2024-05-11T01:13:23.728 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2024-05-11T01:13:23.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:23.729 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:23.747 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:23.748 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:23.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir0 2024-05-11T01:13:23.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.893+0000 7fa9c122a640 1 Processor -- start 2024-05-11T01:13:23.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.893+0000 7fa9c122a640 1 -- start start 2024-05-11T01:13:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9c122a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9bc0bac80 0x7fa9bc0d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9c122a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa9bc0d00e0 0x7fa9bc0d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9c122a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9bc15fa90 con 0x7fa9bc15f6b0 2024-05-11T01:13:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9c122a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa9bc0d39f0 con 0x7fa9bc0d00e0 2024-05-11T01:13:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9c122a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa9bc0d3cd0 con 0x7fa9bc0bac80 2024-05-11T01:13:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9bb59e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa9bc0d00e0 0x7fa9bc0d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9bb59e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa9bc0d00e0 0x7fa9bc0d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42590/0 (socket says 172.21.15.16:42590) 2024-05-11T01:13:23.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9bad9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa9bc15f6b0 0x7fa9bc0d3210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52588/0 (socket says 172.21.15.16:52588) 2024-05-11T01:13:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9bb59e640 1 -- 172.21.15.16:0/263865779 learned_addr learned my addr 172.21.15.16:0/263865779 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.894+0000 7fa9ba59c640 1 --2- 172.21.15.16:0/263865779 >> v2:172.21.15.174:3300/0 conn(0x7fa9bc0bac80 0x7fa9bc0d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9bb59e640 1 -- 172.21.15.16:0/263865779 >> v2:172.21.15.174:3300/0 conn(0x7fa9bc0bac80 msgr2=0x7fa9bc0d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9bb59e640 1 --2- 172.21.15.16:0/263865779 >> v2:172.21.15.174:3300/0 conn(0x7fa9bc0bac80 0x7fa9bc0d4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9bb59e640 1 -- 172.21.15.16:0/263865779 >> v1:172.21.15.16:6789/0 conn(0x7fa9bc15f6b0 legacy=0x7fa9bc0d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9bb59e640 1 -- 172.21.15.16:0/263865779 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc0d3fb0 con 0x7fa9bc0d00e0 2024-05-11T01:13:23.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9b9d9b640 1 -- 172.21.15.16:0/263865779 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872795276 0 0) 0x7fa9bc15fa90 con 0x7fa9bc15f6b0 2024-05-11T01:13:23.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9bb59e640 1 --2- 172.21.15.16:0/263865779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0d00e0 0x7fa9bc0d0570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc0d19e0 tx=0x7fa9ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a0355147998ad9 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9b9d9b640 1 -- 172.21.15.16:0/263865779 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac037070 con 0x7fa9bc0d00e0 2024-05-11T01:13:23.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9b9d9b640 1 -- 172.21.15.16:0/263865779 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ac02ae50 con 0x7fa9bc0d00e0 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.895+0000 7fa9b9d9b640 1 -- 172.21.15.16:0/263865779 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac032860 con 0x7fa9bc0d00e0 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.896+0000 7fa9c122a640 1 -- 172.21.15.16:0/263865779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0d00e0 msgr2=0x7fa9bc0d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.896+0000 7fa9c122a640 1 --2- 172.21.15.16:0/263865779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0d00e0 0x7fa9bc0d0570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc0d19e0 tx=0x7fa9ac02a300 comp rx=0 tx=0).stop 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.896+0000 7fa9c122a640 1 -- 172.21.15.16:0/263865779 shutdown_connections 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.896+0000 7fa9c122a640 1 --2- 172.21.15.16:0/263865779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0d00e0 0x7fa9bc0d0570 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.896+0000 7fa9c122a640 1 --2- 172.21.15.16:0/263865779 >> v2:172.21.15.174:3300/0 conn(0x7fa9bc0bac80 0x7fa9bc0d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.896+0000 7fa9c122a640 1 -- 172.21.15.16:0/263865779 >> 172.21.15.16:0/263865779 conn(0x7fa9bc073f00 msgr2=0x7fa9bc074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.896+0000 7fa9c122a640 1 -- 172.21.15.16:0/263865779 shutdown_connections 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.896+0000 7fa9c122a640 1 -- 172.21.15.16:0/263865779 wait complete. 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.897+0000 7fa9c122a640 1 Processor -- start 2024-05-11T01:13:23.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9c122a640 1 -- start start 2024-05-11T01:13:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9c122a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0bac80 0x7fa9bc156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9c122a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9bc0d00e0 0x7fa9bc0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9c122a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9bc15f6b0 0x7fa9bc0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9c122a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0d4fd0 con 0x7fa9bc0bac80 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9c122a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa9bc0d4570 con 0x7fa9bc15f6b0 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9c122a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa9bc156d90 con 0x7fa9bc0d00e0 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9bad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0bac80 0x7fa9bc156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9bad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0bac80 0x7fa9bc156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42600/0 (socket says 172.21.15.16:42600) 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.898+0000 7fa9bad9d640 1 -- 172.21.15.16:0/862182926 learned_addr learned my addr 172.21.15.16:0/862182926 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9ba59c640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9bc0d00e0 0x7fa9bc0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9bb59e640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9bc15f6b0 0x7fa9bc0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9bad9d640 1 -- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9bc0d00e0 msgr2=0x7fa9bc0cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9bad9d640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9bc0d00e0 0x7fa9bc0cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9bad9d640 1 -- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9bc15f6b0 msgr2=0x7fa9bc0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9bad9d640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9bc15f6b0 0x7fa9bc0ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:23.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9bad9d640 1 -- 172.21.15.16:0/862182926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9bc1f4f40 con 0x7fa9bc0bac80 2024-05-11T01:13:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9bad9d640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0bac80 0x7fa9bc156850 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c7a0 tx=0x7fa9b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9b37fe640 1 -- 172.21.15.16:0/862182926 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4018070 con 0x7fa9bc0bac80 2024-05-11T01:13:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9b37fe640 1 -- 172.21.15.16:0/862182926 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b400a640 con 0x7fa9bc0bac80 2024-05-11T01:13:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9bc1f5200 con 0x7fa9bc0bac80 2024-05-11T01:13:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9b37fe640 1 -- 172.21.15.16:0/862182926 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400aa30 con 0x7fa9bc0bac80 2024-05-11T01:13:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.899+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9bc1f57c0 con 0x7fa9bc0bac80 2024-05-11T01:13:23.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.900+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9bc06a5b0 con 0x7fa9bc0bac80 2024-05-11T01:13:23.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.901+0000 7fa9b37fe640 1 -- 172.21.15.16:0/862182926 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7fa9b401b070 con 0x7fa9bc0bac80 2024-05-11T01:13:23.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.901+0000 7fa9b37fe640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa99c076500 0x7fa99c0789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:23.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.901+0000 7fa9b37fe640 1 -- 172.21.15.16:0/862182926 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fa9b4096fd0 con 0x7fa9bc0bac80 2024-05-11T01:13:23.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.902+0000 7fa9ba59c640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa99c076500 0x7fa99c0789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:23.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.902+0000 7fa9ba59c640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa99c076500 0x7fa99c0789c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4006fd0 tx=0x7fa9a4008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:23.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:23.905+0000 7fa9b37fe640 1 -- 172.21.15.16:0/862182926 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa9b4060640 con 0x7fa9bc0bac80 2024-05-11T01:13:24.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.117+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa9bc15fd20 con 0x7fa99c076500 2024-05-11T01:13:24.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.125+0000 7fa9b37fe640 1 -- 172.21.15.16:0/862182926 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fa9bc15fd20 con 0x7fa99c076500 2024-05-11T01:13:24.124 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:24.124 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:04", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:24.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa99c076500 msgr2=0x7fa99c0789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa99c076500 0x7fa99c0789c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4006fd0 tx=0x7fa9a4008040 comp rx=0 tx=0).stop 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0bac80 msgr2=0x7fa9bc156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0bac80 0x7fa9bc156850 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400c7a0 tx=0x7fa9b400cc60 comp rx=0 tx=0).stop 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 shutdown_connections 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa99c076500 0x7fa99c0789c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9bc15f6b0 0x7fa9bc0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa9bc0d00e0 0x7fa9bc0cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 --2- 172.21.15.16:0/862182926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9bc0bac80 0x7fa9bc156850 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 >> 172.21.15.16:0/862182926 conn(0x7fa9bc073f00 msgr2=0x7fa9bc0742e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 shutdown_connections 2024-05-11T01:13:24.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.127+0000 7fa9c122a640 1 -- 172.21.15.16:0/862182926 wait complete. 2024-05-11T01:13:24.137 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:04", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:24.137 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:04', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:24.137 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:24.137 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:24.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:24.138 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:24.155 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:24.156 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_01_UTC 2024-05-11T01:13:24.156 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_01_UTC'] 2024-05-11T01:13:24.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir1 2024-05-11T01:13:24.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.302+0000 7f3acb4c4640 1 Processor -- start 2024-05-11T01:13:24.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.302+0000 7f3acb4c4640 1 -- start start 2024-05-11T01:13:24.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3acb4c4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3ac415f6b0 0x7f3ac40d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3acb4c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 0x7f3ac40d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3acb4c4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac415fa90 con 0x7f3ac40d00e0 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3acb4c4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac40d3750 con 0x7f3ac415f6b0 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3acb4c4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac40d39f0 con 0x7f3ac40bac80 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3ac9a61640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3ac40d00e0 0x7f3ac40b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52596/0 (socket says 172.21.15.16:52596) 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3ac9a61640 1 -- 172.21.15.16:0/3748288175 learned_addr learned my addr 172.21.15.16:0/3748288175 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3ac8a5f640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 0x7f3ac40d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000366907 0 0) 0x7f3ac415fa90 con 0x7f3ac40d00e0 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3ac9260640 1 --2- 172.21.15.16:0/3748288175 >> v2:172.21.15.174:3300/0 conn(0x7f3ac415f6b0 0x7f3ac40d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ab0003520 con 0x7f3ac40d00e0 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2447541702 0 0) 0x7f3ab0003520 con 0x7f3ac40d00e0 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 msgr2=0x7f3ac40d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 0x7f3ac40d4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 >> v2:172.21.15.174:3300/0 conn(0x7f3ac415f6b0 msgr2=0x7f3ac40d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 --2- 172.21.15.16:0/3748288175 >> v2:172.21.15.174:3300/0 conn(0x7f3ac415f6b0 0x7f3ac40d3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac40d3cd0 con 0x7f3ac40d00e0 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f3abc001a70 con 0x7f3ac40d00e0 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 >> v1:172.21.15.16:6789/0 conn(0x7f3ac40d00e0 legacy=0x7f3ac40b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab0003a00 0x7f3ab0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 0x7f3ab0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ab00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac40d3750 con 0x7f3ab0004d40 2024-05-11T01:13:24.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac40d39f0 con 0x7f3ab0003a00 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.303+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab000ba50 con 0x7f3ac40bac80 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac9a61640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ab00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac9260640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab0003a00 0x7f3ab0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac8a5f640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 0x7f3ab0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac9a61640 1 -- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 msgr2=0x7f3ab0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac9a61640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 0x7f3ab0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac9a61640 1 -- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab0003a00 msgr2=0x7f3ab0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac9a61640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ab0003a00 0x7f3ab0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac9a61640 1 -- 172.21.15.16:0/3748288175 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab0003520 con 0x7f3ab0004d40 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac8a5f640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40bac80 0x7f3ab0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.304+0000 7f3ac9a61640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ab00051c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00a850 tx=0x7f3ab0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af0e38c6e13ff95 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00a4a0 con 0x7f3ab0004d40 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3abc02f070 con 0x7f3ab0004d40 2024-05-11T01:13:24.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3abbfff640 1 -- 172.21.15.16:0/3748288175 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc02bc30 con 0x7f3ab0004d40 2024-05-11T01:13:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3acb4c4640 1 -- 172.21.15.16:0/3748288175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 msgr2=0x7f3ab00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3acb4c4640 1 --2- 172.21.15.16:0/3748288175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ab00051c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00a850 tx=0x7f3ab0005830 comp rx=0 tx=0).stop 2024-05-11T01:13:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3ac9a61640 1 -- 172.21.15.16:0/3748288175 reap_dead start 2024-05-11T01:13:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3acb4c4640 1 -- 172.21.15.16:0/3748288175 shutdown_connections 2024-05-11T01:13:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3acb4c4640 1 -- 172.21.15.16:0/3748288175 >> 172.21.15.16:0/3748288175 conn(0x7f3ac4073f00 msgr2=0x7f3ac4074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3acb4c4640 1 -- 172.21.15.16:0/3748288175 shutdown_connections 2024-05-11T01:13:24.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.305+0000 7f3acb4c4640 1 -- 172.21.15.16:0/3748288175 wait complete. 2024-05-11T01:13:24.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.306+0000 7f3acb4c4640 1 Processor -- start 2024-05-11T01:13:24.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3acb4c4640 1 -- start start 2024-05-11T01:13:24.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3acb4c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ac40cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3acb4c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac414bb30 0x7f3ac40ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3acb4c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40ca970 0x7f3ac414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3acb4c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac40d4570 con 0x7f3ab0004d40 2024-05-11T01:13:24.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3acb4c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac40d4290 con 0x7f3ac40ca970 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3acb4c4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac40d0570 con 0x7f3ac414bb30 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3ac9260640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ac40cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3ac9260640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ac40cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42606/0 (socket says 172.21.15.16:42606) 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.307+0000 7f3ac9260640 1 -- 172.21.15.16:0/1849994542 learned_addr learned my addr 172.21.15.16:0/1849994542 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ac9260640 1 -- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac414bb30 msgr2=0x7f3ac40ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ac9260640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac414bb30 0x7f3ac40ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ac9260640 1 -- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40ca970 msgr2=0x7f3ac414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ac9260640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40ca970 0x7f3ac414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ac9260640 1 -- 172.21.15.16:0/1849994542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac40ce860 con 0x7f3ab0004d40 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ac9260640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ac40cb760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0011960 tx=0x7f3ac0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ab9ffb640 1 -- 172.21.15.16:0/1849994542 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000fa70 con 0x7f3ab0004d40 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ab9ffb640 1 -- 172.21.15.16:0/1849994542 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac000fc10 con 0x7f3ab0004d40 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac40ceb40 con 0x7f3ab0004d40 2024-05-11T01:13:24.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3ab9ffb640 1 -- 172.21.15.16:0/1849994542 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0014440 con 0x7f3ab0004d40 2024-05-11T01:13:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.308+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac40cf100 con 0x7f3ab0004d40 2024-05-11T01:13:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.309+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac40cad90 con 0x7f3ab0004d40 2024-05-11T01:13:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.310+0000 7f3ab9ffb640 1 -- 172.21.15.16:0/1849994542 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f3ac0012040 con 0x7f3ab0004d40 2024-05-11T01:13:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.311+0000 7f3ab9ffb640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa80764d0 0x7f3aa8078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.311+0000 7f3ab9ffb640 1 -- 172.21.15.16:0/1849994542 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3ac00980c0 con 0x7f3ab0004d40 2024-05-11T01:13:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.311+0000 7f3ac8a5f640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa80764d0 0x7f3aa8078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.311+0000 7f3ac8a5f640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa80764d0 0x7f3aa8078990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40ce270 tx=0x7f3ab4008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:24.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.315+0000 7f3ab9ffb640 1 -- 172.21.15.16:0/1849994542 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ac0019030 con 0x7f3ab0004d40 2024-05-11T01:13:24.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.529+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ac40cbca0 con 0x7f3aa80764d0 2024-05-11T01:13:24.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.537+0000 7f3ab9ffb640 1 -- 172.21.15.16:0/1849994542 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f3ab40118e0 con 0x7f3aa80764d0 2024-05-11T01:13:24.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:24.536 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:04", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:01", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa80764d0 msgr2=0x7f3aa8078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa80764d0 0x7f3aa8078990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ac40ce270 tx=0x7f3ab4008040 comp rx=0 tx=0).stop 2024-05-11T01:13:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 msgr2=0x7f3ac40cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ac40cb760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0011960 tx=0x7f3ac0011e20 comp rx=0 tx=0).stop 2024-05-11T01:13:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 shutdown_connections 2024-05-11T01:13:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa80764d0 0x7f3aa8078990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40ca970 0x7f3ac414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac414bb30 0x7f3ac40ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 --2- 172.21.15.16:0/1849994542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ab0004d40 0x7f3ac40cb760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 >> 172.21.15.16:0/1849994542 conn(0x7f3ac4073f00 msgr2=0x7f3ac40d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 shutdown_connections 2024-05-11T01:13:24.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.540+0000 7f3acb4c4640 1 -- 172.21.15.16:0/1849994542 wait complete. 2024-05-11T01:13:24.549 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:04", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:01", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:24.550 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:04', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:01', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:24.550 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:24.550 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:24.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:24.550 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2024-05-11T01:13:24.567 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:24.567 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:24.567 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:24.567 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:24.567 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:24.568 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:24.568 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:24.568 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:24.568 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:24.568 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:24.568 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:24.569 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:24.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir2 2024-05-11T01:13:24.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.714+0000 7fe2ea52b640 1 Processor -- start 2024-05-11T01:13:24.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.714+0000 7fe2ea52b640 1 -- start start 2024-05-11T01:13:24.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.714+0000 7fe2ea52b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2e415fd00 0x7fe2e40b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2ea52b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2ea52b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e40d2e30 con 0x7fe2e40d16c0 2024-05-11T01:13:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2ea52b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e40d4000 con 0x7fe2e415fd00 2024-05-11T01:13:24.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2ea52b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e40d3460 con 0x7fe2e4160180 2024-05-11T01:13:24.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2e8ac8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2dbfff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe2e415fd00 0x7fe2e40b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2e8ac8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:58936/0 (socket says 172.21.15.16:58936) 2024-05-11T01:13:24.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2e8ac8640 1 -- 172.21.15.16:0/3898522828 learned_addr learned my addr 172.21.15.16:0/3898522828 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:24.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2e8ac8640 1 -- 172.21.15.16:0/3898522828 >> v2:172.21.15.174:3300/0 conn(0x7fe2e415fd00 msgr2=0x7fe2e40b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:24.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2e8ac8640 1 --2- 172.21.15.16:0/3898522828 >> v2:172.21.15.174:3300/0 conn(0x7fe2e415fd00 0x7fe2e40b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2e8ac8640 1 -- 172.21.15.16:0/3898522828 >> v1:172.21.15.174:6789/0 conn(0x7fe2e40d16c0 legacy=0x7fe2e40d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.715+0000 7fe2e8ac8640 1 -- 172.21.15.16:0/3898522828 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e4160750 con 0x7fe2e4160180 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.716+0000 7fe2e8ac8640 1 --2- 172.21.15.16:0/3898522828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b5230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009e50 tx=0x7fe2dc02a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5740f00d7706da server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.716+0000 7fe2e37fe640 1 -- 172.21.15.16:0/3898522828 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc036070 con 0x7fe2e4160180 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.716+0000 7fe2e37fe640 1 -- 172.21.15.16:0/3898522828 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2dc031600 con 0x7fe2e4160180 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.716+0000 7fe2e37fe640 1 -- 172.21.15.16:0/3898522828 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0319d0 con 0x7fe2e4160180 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.717+0000 7fe2ea52b640 1 -- 172.21.15.16:0/3898522828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 msgr2=0x7fe2e40b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.717+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/3898522828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b5230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009e50 tx=0x7fe2dc02a630 comp rx=0 tx=0).stop 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.717+0000 7fe2ea52b640 1 -- 172.21.15.16:0/3898522828 shutdown_connections 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.717+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/3898522828 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b5230 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.717+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/3898522828 >> v2:172.21.15.174:3300/0 conn(0x7fe2e415fd00 0x7fe2e40b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.717+0000 7fe2ea52b640 1 -- 172.21.15.16:0/3898522828 >> 172.21.15.16:0/3898522828 conn(0x7fe2e40681c0 msgr2=0x7fe2e40685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.717+0000 7fe2ea52b640 1 -- 172.21.15.16:0/3898522828 shutdown_connections 2024-05-11T01:13:24.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.717+0000 7fe2ea52b640 1 -- 172.21.15.16:0/3898522828 wait complete. 2024-05-11T01:13:24.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.718+0000 7fe2ea52b640 1 Processor -- start 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.718+0000 7fe2ea52b640 1 -- start start 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2ea52b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e40d16c0 0x7fe2e41484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2ea52b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e415fd00 0x7fe2e40b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2ea52b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2ea52b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e406f250 con 0x7fe2e40d16c0 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2ea52b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e40d30f0 con 0x7fe2e415fd00 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2ea52b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e406f3d0 con 0x7fe2e4160180 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e40d16c0 0x7fe2e41484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e40d16c0 0x7fe2e41484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42620/0 (socket says 172.21.15.16:42620) 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e3fff640 1 -- 172.21.15.16:0/577278265 learned_addr learned my addr 172.21.15.16:0/577278265 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e8ac8640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2dbfff640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e415fd00 0x7fe2e40b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e3fff640 1 -- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 msgr2=0x7fe2e40b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e3fff640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e3fff640 1 -- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e415fd00 msgr2=0x7fe2e40b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e3fff640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e415fd00 0x7fe2e40b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.719+0000 7fe2e3fff640 1 -- 172.21.15.16:0/577278265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e40b54c0 con 0x7fe2e40d16c0 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.720+0000 7fe2e3fff640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e40d16c0 0x7fe2e41484f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400c760 tx=0x7fe2d400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.720+0000 7fe2e17fa640 1 -- 172.21.15.16:0/577278265 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4017070 con 0x7fe2e40d16c0 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.720+0000 7fe2e17fa640 1 -- 172.21.15.16:0/577278265 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d4005290 con 0x7fe2e40d16c0 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.720+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e40b51e0 con 0x7fe2e40d16c0 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.720+0000 7fe2e17fa640 1 -- 172.21.15.16:0/577278265 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400a880 con 0x7fe2e40d16c0 2024-05-11T01:13:24.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.720+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e40b60f0 con 0x7fe2e40d16c0 2024-05-11T01:13:24.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.721+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e406a5b0 con 0x7fe2e40d16c0 2024-05-11T01:13:24.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.721+0000 7fe2e17fa640 1 -- 172.21.15.16:0/577278265 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7fe2d401a070 con 0x7fe2e40d16c0 2024-05-11T01:13:24.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.722+0000 7fe2e17fa640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe2c4076500 0x7fe2c40789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:24.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.722+0000 7fe2e17fa640 1 -- 172.21.15.16:0/577278265 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7fe2d4096ef0 con 0x7fe2e40d16c0 2024-05-11T01:13:24.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.722+0000 7fe2dbfff640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe2c4076500 0x7fe2c40789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:24.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.723+0000 7fe2dbfff640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe2c4076500 0x7fe2c40789c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4161510 tx=0x7fe2cc009190 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:24.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.726+0000 7fe2e17fa640 1 -- 172.21.15.16:0/577278265 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe2d405fe00 con 0x7fe2e40d16c0 2024-05-11T01:13:24.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.941+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe2e40d06f0 con 0x7fe2c4076500 2024-05-11T01:13:24.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.949+0000 7fe2e17fa640 1 -- 172.21.15.16:0/577278265 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fe2e40d06f0 con 0x7fe2c4076500 2024-05-11T01:13:24.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:24.949 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:05", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe2c4076500 msgr2=0x7fe2c40789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe2c4076500 0x7fe2c40789c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4161510 tx=0x7fe2cc009190 comp rx=0 tx=0).stop 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e40d16c0 msgr2=0x7fe2e41484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e40d16c0 0x7fe2e41484f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400c760 tx=0x7fe2d400cc20 comp rx=0 tx=0).stop 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 shutdown_connections 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fe2c4076500 0x7fe2c40789c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe2e4160180 0x7fe2e40b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe2e415fd00 0x7fe2e40b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 --2- 172.21.15.16:0/577278265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2e40d16c0 0x7fe2e41484f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:24.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 >> 172.21.15.16:0/577278265 conn(0x7fe2e40681c0 msgr2=0x7fe2e406d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:24.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 shutdown_connections 2024-05-11T01:13:24.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:24.952+0000 7fe2ea52b640 1 -- 172.21.15.16:0/577278265 wait complete. 2024-05-11T01:13:24.961 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:05", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:24.962 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:05', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:24.962 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:24.962 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:24.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:24.962 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2024-05-11T01:13:24.979 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:24.979 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:24.981 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:24.981 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:24.981 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:24.981 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir3 2024-05-11T01:13:25.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.126+0000 7f4e105b6640 1 Processor -- start 2024-05-11T01:13:25.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.126+0000 7f4e105b6640 1 -- start start 2024-05-11T01:13:25.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e105b6640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4e080cd940 0x7f4e080cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e105b6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e08140f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e105b6640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0815db00 con 0x7f4e081402d0 2024-05-11T01:13:25.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e105b6640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0815dde0 con 0x7f4e080cd940 2024-05-11T01:13:25.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e105b6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0815e0c0 con 0x7f4e08140b00 2024-05-11T01:13:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e0eb53640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e08140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e0db51640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4e080cd940 0x7f4e080cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e0eb53640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e08140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:58960/0 (socket says 172.21.15.16:58960) 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.127+0000 7f4e0eb53640 1 -- 172.21.15.16:0/3825100238 learned_addr learned my addr 172.21.15.16:0/3825100238 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.128+0000 7f4e0d350640 1 -- 172.21.15.16:0/3825100238 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692988511 0 0) 0x7f4e0815db00 con 0x7f4e081402d0 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.128+0000 7f4e0d350640 1 -- 172.21.15.16:0/3825100238 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df4003520 con 0x7f4e081402d0 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.128+0000 7f4e0db51640 1 -- 172.21.15.16:0/3825100238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 msgr2=0x7f4e08140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.128+0000 7f4e0db51640 1 --2- 172.21.15.16:0/3825100238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e08140f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.128+0000 7f4e0db51640 1 -- 172.21.15.16:0/3825100238 >> v1:172.21.15.174:6789/0 conn(0x7f4e081402d0 legacy=0x7f4e080b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.128+0000 7f4e0db51640 1 -- 172.21.15.16:0/3825100238 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0815e3a0 con 0x7f4e080cd940 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.128+0000 7f4e0eb53640 1 --2- 172.21.15.16:0/3825100238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e08140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e0db51640 1 --2- 172.21.15.16:0/3825100238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 0x7f4e080cddd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097a0 tx=0x7f4df802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a8a7c08898090d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e0d350640 1 -- 172.21.15.16:0/3825100238 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8037070 con 0x7f4e080cd940 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e0d350640 1 -- 172.21.15.16:0/3825100238 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df8032440 con 0x7f4e080cd940 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e0d350640 1 -- 172.21.15.16:0/3825100238 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8032810 con 0x7f4e080cd940 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e105b6640 1 -- 172.21.15.16:0/3825100238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 msgr2=0x7f4e080cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e105b6640 1 --2- 172.21.15.16:0/3825100238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 0x7f4e080cddd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4df80097a0 tx=0x7f4df802a180 comp rx=0 tx=0).stop 2024-05-11T01:13:25.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e105b6640 1 -- 172.21.15.16:0/3825100238 shutdown_connections 2024-05-11T01:13:25.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e105b6640 1 --2- 172.21.15.16:0/3825100238 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e08140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e105b6640 1 --2- 172.21.15.16:0/3825100238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 0x7f4e080cddd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e105b6640 1 -- 172.21.15.16:0/3825100238 >> 172.21.15.16:0/3825100238 conn(0x7f4e0806c3e0 msgr2=0x7f4e0806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:25.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e105b6640 1 -- 172.21.15.16:0/3825100238 shutdown_connections 2024-05-11T01:13:25.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.129+0000 7f4e105b6640 1 -- 172.21.15.16:0/3825100238 wait complete. 2024-05-11T01:13:25.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e105b6640 1 Processor -- start 2024-05-11T01:13:25.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e105b6640 1 -- start start 2024-05-11T01:13:25.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e105b6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 0x7f4e080b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e105b6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e081402d0 0x7f4e0813ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e105b6640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e0813b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e105b6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4e080b2d40 con 0x7f4e081402d0 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e105b6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e081406b0 con 0x7f4e080cd940 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e105b6640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4e080b2ec0 con 0x7f4e08140b00 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e0db51640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e081402d0 0x7f4e0813ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e0db51640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e081402d0 0x7f4e0813ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42626/0 (socket says 172.21.15.16:42626) 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.131+0000 7f4e0db51640 1 -- 172.21.15.16:0/2897679635 learned_addr learned my addr 172.21.15.16:0/2897679635 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e0e352640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 0x7f4e080b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e0eb53640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e0813b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e0db51640 1 -- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 msgr2=0x7f4e0813b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e0db51640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e0813b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e0db51640 1 -- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 msgr2=0x7f4e080b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e0db51640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 0x7f4e080b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e0db51640 1 -- 172.21.15.16:0/2897679635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e08157820 con 0x7f4e081402d0 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e0db51640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e081402d0 0x7f4e0813ab20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4df8035040 tx=0x7f4df80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4dfeffd640 1 -- 172.21.15.16:0/2897679635 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8041030 con 0x7f4e081402d0 2024-05-11T01:13:25.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4dfeffd640 1 -- 172.21.15.16:0/2897679635 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df803d4e0 con 0x7f4e081402d0 2024-05-11T01:13:25.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0813b6f0 con 0x7f4e081402d0 2024-05-11T01:13:25.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4dfeffd640 1 -- 172.21.15.16:0/2897679635 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8037040 con 0x7f4e081402d0 2024-05-11T01:13:25.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.132+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0813bcb0 con 0x7f4e081402d0 2024-05-11T01:13:25.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.133+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0806a5b0 con 0x7f4e081402d0 2024-05-11T01:13:25.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.134+0000 7f4dfeffd640 1 -- 172.21.15.16:0/2897679635 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f4df8044070 con 0x7f4e081402d0 2024-05-11T01:13:25.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.134+0000 7f4dfeffd640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4dec0764d0 0x7f4dec078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.134+0000 7f4dfeffd640 1 -- 172.21.15.16:0/2897679635 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f4df80b80a0 con 0x7f4e081402d0 2024-05-11T01:13:25.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.134+0000 7f4e0e352640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4dec0764d0 0x7f4dec078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.135+0000 7f4e0e352640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4dec0764d0 0x7f4dec078990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e040016b0 tx=0x7f4e04009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.138+0000 7f4dfeffd640 1 -- 172.21.15.16:0/2897679635 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4df8081690 con 0x7f4e081402d0 2024-05-11T01:13:25.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.348+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e08160170 con 0x7f4dec0764d0 2024-05-11T01:13:25.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.356+0000 7f4dfeffd640 1 -- 172.21.15.16:0/2897679635 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f4e08160170 con 0x7f4dec0764d0 2024-05-11T01:13:25.355 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:25.355 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:05", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:25.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4dec0764d0 msgr2=0x7f4dec078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4dec0764d0 0x7f4dec078990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e040016b0 tx=0x7f4e04009040 comp rx=0 tx=0).stop 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e081402d0 msgr2=0x7f4e0813ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e081402d0 0x7f4e0813ab20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4df8035040 tx=0x7f4df80046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 shutdown_connections 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4dec0764d0 0x7f4dec078990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4e08140b00 0x7f4e0813b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e081402d0 0x7f4e0813ab20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 --2- 172.21.15.16:0/2897679635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e080cd940 0x7f4e080b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 >> 172.21.15.16:0/2897679635 conn(0x7f4e0806c3e0 msgr2=0x7f4e08160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 shutdown_connections 2024-05-11T01:13:25.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.358+0000 7f4e105b6640 1 -- 172.21.15.16:0/2897679635 wait complete. 2024-05-11T01:13:25.368 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:05", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:25.368 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:05', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:25.368 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:25.368 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:25.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:25.368 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2024-05-11T01:13:25.385 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:25.385 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:25.385 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:25.385 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:25.385 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:25.385 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:25.386 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:25.386 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:25.386 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:25.386 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:25.386 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:25.386 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:25.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir4 2024-05-11T01:13:25.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.532+0000 7f2a95c2c640 1 Processor -- start 2024-05-11T01:13:25.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.532+0000 7f2a95c2c640 1 -- start start 2024-05-11T01:13:25.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a95c2c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2a90148e50 0x7f2a900b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a95c2c640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a900b5aa0 con 0x7f2a9006eb10 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a95c2c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a90149230 con 0x7f2a900707a0 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a95c2c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2a90163290 con 0x7f2a90148e50 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a8f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2a90148e50 0x7f2a900b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a8ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2a9006eb10 0x7f2a900b5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52604/0 (socket says 172.21.15.16:52604) 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a8ffff640 1 -- 172.21.15.16:0/3746461370 learned_addr learned my addr 172.21.15.16:0/3746461370 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a8f7fe640 1 -- 172.21.15.16:0/3746461370 >> v1:172.21.15.174:6789/0 conn(0x7f2a900707a0 legacy=0x7f2a900b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a8f7fe640 1 -- 172.21.15.16:0/3746461370 >> v1:172.21.15.16:6789/0 conn(0x7f2a9006eb10 legacy=0x7f2a900b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a8f7fe640 1 -- 172.21.15.16:0/3746461370 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a90163570 con 0x7f2a90148e50 2024-05-11T01:13:25.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.533+0000 7f2a8e7fc640 1 -- 172.21.15.16:0/3746461370 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505865156 0 0) 0x7f2a900b5aa0 con 0x7f2a9006eb10 2024-05-11T01:13:25.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.534+0000 7f2a8f7fe640 1 --2- 172.21.15.16:0/3746461370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a90148e50 0x7f2a900b66a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2a90149400 tx=0x7f2a8002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8914750117f4739 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.534+0000 7f2a8e7fc640 1 -- 172.21.15.16:0/3746461370 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80037070 con 0x7f2a90148e50 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.534+0000 7f2a8e7fc640 1 -- 172.21.15.16:0/3746461370 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8002ae50 con 0x7f2a90148e50 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.534+0000 7f2a8e7fc640 1 -- 172.21.15.16:0/3746461370 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80032660 con 0x7f2a90148e50 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.535+0000 7f2a95c2c640 1 -- 172.21.15.16:0/3746461370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a90148e50 msgr2=0x7f2a900b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.535+0000 7f2a95c2c640 1 --2- 172.21.15.16:0/3746461370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a90148e50 0x7f2a900b66a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2a90149400 tx=0x7f2a8002a100 comp rx=0 tx=0).stop 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.535+0000 7f2a95c2c640 1 -- 172.21.15.16:0/3746461370 shutdown_connections 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.535+0000 7f2a95c2c640 1 --2- 172.21.15.16:0/3746461370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a90148e50 0x7f2a900b66a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.535+0000 7f2a95c2c640 1 -- 172.21.15.16:0/3746461370 >> 172.21.15.16:0/3746461370 conn(0x7f2a900b8510 msgr2=0x7f2a900b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.535+0000 7f2a95c2c640 1 -- 172.21.15.16:0/3746461370 shutdown_connections 2024-05-11T01:13:25.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.535+0000 7f2a95c2c640 1 -- 172.21.15.16:0/3746461370 wait complete. 2024-05-11T01:13:25.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.536+0000 7f2a95c2c640 1 Processor -- start 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.536+0000 7f2a95c2c640 1 -- start start 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a95c2c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a9006eb10 0x7f2a9013e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a95c2c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a900707a0 0x7f2a90142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a95c2c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a90148e50 0x7f2a900b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a95c2c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2a900b6be0 con 0x7f2a9006eb10 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a95c2c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2a90163b30 con 0x7f2a900707a0 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a95c2c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2a900b6d60 con 0x7f2a90148e50 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a9006eb10 0x7f2a9013e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a9006eb10 0x7f2a9013e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42632/0 (socket says 172.21.15.16:42632) 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8f7fe640 1 -- 172.21.15.16:0/2702472983 learned_addr learned my addr 172.21.15.16:0/2702472983 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:25.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8ffff640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a90148e50 0x7f2a900b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8effd640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a900707a0 0x7f2a90142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8f7fe640 1 -- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a90148e50 msgr2=0x7f2a900b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8f7fe640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a90148e50 0x7f2a900b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8f7fe640 1 -- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a900707a0 msgr2=0x7f2a90142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8f7fe640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a900707a0 0x7f2a90142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8f7fe640 1 -- 172.21.15.16:0/2702472983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a901f5950 con 0x7f2a9006eb10 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.537+0000 7f2a8ffff640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a90148e50 0x7f2a900b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.538+0000 7f2a8f7fe640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a9006eb10 0x7f2a9013e2c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2a80000c00 tx=0x7f2a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.538+0000 7f2a77fff640 1 -- 172.21.15.16:0/2702472983 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80042070 con 0x7f2a9006eb10 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.538+0000 7f2a77fff640 1 -- 172.21.15.16:0/2702472983 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8003e670 con 0x7f2a9006eb10 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.538+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a901f5c30 con 0x7f2a9006eb10 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.538+0000 7f2a77fff640 1 -- 172.21.15.16:0/2702472983 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80037040 con 0x7f2a9006eb10 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.538+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a901f61f0 con 0x7f2a9006eb10 2024-05-11T01:13:25.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.539+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a901f8bd0 con 0x7f2a9006eb10 2024-05-11T01:13:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.539+0000 7f2a77fff640 1 -- 172.21.15.16:0/2702472983 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f2a80045070 con 0x7f2a9006eb10 2024-05-11T01:13:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.540+0000 7f2a77fff640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f2a7c0764d0 0x7f2a7c078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.540+0000 7f2a77fff640 1 -- 172.21.15.16:0/2702472983 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f2a800b8150 con 0x7f2a9006eb10 2024-05-11T01:13:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.540+0000 7f2a8effd640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f2a7c0764d0 0x7f2a7c078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.541+0000 7f2a8effd640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f2a7c0764d0 0x7f2a7c078990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a901417f0 tx=0x7f2a84009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.544+0000 7f2a77fff640 1 -- 172.21.15.16:0/2702472983 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2a901f8bd0 con 0x7f2a9006eb10 2024-05-11T01:13:25.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.754+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a9006a5b0 con 0x7f2a7c0764d0 2024-05-11T01:13:25.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.762+0000 7f2a77fff640 1 -- 172.21.15.16:0/2702472983 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f2a9006a5b0 con 0x7f2a7c0764d0 2024-05-11T01:13:25.761 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:25.761 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:06", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f2a7c0764d0 msgr2=0x7f2a7c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f2a7c0764d0 0x7f2a7c078990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a901417f0 tx=0x7f2a84009040 comp rx=0 tx=0).stop 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a9006eb10 msgr2=0x7f2a9013e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a9006eb10 0x7f2a9013e2c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2a80000c00 tx=0x7f2a800046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 shutdown_connections 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f2a7c0764d0 0x7f2a7c078990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2a90148e50 0x7f2a900b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2a900707a0 0x7f2a90142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 --2- 172.21.15.16:0/2702472983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a9006eb10 0x7f2a9013e2c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 >> 172.21.15.16:0/2702472983 conn(0x7f2a900b8510 msgr2=0x7f2a90148080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:25.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 shutdown_connections 2024-05-11T01:13:25.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.764+0000 7f2a95c2c640 1 -- 172.21.15.16:0/2702472983 wait complete. 2024-05-11T01:13:25.774 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:06", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:25.774 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:06', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:25.774 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:25.774 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:25.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:25.775 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:25.793 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:25.793 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir5 2024-05-11T01:13:25.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.938+0000 7f8e5e1e4640 1 Processor -- start 2024-05-11T01:13:25.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.938+0000 7f8e5e1e4640 1 -- start start 2024-05-11T01:13:25.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.939+0000 7f8e5e1e4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8e581402d0 0x7f8e580b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.939+0000 7f8e5e1e4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8e58141b10 0x7f8e580cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.939+0000 7f8e5e1e4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e5815db00 con 0x7f8e580cd940 2024-05-11T01:13:25.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.939+0000 7f8e5e1e4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8e580ce2f0 con 0x7f8e581402d0 2024-05-11T01:13:25.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.939+0000 7f8e5e1e4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8e5815dde0 con 0x7f8e58141b10 2024-05-11T01:13:25.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.939+0000 7f8e577fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8e581402d0 0x7f8e580b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.939+0000 7f8e56ffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8e580cd940 0x7f8e58142a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52620/0 (socket says 172.21.15.16:52620) 2024-05-11T01:13:25.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.939+0000 7f8e56ffd640 1 -- 172.21.15.16:0/3145637259 learned_addr learned my addr 172.21.15.16:0/3145637259 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:25.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.940+0000 7f8e57fff640 1 --2- 172.21.15.16:0/3145637259 >> v2:172.21.15.174:3300/0 conn(0x7f8e58141b10 0x7f8e580cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.940+0000 7f8e577fe640 1 -- 172.21.15.16:0/3145637259 >> v2:172.21.15.174:3300/0 conn(0x7f8e58141b10 msgr2=0x7f8e580cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:25.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.940+0000 7f8e577fe640 1 --2- 172.21.15.16:0/3145637259 >> v2:172.21.15.174:3300/0 conn(0x7f8e58141b10 0x7f8e580cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.940+0000 7f8e577fe640 1 -- 172.21.15.16:0/3145637259 >> v1:172.21.15.16:6789/0 conn(0x7f8e580cd940 legacy=0x7f8e58142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.940+0000 7f8e577fe640 1 -- 172.21.15.16:0/3145637259 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5815e0c0 con 0x7f8e581402d0 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.940+0000 7f8e577fe640 1 --2- 172.21.15.16:0/3145637259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e580b3290 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8e581549e0 tx=0x7f8e4802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deaefadfe910b4a server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e567fc640 1 -- 172.21.15.16:0/3145637259 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48037070 con 0x7f8e581402d0 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e567fc640 1 -- 172.21.15.16:0/3145637259 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e48032440 con 0x7f8e581402d0 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e567fc640 1 -- 172.21.15.16:0/3145637259 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48032810 con 0x7f8e581402d0 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/3145637259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 msgr2=0x7f8e580b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/3145637259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e580b3290 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8e581549e0 tx=0x7f8e4802a1a0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/3145637259 shutdown_connections 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/3145637259 >> v2:172.21.15.174:3300/0 conn(0x7f8e58141b10 0x7f8e580cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/3145637259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e580b3290 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/3145637259 >> 172.21.15.16:0/3145637259 conn(0x7f8e5806c3e0 msgr2=0x7f8e5806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:25.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/3145637259 shutdown_connections 2024-05-11T01:13:25.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.941+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/3145637259 wait complete. 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.942+0000 7f8e5e1e4640 1 Processor -- start 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.943+0000 7f8e5e1e4640 1 -- start start 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.943+0000 7f8e5e1e4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e580cd940 0x7f8e58138250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.943+0000 7f8e5e1e4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e58157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.943+0000 7f8e5e1e4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e58141b10 0x7f8e580b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.943+0000 7f8e5e1e4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581406b0 con 0x7f8e581402d0 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.943+0000 7f8e5e1e4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5815e680 con 0x7f8e58141b10 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.943+0000 7f8e5e1e4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8e580b37d0 con 0x7f8e580cd940 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.943+0000 7f8e56ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e58157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e56ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e58157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42640/0 (socket says 172.21.15.16:42640) 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e56ffd640 1 -- 172.21.15.16:0/2537498504 learned_addr learned my addr 172.21.15.16:0/2537498504 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:25.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e577fe640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e580cd940 0x7f8e58138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e57fff640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e58141b10 0x7f8e580b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e56ffd640 1 -- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e580cd940 msgr2=0x7f8e58138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e56ffd640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e580cd940 0x7f8e58138250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e56ffd640 1 -- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e58141b10 msgr2=0x7f8e580b4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e56ffd640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e58141b10 0x7f8e580b4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e56ffd640 1 -- 172.21.15.16:0/2537498504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e580cf940 con 0x7f8e581402d0 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e56ffd640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e58157230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00c4d0 tx=0x7f8e4c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e3ffff640 1 -- 172.21.15.16:0/2537498504 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c017070 con 0x7f8e581402d0 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e3ffff640 1 -- 172.21.15.16:0/2537498504 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e4c005d00 con 0x7f8e581402d0 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e580cfc20 con 0x7f8e581402d0 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e3ffff640 1 -- 172.21.15.16:0/2537498504 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0072b0 con 0x7f8e581402d0 2024-05-11T01:13:25.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.944+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e580d01e0 con 0x7f8e581402d0 2024-05-11T01:13:25.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.945+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e5806a5b0 con 0x7f8e581402d0 2024-05-11T01:13:25.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.946+0000 7f8e3ffff640 1 -- 172.21.15.16:0/2537498504 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f8e4c01a070 con 0x7f8e581402d0 2024-05-11T01:13:25.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.946+0000 7f8e3ffff640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8e440764d0 0x7f8e44078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:25.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.946+0000 7f8e3ffff640 1 -- 172.21.15.16:0/2537498504 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f8e4c096c30 con 0x7f8e581402d0 2024-05-11T01:13:25.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.946+0000 7f8e577fe640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8e440764d0 0x7f8e44078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:25.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.947+0000 7f8e577fe640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8e440764d0 0x7f8e44078990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e48034000 tx=0x7f8e4802e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:25.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:25.951+0000 7f8e3ffff640 1 -- 172.21.15.16:0/2537498504 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8e4c05fc70 con 0x7f8e581402d0 2024-05-11T01:13:26.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.163+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e5813dfa0 con 0x7f8e440764d0 2024-05-11T01:13:26.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.171+0000 7f8e3ffff640 1 -- 172.21.15.16:0/2537498504 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f8e5813dfa0 con 0x7f8e440764d0 2024-05-11T01:13:26.171 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:26.171 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:06", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8e440764d0 msgr2=0x7f8e44078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8e440764d0 0x7f8e44078990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e48034000 tx=0x7f8e4802e000 comp rx=0 tx=0).stop 2024-05-11T01:13:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 msgr2=0x7f8e58157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e58157230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00c4d0 tx=0x7f8e4c00c990 comp rx=0 tx=0).stop 2024-05-11T01:13:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 shutdown_connections 2024-05-11T01:13:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8e440764d0 0x7f8e44078990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e58141b10 0x7f8e580b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e581402d0 0x7f8e58157230 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 --2- 172.21.15.16:0/2537498504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8e580cd940 0x7f8e58138250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 >> 172.21.15.16:0/2537498504 conn(0x7f8e5806c3e0 msgr2=0x7f8e580b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:26.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 shutdown_connections 2024-05-11T01:13:26.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.174+0000 7f8e5e1e4640 1 -- 172.21.15.16:0/2537498504 wait complete. 2024-05-11T01:13:26.184 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:06", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:26.184 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:06', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:26.184 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:26.184 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:26.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:26.184 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:26.202 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:26.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir6 2024-05-11T01:13:26.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.349+0000 7ff8ba6e1640 1 Processor -- start 2024-05-11T01:13:26.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.349+0000 7ff8ba6e1640 1 -- start start 2024-05-11T01:13:26.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8ba6e1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8b415f6b0 0x7ff8b40d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8ba6e1640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff8b40d00e0 0x7ff8b40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8ba6e1640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8b415fa90 con 0x7ff8b40bac80 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8ba6e1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b40d3750 con 0x7ff8b415f6b0 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8ba6e1640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b40d39f0 con 0x7ff8b40d00e0 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8b3fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8b415f6b0 0x7ff8b40d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8b3fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8b415f6b0 0x7ff8b40d3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42656/0 (socket says 172.21.15.16:42656) 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8b3fff640 1 -- 172.21.15.16:0/556387118 learned_addr learned my addr 172.21.15.16:0/556387118 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.350+0000 7ff8b8c7e640 1 --2- 172.21.15.16:0/556387118 >> v2:172.21.15.174:3300/0 conn(0x7ff8b40d00e0 0x7ff8b40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.351+0000 7ff8b3fff640 1 -- 172.21.15.16:0/556387118 >> v2:172.21.15.174:3300/0 conn(0x7ff8b40d00e0 msgr2=0x7ff8b40d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.351+0000 7ff8b3fff640 1 --2- 172.21.15.16:0/556387118 >> v2:172.21.15.174:3300/0 conn(0x7ff8b40d00e0 0x7ff8b40d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.351+0000 7ff8b3fff640 1 -- 172.21.15.16:0/556387118 >> v1:172.21.15.174:6789/0 conn(0x7ff8b40bac80 legacy=0x7ff8b40d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.351+0000 7ff8b3fff640 1 -- 172.21.15.16:0/556387118 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b40d3cd0 con 0x7ff8b415f6b0 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.351+0000 7ff8b3fff640 1 --2- 172.21.15.16:0/556387118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b415f6b0 0x7ff8b40d3210 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40cfb30 tx=0x7ff8a402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5105d58d67f87d1c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:26.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8b2ffd640 1 -- 172.21.15.16:0/556387118 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4037070 con 0x7ff8b415f6b0 2024-05-11T01:13:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8b2ffd640 1 -- 172.21.15.16:0/556387118 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a402ae50 con 0x7ff8b415f6b0 2024-05-11T01:13:26.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8b2ffd640 1 -- 172.21.15.16:0/556387118 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4032860 con 0x7ff8b415f6b0 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/556387118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b415f6b0 msgr2=0x7ff8b40d3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/556387118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b415f6b0 0x7ff8b40d3210 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40cfb30 tx=0x7ff8a402a300 comp rx=0 tx=0).stop 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/556387118 shutdown_connections 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/556387118 >> v2:172.21.15.174:3300/0 conn(0x7ff8b40d00e0 0x7ff8b40d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/556387118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b415f6b0 0x7ff8b40d3210 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/556387118 >> 172.21.15.16:0/556387118 conn(0x7ff8b4073f00 msgr2=0x7ff8b4074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/556387118 shutdown_connections 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.352+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/556387118 wait complete. 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.353+0000 7ff8ba6e1640 1 Processor -- start 2024-05-11T01:13:26.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8ba6e1640 1 -- start start 2024-05-11T01:13:26.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8ba6e1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b40bac80 0x7ff8b415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8ba6e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b40d00e0 0x7ff8b40adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8ba6e1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b415f6b0 0x7ff8b40b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8ba6e1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b40d4570 con 0x7ff8b40bac80 2024-05-11T01:13:26.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8ba6e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b40d4290 con 0x7ff8b40d00e0 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8ba6e1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b40b8400 con 0x7ff8b415f6b0 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b40bac80 0x7ff8b415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8b3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b40bac80 0x7ff8b415cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42658/0 (socket says 172.21.15.16:42658) 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8b3fff640 1 -- 172.21.15.16:0/1586317792 learned_addr learned my addr 172.21.15.16:0/1586317792 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b8c7e640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b415f6b0 0x7ff8b40b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.354+0000 7ff8b37fe640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b40d00e0 0x7ff8b40adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b3fff640 1 -- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b415f6b0 msgr2=0x7ff8b40b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b3fff640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b415f6b0 0x7ff8b40b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b3fff640 1 -- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b40d00e0 msgr2=0x7ff8b40adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b3fff640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b40d00e0 0x7ff8b40adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b3fff640 1 -- 172.21.15.16:0/1586317792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b415d110 con 0x7ff8b40bac80 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b3fff640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b40bac80 0x7ff8b415cbd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4000c00 tx=0x7ff8a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b0ff9640 1 -- 172.21.15.16:0/1586317792 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4042070 con 0x7ff8b40bac80 2024-05-11T01:13:26.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b0ff9640 1 -- 172.21.15.16:0/1586317792 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a403e660 con 0x7ff8b40bac80 2024-05-11T01:13:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b40ae630 con 0x7ff8b40bac80 2024-05-11T01:13:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8b0ff9640 1 -- 172.21.15.16:0/1586317792 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4037040 con 0x7ff8b40bac80 2024-05-11T01:13:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.355+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b40cd960 con 0x7ff8b40bac80 2024-05-11T01:13:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.356+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8b406a5b0 con 0x7ff8b40bac80 2024-05-11T01:13:26.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.357+0000 7ff8b0ff9640 1 -- 172.21.15.16:0/1586317792 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7ff8a4045070 con 0x7ff8b40bac80 2024-05-11T01:13:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.357+0000 7ff8b0ff9640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff8a00764d0 0x7ff8a0078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.357+0000 7ff8b0ff9640 1 -- 172.21.15.16:0/1586317792 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7ff8a40b80a0 con 0x7ff8b40bac80 2024-05-11T01:13:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.357+0000 7ff8b37fe640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff8a00764d0 0x7ff8a0078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.358+0000 7ff8b37fe640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff8a00764d0 0x7ff8a0078990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8b415fe80 tx=0x7ff8a8009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:26.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.362+0000 7ff8b0ff9640 1 -- 172.21.15.16:0/1586317792 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff8a4081170 con 0x7ff8b40bac80 2024-05-11T01:13:26.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.576+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff8b40cd430 con 0x7ff8a00764d0 2024-05-11T01:13:26.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.585+0000 7ff8b0ff9640 1 -- 172.21.15.16:0/1586317792 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7ff8b40cd430 con 0x7ff8a00764d0 2024-05-11T01:13:26.585 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:26.585 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:06", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:26.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff8a00764d0 msgr2=0x7ff8a0078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff8a00764d0 0x7ff8a0078990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8b415fe80 tx=0x7ff8a8009040 comp rx=0 tx=0).stop 2024-05-11T01:13:26.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b40bac80 msgr2=0x7ff8b415cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b40bac80 0x7ff8b415cbd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4000c00 tx=0x7ff8a40046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 shutdown_connections 2024-05-11T01:13:26.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff8a00764d0 0x7ff8a0078990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8b415f6b0 0x7ff8b40b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8b40d00e0 0x7ff8b40adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 --2- 172.21.15.16:0/1586317792 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8b40bac80 0x7ff8b415cbd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 >> 172.21.15.16:0/1586317792 conn(0x7ff8b4073f00 msgr2=0x7ff8b4161fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:26.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 shutdown_connections 2024-05-11T01:13:26.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.588+0000 7ff8ba6e1640 1 -- 172.21.15.16:0/1586317792 wait complete. 2024-05-11T01:13:26.598 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:06", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:26.598 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:06', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:26.598 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:26.598 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:26.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:26.599 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:26.616 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:26.617 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:26.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir7 2024-05-11T01:13:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.762+0000 7f9080d0a640 1 Processor -- start 2024-05-11T01:13:26.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.763+0000 7f9080d0a640 1 -- start start 2024-05-11T01:13:26.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.763+0000 7f9080d0a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f907c163010 0x7f907c0b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.763+0000 7f9080d0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0b72c0 0x7f907c0b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9080d0a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f907c0b76d0 con 0x7f907c0bae40 2024-05-11T01:13:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9080d0a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f907c1635d0 con 0x7f907c163010 2024-05-11T01:13:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9080d0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f907c1638b0 con 0x7f907c0b72c0 2024-05-11T01:13:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9079d9b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f907c163010 0x7f907c0b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9079d9b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f907c163010 0x7f907c0b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42664/0 (socket says 172.21.15.16:42664) 2024-05-11T01:13:26.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9079d9b640 1 -- 172.21.15.16:0/2749121474 learned_addr learned my addr 172.21.15.16:0/2749121474 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f907ad9d640 1 --2- 172.21.15.16:0/2749121474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0b72c0 0x7f907c0b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9079d9b640 1 -- 172.21.15.16:0/2749121474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0b72c0 msgr2=0x7f907c0b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9079d9b640 1 --2- 172.21.15.16:0/2749121474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0b72c0 0x7f907c0b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9079d9b640 1 -- 172.21.15.16:0/2749121474 >> v1:172.21.15.174:6789/0 conn(0x7f907c0bae40 legacy=0x7f907c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.764+0000 7f9079d9b640 1 -- 172.21.15.16:0/2749121474 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c163b90 con 0x7f907c163010 2024-05-11T01:13:26.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.765+0000 7f9079d9b640 1 --2- 172.21.15.16:0/2749121474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9070009870 tx=0x7f907002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300963e3b0d4fed5 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.765+0000 7f907959a640 1 -- 172.21.15.16:0/2749121474 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070037070 con 0x7f907c163010 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.765+0000 7f907959a640 1 -- 172.21.15.16:0/2749121474 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9070032440 con 0x7f907c163010 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.765+0000 7f907959a640 1 -- 172.21.15.16:0/2749121474 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070032810 con 0x7f907c163010 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.765+0000 7f9080d0a640 1 -- 172.21.15.16:0/2749121474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 msgr2=0x7f907c0b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.765+0000 7f9080d0a640 1 --2- 172.21.15.16:0/2749121474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6d80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9070009870 tx=0x7f907002a130 comp rx=0 tx=0).stop 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.766+0000 7f9080d0a640 1 -- 172.21.15.16:0/2749121474 shutdown_connections 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.766+0000 7f9080d0a640 1 --2- 172.21.15.16:0/2749121474 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0b72c0 0x7f907c0b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.766+0000 7f9080d0a640 1 --2- 172.21.15.16:0/2749121474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6d80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.766+0000 7f9080d0a640 1 -- 172.21.15.16:0/2749121474 >> 172.21.15.16:0/2749121474 conn(0x7f907c074140 msgr2=0x7f907c0d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.766+0000 7f9080d0a640 1 -- 172.21.15.16:0/2749121474 shutdown_connections 2024-05-11T01:13:26.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.766+0000 7f9080d0a640 1 -- 172.21.15.16:0/2749121474 wait complete. 2024-05-11T01:13:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.767+0000 7f9080d0a640 1 Processor -- start 2024-05-11T01:13:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.767+0000 7f9080d0a640 1 -- start start 2024-05-11T01:13:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f9080d0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f907c0b72c0 0x7f907c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.771 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f9080d0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0bae40 0x7f907c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f9080d0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f9080d0a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f907c0b42b0 con 0x7f907c163010 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f9080d0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f907c0bb220 con 0x7f907c0b72c0 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f9080d0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f907c0b4430 con 0x7f907c0bae40 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42680/0 (socket says 172.21.15.16:42680) 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 -- 172.21.15.16:0/3444228813 learned_addr learned my addr 172.21.15.16:0/3444228813 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f9079d9b640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0bae40 0x7f907c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907a59c640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f907c0b72c0 0x7f907c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 -- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0bae40 msgr2=0x7f907c0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0bae40 0x7f907c0b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 -- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f907c0b72c0 msgr2=0x7f907c0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f907c0b72c0 0x7f907c0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:26.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 -- 172.21.15.16:0/3444228813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c0c8420 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f907ad9d640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9074007e70 tx=0x7f907400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.768+0000 7f906affd640 1 -- 172.21.15.16:0/3444228813 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074014620 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.769+0000 7f906affd640 1 -- 172.21.15.16:0/3444228813 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074019070 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.769+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907c1f8be0 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.769+0000 7f906affd640 1 -- 172.21.15.16:0/3444228813 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074014a20 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.769+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907c1f91a0 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.770+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f907c06a5b0 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.770+0000 7f906affd640 1 -- 172.21.15.16:0/3444228813 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f9074014bc0 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.771+0000 7f906affd640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f905c0764d0 0x7f905c078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.771+0000 7f906affd640 1 -- 172.21.15.16:0/3444228813 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f90740982b0 con 0x7f907c163010 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.771+0000 7f907a59c640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f905c0764d0 0x7f905c078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:26.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.772+0000 7f907a59c640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f905c0764d0 0x7f905c078990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f906c004f60 tx=0x7f906c007e30 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:26.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.775+0000 7f906affd640 1 -- 172.21.15.16:0/3444228813 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f90740611c0 con 0x7f907c163010 2024-05-11T01:13:26.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:26.992+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f907c0d2fa0 con 0x7f905c0764d0 2024-05-11T01:13:27.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.001+0000 7f906affd640 1 -- 172.21.15.16:0/3444228813 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f907c0d2fa0 con 0x7f905c0764d0 2024-05-11T01:13:27.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:27.000 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:07", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:27.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f905c0764d0 msgr2=0x7f905c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f905c0764d0 0x7f905c078990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f906c004f60 tx=0x7f906c007e30 comp rx=0 tx=0).stop 2024-05-11T01:13:27.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 msgr2=0x7f907c0b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9074007e70 tx=0x7f907400e4b0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 shutdown_connections 2024-05-11T01:13:27.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f905c0764d0 0x7f905c078990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f907c163010 0x7f907c0b6710 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f907c0bae40 0x7f907c0b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 --2- 172.21.15.16:0/3444228813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f907c0b72c0 0x7f907c0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 >> 172.21.15.16:0/3444228813 conn(0x7f907c074140 msgr2=0x7f907c0b8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:27.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 shutdown_connections 2024-05-11T01:13:27.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.003+0000 7f9080d0a640 1 -- 172.21.15.16:0/3444228813 wait complete. 2024-05-11T01:13:27.013 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:07", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:27.013 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:07', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:27.013 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:27.013 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:27.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:27.013 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:27.031 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:27.031 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:27.032 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir8 2024-05-11T01:13:27.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.178+0000 7f7501751640 1 Processor -- start 2024-05-11T01:13:27.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.178+0000 7f7501751640 1 -- start start 2024-05-11T01:13:27.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f7501751640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74fc0b1020 0x7f74fc0b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f7501751640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74fc15d550 con 0x7f74fc15d170 2024-05-11T01:13:27.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f7501751640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74fc163300 con 0x7f74fc0b5070 2024-05-11T01:13:27.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f7501751640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f74fc163f10 con 0x7f74fc0b1020 2024-05-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f74f27fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74fc0b1020 0x7f74fc0b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f74f27fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74fc0b1020 0x7f74fc0b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42686/0 (socket says 172.21.15.16:42686) 2024-05-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f74faffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f74fc15d170 0x7f74fc06c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52636/0 (socket says 172.21.15.16:52636) 2024-05-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f74f27fc640 1 -- 172.21.15.16:0/3143458805 learned_addr learned my addr 172.21.15.16:0/3143458805 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f74f27fc640 1 -- 172.21.15.16:0/3143458805 >> v1:172.21.15.174:6789/0 conn(0x7f74fc0b5070 legacy=0x7f74fc0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f74f27fc640 1 -- 172.21.15.16:0/3143458805 >> v1:172.21.15.16:6789/0 conn(0x7f74fc15d170 legacy=0x7f74fc06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f74f27fc640 1 -- 172.21.15.16:0/3143458805 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc1635e0 con 0x7f74fc0b1020 2024-05-11T01:13:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.179+0000 7f74fa7fc640 1 -- 172.21.15.16:0/3143458805 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072110793 0 0) 0x7f74fc15d550 con 0x7f74fc15d170 2024-05-11T01:13:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.180+0000 7f74f27fc640 1 --2- 172.21.15.16:0/3143458805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc0b1020 0x7f74fc0b14b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009870 tx=0x7f74e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f621387426e6b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.180+0000 7f74fa7fc640 1 -- 172.21.15.16:0/3143458805 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4037070 con 0x7f74fc0b1020 2024-05-11T01:13:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.180+0000 7f74fa7fc640 1 -- 172.21.15.16:0/3143458805 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e4032440 con 0x7f74fc0b1020 2024-05-11T01:13:27.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.180+0000 7f74fa7fc640 1 -- 172.21.15.16:0/3143458805 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4032810 con 0x7f74fc0b1020 2024-05-11T01:13:27.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.181+0000 7f7501751640 1 -- 172.21.15.16:0/3143458805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc0b1020 msgr2=0x7f74fc0b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.181+0000 7f7501751640 1 --2- 172.21.15.16:0/3143458805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc0b1020 0x7f74fc0b14b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009870 tx=0x7f74e402a1e0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.181+0000 7f7501751640 1 -- 172.21.15.16:0/3143458805 shutdown_connections 2024-05-11T01:13:27.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.181+0000 7f7501751640 1 --2- 172.21.15.16:0/3143458805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc0b1020 0x7f74fc0b14b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.181+0000 7f7501751640 1 -- 172.21.15.16:0/3143458805 >> 172.21.15.16:0/3143458805 conn(0x7f74fc0d1fe0 msgr2=0x7f74fc0d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:27.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.181+0000 7f7501751640 1 -- 172.21.15.16:0/3143458805 shutdown_connections 2024-05-11T01:13:27.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.181+0000 7f7501751640 1 -- 172.21.15.16:0/3143458805 wait complete. 2024-05-11T01:13:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.182+0000 7f7501751640 1 Processor -- start 2024-05-11T01:13:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.182+0000 7f7501751640 1 -- start start 2024-05-11T01:13:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f7501751640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0b1020 0x7f74fc0cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f7501751640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0b5070 0x7f74fc1f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f7501751640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc15d170 0x7f74fc1614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f7501751640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc070800 con 0x7f74fc15d170 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f7501751640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc163ba0 con 0x7f74fc0b5070 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f7501751640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f74fc06c530 con 0x7f74fc0b1020 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc15d170 0x7f74fc1614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc15d170 0x7f74fc1614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42700/0 (socket says 172.21.15.16:42700) 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 -- 172.21.15.16:0/1867455805 learned_addr learned my addr 172.21.15.16:0/1867455805 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74faffd640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0b1020 0x7f74fc0cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74f27fc640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0b5070 0x7f74fc1f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 -- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0b1020 msgr2=0x7f74fc0cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0b1020 0x7f74fc0cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 -- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0b5070 msgr2=0x7f74fc1f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0b5070 0x7f74fc1f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 -- 172.21.15.16:0/1867455805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc1f99d0 con 0x7f74fc15d170 2024-05-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74f27fc640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0b5070 0x7f74fc1f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.183+0000 7f74fb7fe640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc15d170 0x7f74fc1614d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c730 tx=0x7f74f400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.184+0000 7f74f3fff640 1 -- 172.21.15.16:0/1867455805 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4003b70 con 0x7f74fc15d170 2024-05-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.184+0000 7f74f3fff640 1 -- 172.21.15.16:0/1867455805 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f4003d10 con 0x7f74fc15d170 2024-05-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.184+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc155810 con 0x7f74fc15d170 2024-05-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.184+0000 7f74f3fff640 1 -- 172.21.15.16:0/1867455805 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f400aa70 con 0x7f74fc15d170 2024-05-11T01:13:27.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.184+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc155dd0 con 0x7f74fc15d170 2024-05-11T01:13:27.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.185+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74fc06a5b0 con 0x7f74fc15d170 2024-05-11T01:13:27.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.185+0000 7f74f3fff640 1 -- 172.21.15.16:0/1867455805 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f74f400ac10 con 0x7f74fc15d170 2024-05-11T01:13:27.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.186+0000 7f74f3fff640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74dc0764d0 0x7f74dc078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.186+0000 7f74f3fff640 1 -- 172.21.15.16:0/1867455805 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f74f4097880 con 0x7f74fc15d170 2024-05-11T01:13:27.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.186+0000 7f74faffd640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74dc0764d0 0x7f74dc078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.187+0000 7f74faffd640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74dc0764d0 0x7f74dc078990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74ec000f60 tx=0x7f74ec007e40 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.190+0000 7f74f3fff640 1 -- 172.21.15.16:0/1867455805 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f74f4060e60 con 0x7f74fc15d170 2024-05-11T01:13:27.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.402+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74fc06d130 con 0x7f74dc0764d0 2024-05-11T01:13:27.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.410+0000 7f74f3fff640 1 -- 172.21.15.16:0/1867455805 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f74fc06d130 con 0x7f74dc0764d0 2024-05-11T01:13:27.409 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:27.409 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:07", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74dc0764d0 msgr2=0x7f74dc078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74dc0764d0 0x7f74dc078990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74ec000f60 tx=0x7f74ec007e40 comp rx=0 tx=0).stop 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc15d170 msgr2=0x7f74fc1614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc15d170 0x7f74fc1614d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c730 tx=0x7f74f400cbf0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 shutdown_connections 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f74dc0764d0 0x7f74dc078990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74fc15d170 0x7f74fc1614d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc0b5070 0x7f74fc1f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 --2- 172.21.15.16:0/1867455805 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74fc0b1020 0x7f74fc0cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 >> 172.21.15.16:0/1867455805 conn(0x7f74fc0d1fe0 msgr2=0x7f74fc157950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 shutdown_connections 2024-05-11T01:13:27.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.412+0000 7f7501751640 1 -- 172.21.15.16:0/1867455805 wait complete. 2024-05-11T01:13:27.422 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:07", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:27.422 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:07', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:27.422 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:27.422 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:27.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:27.423 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2024-05-11T01:13:27.440 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:27.440 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:27.440 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:27.440 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:27.440 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:27.440 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:27.440 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:27.441 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:27.441 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:27.441 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:27.441 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:27.441 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-05-11-01_03_00_UTC', 'scheduled-2024-05-11-01_04_00_UTC', 'scheduled-2024-05-11-01_05_00_UTC', 'scheduled-2024-05-11-01_06_00_UTC', 'scheduled-2024-05-11-01_07_00_UTC', 'scheduled-2024-05-11-01_08_00_UTC', 'scheduled-2024-05-11-01_09_00_UTC', 'scheduled-2024-05-11-01_10_00_UTC', 'scheduled-2024-05-11-01_11_00_UTC', 'scheduled-2024-05-11-01_12_00_UTC', 'scheduled-2024-05-11-01_13_00_UTC'] 2024-05-11T01:13:27.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir9 2024-05-11T01:13:27.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.589+0000 7f52ef833640 1 Processor -- start 2024-05-11T01:13:27.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.589+0000 7f52ef833640 1 -- start start 2024-05-11T01:13:27.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ef833640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52e81402d0 0x7f52e80b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ef833640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e80cd940 0x7f52e80cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ef833640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f52e8142a50 0x7f52e8142e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ef833640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f52e815db00 con 0x7f52e81402d0 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ef833640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f52e815dde0 con 0x7f52e8142a50 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ef833640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f52e815e0c0 con 0x7f52e80cd940 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ed5cf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52e81402d0 0x7f52e80b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ed5cf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52e81402d0 0x7f52e80b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42706/0 (socket says 172.21.15.16:42706) 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ed5cf640 1 -- 172.21.15.16:0/2730823730 learned_addr learned my addr 172.21.15.16:0/2730823730 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ecdce640 1 --2- 172.21.15.16:0/2730823730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e80cd940 0x7f52e80cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52eddd0640 1 --2- 172.21.15.16:0/2730823730 >> v2:172.21.15.174:3300/0 conn(0x7f52e8142a50 0x7f52e8142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ed5cf640 1 -- 172.21.15.16:0/2730823730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e80cd940 msgr2=0x7f52e80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:27.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ed5cf640 1 --2- 172.21.15.16:0/2730823730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e80cd940 0x7f52e80cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ed5cf640 1 -- 172.21.15.16:0/2730823730 >> v2:172.21.15.174:3300/0 conn(0x7f52e8142a50 msgr2=0x7f52e8142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:27.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ed5cf640 1 --2- 172.21.15.16:0/2730823730 >> v2:172.21.15.174:3300/0 conn(0x7f52e8142a50 0x7f52e8142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.590+0000 7f52ed5cf640 1 -- 172.21.15.16:0/2730823730 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e815e3a0 con 0x7f52e81402d0 2024-05-11T01:13:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.591+0000 7f52ed5cf640 1 --2- 172.21.15.16:0/2730823730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e80b3290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f52e80d1ef0 tx=0x7f52e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836b2805527672ca server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.591+0000 7f52dffff640 1 -- 172.21.15.16:0/2730823730 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4037070 con 0x7f52e81402d0 2024-05-11T01:13:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.591+0000 7f52dffff640 1 -- 172.21.15.16:0/2730823730 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e4032440 con 0x7f52e81402d0 2024-05-11T01:13:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.591+0000 7f52dffff640 1 -- 172.21.15.16:0/2730823730 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4032810 con 0x7f52e81402d0 2024-05-11T01:13:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 -- 172.21.15.16:0/2730823730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 msgr2=0x7f52e80b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 --2- 172.21.15.16:0/2730823730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e80b3290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f52e80d1ef0 tx=0x7f52e402a1e0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 -- 172.21.15.16:0/2730823730 shutdown_connections 2024-05-11T01:13:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 --2- 172.21.15.16:0/2730823730 >> v2:172.21.15.174:3300/0 conn(0x7f52e8142a50 0x7f52e8142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 --2- 172.21.15.16:0/2730823730 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e80cd940 0x7f52e80cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 --2- 172.21.15.16:0/2730823730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e80b3290 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 -- 172.21.15.16:0/2730823730 >> 172.21.15.16:0/2730823730 conn(0x7f52e806c3e0 msgr2=0x7f52e806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 -- 172.21.15.16:0/2730823730 shutdown_connections 2024-05-11T01:13:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.592+0000 7f52ef833640 1 -- 172.21.15.16:0/2730823730 wait complete. 2024-05-11T01:13:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.593+0000 7f52ef833640 1 Processor -- start 2024-05-11T01:13:27.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.593+0000 7f52ef833640 1 -- start start 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ef833640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e80cd940 0x7f52e81f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ef833640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e8073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ef833640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e8142a50 0x7f52e8073590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ef833640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f52e80b37d0 con 0x7f52e81402d0 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ef833640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f52e81406b0 con 0x7f52e80cd940 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ef833640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f52e80b2d40 con 0x7f52e8142a50 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ecdce640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e8073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ecdce640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e8073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42712/0 (socket says 172.21.15.16:42712) 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ecdce640 1 -- 172.21.15.16:0/2260943556 learned_addr learned my addr 172.21.15.16:0/2260943556 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:27.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ed5cf640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e80cd940 0x7f52e81f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52eddd0640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e8142a50 0x7f52e8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ecdce640 1 -- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e8142a50 msgr2=0x7f52e8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ecdce640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e8142a50 0x7f52e8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ecdce640 1 -- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e80cd940 msgr2=0x7f52e81f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ecdce640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e80cd940 0x7f52e81f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.594+0000 7f52ecdce640 1 -- 172.21.15.16:0/2260943556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e81f8730 con 0x7f52e81402d0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.595+0000 7f52ecdce640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e8073050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f52d800d5f0 tx=0x7f52d800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.595+0000 7f52ddffb640 1 -- 172.21.15.16:0/2260943556 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d80125f0 con 0x7f52e81402d0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.595+0000 7f52ddffb640 1 -- 172.21.15.16:0/2260943556 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d8019070 con 0x7f52e81402d0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.595+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e80d0a60 con 0x7f52e81402d0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.595+0000 7f52ddffb640 1 -- 172.21.15.16:0/2260943556 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d80129d0 con 0x7f52e81402d0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.595+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e80d1020 con 0x7f52e81402d0 2024-05-11T01:13:27.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.596+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e806a5b0 con 0x7f52e81402d0 2024-05-11T01:13:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.596+0000 7f52ddffb640 1 -- 172.21.15.16:0/2260943556 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f52d8012b70 con 0x7f52e81402d0 2024-05-11T01:13:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.597+0000 7f52ddffb640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52cc0764d0 0x7f52cc078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.597+0000 7f52ddffb640 1 -- 172.21.15.16:0/2260943556 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f52d8097ca0 con 0x7f52e81402d0 2024-05-11T01:13:27.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.598+0000 7f52ed5cf640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52cc0764d0 0x7f52cc078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.598+0000 7f52ed5cf640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52cc0764d0 0x7f52cc078990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52e4034000 tx=0x7f52e402e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.602+0000 7f52ddffb640 1 -- 172.21.15.16:0/2260943556 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f52d8060cc0 con 0x7f52e81402d0 2024-05-11T01:13:27.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.814+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52e8141f90 con 0x7f52cc0764d0 2024-05-11T01:13:27.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.822+0000 7f52ddffb640 1 -- 172.21.15.16:0/2260943556 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f52e8141f90 con 0x7f52cc0764d0 2024-05-11T01:13:27.822 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:27.822 INFO:teuthology.orchestra.run.smithi016.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:08", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52cc0764d0 msgr2=0x7f52cc078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52cc0764d0 0x7f52cc078990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52e4034000 tx=0x7f52e402e000 comp rx=0 tx=0).stop 2024-05-11T01:13:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 msgr2=0x7f52e8073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e8073050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f52d800d5f0 tx=0x7f52d800dab0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 shutdown_connections 2024-05-11T01:13:27.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f52cc0764d0 0x7f52cc078990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f52e8142a50 0x7f52e8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52e81402d0 0x7f52e8073050 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 --2- 172.21.15.16:0/2260943556 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52e80cd940 0x7f52e81f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 >> 172.21.15.16:0/2260943556 conn(0x7f52e806c3e0 msgr2=0x7f52e815cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 shutdown_connections 2024-05-11T01:13:27.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.825+0000 7f52ef833640 1 -- 172.21.15.16:0/2260943556 wait complete. 2024-05-11T01:13:27.835 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1m", "retention": {}, "start": "2024-05-11T00:00:00", "created": "2024-05-11T01:02:08", "first": "2024-05-11T01:03:00", "last": "2024-05-11T01:13:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-05-11T01:13:27.835 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1m', 'retention': {}, 'start': '2024-05-11T00:00:00', 'created': '2024-05-11T01:02:08', 'first': '2024-05-11T01:03:00', 'last': '2024-05-11T01:13:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-05-11T01:13:27.835 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-05-11T01:13:27.835 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-05-11T01:13:27.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir0 1m 2024-05-11T01:13:27.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.942+0000 7f00af70a640 1 Processor -- start 2024-05-11T01:13:27.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.942+0000 7f00af70a640 1 -- start start 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.943+0000 7f00af70a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f00a80b6eb0 0x7f00a80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.943+0000 7f00af70a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a80d1a50 con 0x7f00a815c3c0 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.943+0000 7f00af70a640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a80d1d30 con 0x7f00a80d12e0 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.943+0000 7f00af70a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f00a80708e0 con 0x7f00a80b6eb0 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.943+0000 7f00acca5640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f00a80b6eb0 0x7f00a80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.944+0000 7f00ad4a6640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f00a815c3c0 0x7f00a80b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52642/0 (socket says 172.21.15.16:52642) 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.944+0000 7f00ad4a6640 1 -- 172.21.15.16:0/2880519102 learned_addr learned my addr 172.21.15.16:0/2880519102 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.944+0000 7f00acca5640 1 -- 172.21.15.16:0/2880519102 >> v1:172.21.15.174:6789/0 conn(0x7f00a80d12e0 legacy=0x7f00a8073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:27.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.944+0000 7f00acca5640 1 -- 172.21.15.16:0/2880519102 >> v1:172.21.15.16:6789/0 conn(0x7f00a815c3c0 legacy=0x7f00a80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.944+0000 7f00acca5640 1 -- 172.21.15.16:0/2880519102 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a8070b30 con 0x7f00a80b6eb0 2024-05-11T01:13:27.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.944+0000 7f00a7fff640 1 -- 172.21.15.16:0/2880519102 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486828478 0 0) 0x7f00a80d1a50 con 0x7f00a815c3c0 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00acca5640 1 --2- 172.21.15.16:0/2880519102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a80b5b80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f009c0097a0 tx=0x7f009c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237ce9fe2dd9451f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00a7fff640 1 -- 172.21.15.16:0/2880519102 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c037070 con 0x7f00a80b6eb0 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00a7fff640 1 -- 172.21.15.16:0/2880519102 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009c02ae50 con 0x7f00a80b6eb0 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00a7fff640 1 -- 172.21.15.16:0/2880519102 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c032660 con 0x7f00a80b6eb0 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00af70a640 1 -- 172.21.15.16:0/2880519102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 msgr2=0x7f00a80b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00af70a640 1 --2- 172.21.15.16:0/2880519102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a80b5b80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f009c0097a0 tx=0x7f009c02a100 comp rx=0 tx=0).stop 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00af70a640 1 -- 172.21.15.16:0/2880519102 shutdown_connections 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00af70a640 1 --2- 172.21.15.16:0/2880519102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a80b5b80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00af70a640 1 -- 172.21.15.16:0/2880519102 >> 172.21.15.16:0/2880519102 conn(0x7f00a80d20b0 msgr2=0x7f00a80d2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:27.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00af70a640 1 -- 172.21.15.16:0/2880519102 shutdown_connections 2024-05-11T01:13:27.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.945+0000 7f00af70a640 1 -- 172.21.15.16:0/2880519102 wait complete. 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.947+0000 7f00af70a640 1 Processor -- start 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.947+0000 7f00af70a640 1 -- start start 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.947+0000 7f00af70a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.947+0000 7f00af70a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00a80d12e0 0x7f00a8146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.947+0000 7f00af70a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00a815c3c0 0x7f00a8071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.947+0000 7f00af70a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8073d00 con 0x7f00a80b6eb0 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.947+0000 7f00af70a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8073b80 con 0x7f00a815c3c0 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.947+0000 7f00af70a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f00a8073e80 con 0x7f00a80d12e0 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a814fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42740/0 (socket says 172.21.15.16:42740) 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 -- 172.21.15.16:0/3911808865 learned_addr learned my addr 172.21.15.16:0/3911808865 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00acca5640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00a80d12e0 0x7f00a8146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00adca7640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00a815c3c0 0x7f00a8071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 -- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00a80d12e0 msgr2=0x7f00a8146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00a80d12e0 0x7f00a8146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 -- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00a815c3c0 msgr2=0x7f00a8071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00a815c3c0 0x7f00a8071330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 -- 172.21.15.16:0/3911808865 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a8157a20 con 0x7f00a80b6eb0 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00adca7640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00a815c3c0 0x7f00a8071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00ad4a6640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a814fec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f00a000c3e0 tx=0x7f00a000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00a5ffb640 1 -- 172.21.15.16:0/3911808865 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a00074e0 con 0x7f00a80b6eb0 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00a5ffb640 1 -- 172.21.15.16:0/3911808865 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a00047e0 con 0x7f00a80b6eb0 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a8157d00 con 0x7f00a80b6eb0 2024-05-11T01:13:27.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.948+0000 7f00a5ffb640 1 -- 172.21.15.16:0/3911808865 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0004bd0 con 0x7f00a80b6eb0 2024-05-11T01:13:27.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.949+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a81582c0 con 0x7f00a80b6eb0 2024-05-11T01:13:27.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.950+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00a806a5b0 con 0x7f00a80b6eb0 2024-05-11T01:13:27.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.950+0000 7f00a5ffb640 1 -- 172.21.15.16:0/3911808865 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f00a0011070 con 0x7f00a80b6eb0 2024-05-11T01:13:27.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.951+0000 7f00a5ffb640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f00940764d0 0x7f0094078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:27.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.951+0000 7f00a5ffb640 1 -- 172.21.15.16:0/3911808865 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f00a0097690 con 0x7f00a80b6eb0 2024-05-11T01:13:27.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.951+0000 7f00acca5640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f00940764d0 0x7f0094078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:27.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.951+0000 7f00acca5640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f00940764d0 0x7f0094078990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f009c034000 tx=0x7f009c02e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:27.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:27.955+0000 7f00a5ffb640 1 -- 172.21.15.16:0/3911808865 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f00a0060c70 con 0x7f00a80b6eb0 2024-05-11T01:13:28.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.169+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f00a8151700 con 0x7f00940764d0 2024-05-11T01:13:28.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.253+0000 7f00a5ffb640 1 -- 172.21.15.16:0/3911808865 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f00a8151700 con 0x7f00940764d0 2024-05-11T01:13:28.252 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir0 2024-05-11T01:13:28.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f00940764d0 msgr2=0x7f0094078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:28.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f00940764d0 0x7f0094078990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f009c034000 tx=0x7f009c02e000 comp rx=0 tx=0).stop 2024-05-11T01:13:28.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 msgr2=0x7f00a814fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:28.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a814fec0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f00a000c3e0 tx=0x7f00a000c8a0 comp rx=0 tx=0).stop 2024-05-11T01:13:28.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 shutdown_connections 2024-05-11T01:13:28.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f00940764d0 0x7f0094078990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:28.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f00a815c3c0 0x7f00a8071330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:28.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f00a80d12e0 0x7f00a8146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:28.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 --2- 172.21.15.16:0/3911808865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00a80b6eb0 0x7f00a814fec0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:28.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.255+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 >> 172.21.15.16:0/3911808865 conn(0x7f00a80d20b0 msgr2=0x7f00a80b4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:28.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.256+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 shutdown_connections 2024-05-11T01:13:28.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:28.256+0000 7f00af70a640 1 -- 172.21.15.16:0/3911808865 wait complete. 2024-05-11T01:13:28.266 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2024-05-11T01:13:28.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.266 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2024-05-11T01:13:28.283 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:28.283 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:28.283 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:28.284 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:28.284 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:28.284 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:28.284 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:28.284 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:28.284 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:28.284 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:28.285 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:28.285 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:28.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.285 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:28.345 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:28.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.345 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:28.407 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:28.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.407 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:28.470 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:28.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.470 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:28.532 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:28.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.533 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:28.596 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:28.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.596 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:28.658 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:28.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.658 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:28.719 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:28.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.720 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:28.782 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:28.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.782 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:28.843 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:28.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.843 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:28.905 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:28.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.906 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:28.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:28.968 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2024-05-11T01:13:29.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir1 1m 2024-05-11T01:13:29.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.174+0000 7f3fe842a640 1 Processor -- start 2024-05-11T01:13:29.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.174+0000 7f3fe842a640 1 -- start start 2024-05-11T01:13:29.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe842a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe00b3300 0x7f3fe0160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe842a640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3fe00b3f60 0x7f3fe00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe842a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe0073ca0 con 0x7f3fe0145ba0 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe842a640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe00b4910 con 0x7f3fe00b3f60 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe842a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe00b4e20 con 0x7f3fe00b3300 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe61c6640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3fe0145ba0 0x7f3fe00b2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52646/0 (socket says 172.21.15.16:52646) 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe61c6640 1 -- 172.21.15.16:0/2312274827 learned_addr learned my addr 172.21.15.16:0/2312274827 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe59c5640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe00b3300 0x7f3fe0160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe69c7640 1 --2- 172.21.15.16:0/2312274827 >> v2:172.21.15.174:3300/0 conn(0x7f3fe00b3f60 0x7f3fe00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574329034 0 0) 0x7f3fdc001110 con 0x7f3fe0145ba0 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fcc003520 con 0x7f3fe0145ba0 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 636384120 0 0) 0x7f3fcc003520 con 0x7f3fe0145ba0 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe00b3300 msgr2=0x7f3fe0160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:29.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe00b3300 0x7f3fe0160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 >> v2:172.21.15.174:3300/0 conn(0x7f3fe00b3f60 msgr2=0x7f3fe00b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 --2- 172.21.15.16:0/2312274827 >> v2:172.21.15.174:3300/0 conn(0x7f3fe00b3f60 0x7f3fe00b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe00b4b40 con 0x7f3fe0145ba0 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f3fdc0018c0 con 0x7f3fe0145ba0 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe69c7640 1 --2- 172.21.15.16:0/2312274827 >> v2:172.21.15.174:3300/0 conn(0x7f3fe00b3f60 0x7f3fe00b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.175+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 >> v1:172.21.15.16:6789/0 conn(0x7f3fe0145ba0 legacy=0x7f3fe00b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe51c4640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fcc003a00 0x7f3fcc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe51c4640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fcc004800 0x7f3fcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe51c4640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc0051c0 0x7f3fcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe00b4e20 con 0x7f3fcc003a00 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc00bf60 con 0x7f3fcc0051c0 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fcc00c160 con 0x7f3fcc004800 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe59c5640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe00b3300 0x7f3fe0160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:29.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe61c6640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fcc003a00 0x7f3fcc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe69c7640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc0051c0 0x7f3fcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe59c5640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fcc004800 0x7f3fcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe61c6640 1 -- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fcc004800 msgr2=0x7f3fcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe61c6640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fcc004800 0x7f3fcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe61c6640 1 -- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc0051c0 msgr2=0x7f3fcc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe61c6640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc0051c0 0x7f3fcc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.176+0000 7f3fe61c6640 1 -- 172.21.15.16:0/2312274827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc003520 con 0x7f3fcc003a00 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe61c6640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fcc003a00 0x7f3fcc003e20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c3e0 tx=0x7f3fcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786835bd21a14508 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc00c0e0 con 0x7f3fcc003a00 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc034070 con 0x7f3fcc003a00 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe51c4640 1 -- 172.21.15.16:0/2312274827 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc005d30 con 0x7f3fcc003a00 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe842a640 1 -- 172.21.15.16:0/2312274827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fcc003a00 msgr2=0x7f3fcc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:29.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe842a640 1 --2- 172.21.15.16:0/2312274827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fcc003a00 0x7f3fcc003e20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c3e0 tx=0x7f3fcc005830 comp rx=0 tx=0).stop 2024-05-11T01:13:29.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe69c7640 1 -- 172.21.15.16:0/2312274827 reap_dead start 2024-05-11T01:13:29.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe842a640 1 -- 172.21.15.16:0/2312274827 shutdown_connections 2024-05-11T01:13:29.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe842a640 1 -- 172.21.15.16:0/2312274827 >> 172.21.15.16:0/2312274827 conn(0x7f3fe006c3e0 msgr2=0x7f3fe006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:29.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe842a640 1 -- 172.21.15.16:0/2312274827 shutdown_connections 2024-05-11T01:13:29.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.177+0000 7f3fe842a640 1 -- 172.21.15.16:0/2312274827 wait complete. 2024-05-11T01:13:29.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.179+0000 7f3fe842a640 1 Processor -- start 2024-05-11T01:13:29.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.179+0000 7f3fe842a640 1 -- start start 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.179+0000 7f3fe842a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc003a00 0x7f3fe00b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.179+0000 7f3fe842a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe015bcf0 0x7f3fe0139160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.179+0000 7f3fe842a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe015c170 0x7f3fe01396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.179+0000 7f3fe842a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0160400 con 0x7f3fe015c170 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.179+0000 7f3fe842a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe0160120 con 0x7f3fcc003a00 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.179+0000 7f3fe842a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe0160920 con 0x7f3fe015bcf0 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe015c170 0x7f3fe01396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe015c170 0x7f3fe01396a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42758/0 (socket says 172.21.15.16:42758) 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 -- 172.21.15.16:0/841778697 learned_addr learned my addr 172.21.15.16:0/841778697 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe59c5640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe015bcf0 0x7f3fe0139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe61c6640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc003a00 0x7f3fe00b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 -- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe015bcf0 msgr2=0x7f3fe0139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe015bcf0 0x7f3fe0139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 -- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc003a00 msgr2=0x7f3fe00b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc003a00 0x7f3fe00b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 -- 172.21.15.16:0/841778697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe00b1c60 con 0x7f3fe015c170 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe61c6640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc003a00 0x7f3fe00b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe69c7640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe015c170 0x7f3fe01396a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3fe015fd00 tx=0x7f3fd800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/841778697 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800fd90 con 0x7f3fe015c170 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/841778697 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd8003990 con 0x7f3fe015c170 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe0165e10 con 0x7f3fe015c170 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/841778697 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8003d80 con 0x7f3fe015c170 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.180+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe00b21e0 con 0x7f3fe015c170 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.181+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe006a5b0 con 0x7f3fe015c170 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.182+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/841778697 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f3fd801f030 con 0x7f3fe015c170 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.182+0000 7f3fd6ffd640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3fc40764d0 0x7f3fc4078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:29.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.182+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/841778697 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5967+0+0 (secure 0 0 0) 0x7f3fd80981e0 con 0x7f3fe015c170 2024-05-11T01:13:29.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.183+0000 7f3fe61c6640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3fc40764d0 0x7f3fc4078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:29.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.183+0000 7f3fe61c6640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3fc40764d0 0x7f3fc4078990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c3b0 tx=0x7f3fdc009030 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:29.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.187+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/841778697 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3fd8026020 con 0x7f3fe015c170 2024-05-11T01:13:29.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.405+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f3fe0073490 con 0x7f3fc40764d0 2024-05-11T01:13:29.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.512+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/841778697 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f3fe0073490 con 0x7f3fc40764d0 2024-05-11T01:13:29.511 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir1 2024-05-11T01:13:29.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3fc40764d0 msgr2=0x7f3fc4078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3fc40764d0 0x7f3fc4078990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c3b0 tx=0x7f3fdc009030 comp rx=0 tx=0).stop 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe015c170 msgr2=0x7f3fe01396a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe015c170 0x7f3fe01396a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3fe015fd00 tx=0x7f3fd800f580 comp rx=0 tx=0).stop 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 shutdown_connections 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3fc40764d0 0x7f3fc4078990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe015c170 0x7f3fe01396a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3fe015bcf0 0x7f3fe0139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 --2- 172.21.15.16:0/841778697 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3fcc003a00 0x7f3fe00b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 >> 172.21.15.16:0/841778697 conn(0x7f3fe006c3e0 msgr2=0x7f3fe0072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 shutdown_connections 2024-05-11T01:13:29.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:29.515+0000 7f3fe842a640 1 -- 172.21.15.16:0/841778697 wait complete. 2024-05-11T01:13:29.525 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2024-05-11T01:13:29.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.526 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2024-05-11T01:13:29.542 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:29.542 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:29.542 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_01_UTC 2024-05-11T01:13:29.543 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:29.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.543 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:29.609 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:29.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.609 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:29.670 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:29.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.670 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:29.732 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:29.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.732 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:29.801 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:29.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.801 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:29.863 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:29.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.863 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:29.924 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:29.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.924 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:29.987 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:29.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:29.987 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:30.049 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:30.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.049 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:30.110 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:30.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.110 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:30.173 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_13_01_UTC 2024-05-11T01:13:30.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.174 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-05-11-01_13_01_UTC) 2024-05-11T01:13:30.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.236 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2024-05-11T01:13:30.295 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir2 1m 2024-05-11T01:13:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.443+0000 7f5abfcb4640 1 Processor -- start 2024-05-11T01:13:30.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.443+0000 7f5abfcb4640 1 -- start start 2024-05-11T01:13:30.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abfcb4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ab80cd940 0x7f5ab80cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abfcb4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab815db00 con 0x7f5ab81402d0 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abfcb4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab815dde0 con 0x7f5ab8140b00 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abfcb4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab815e0c0 con 0x7f5ab80cd940 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abd24f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ab80cd940 0x7f5ab80cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abda50640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5ab81402d0 0x7f5ab80b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52652/0 (socket says 172.21.15.16:52652) 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abda50640 1 -- 172.21.15.16:0/2025401388 learned_addr learned my addr 172.21.15.16:0/2025401388 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abd24f640 1 -- 172.21.15.16:0/2025401388 >> v1:172.21.15.174:6789/0 conn(0x7f5ab8140b00 legacy=0x7f5ab8140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.444+0000 7f5abd24f640 1 -- 172.21.15.16:0/2025401388 >> v1:172.21.15.16:6789/0 conn(0x7f5ab81402d0 legacy=0x7f5ab80b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.445+0000 7f5abd24f640 1 -- 172.21.15.16:0/2025401388 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab815e3a0 con 0x7f5ab80cd940 2024-05-11T01:13:30.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.445+0000 7f5abca4e640 1 -- 172.21.15.16:0/2025401388 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103759248 0 0) 0x7f5ab815db00 con 0x7f5ab81402d0 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.445+0000 7f5abd24f640 1 --2- 172.21.15.16:0/2025401388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab80cd940 0x7f5ab80cddd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0097a0 tx=0x7f5aac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8aa4aede59e6ef server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.445+0000 7f5abca4e640 1 -- 172.21.15.16:0/2025401388 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac037070 con 0x7f5ab80cd940 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.445+0000 7f5abca4e640 1 -- 172.21.15.16:0/2025401388 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aac032440 con 0x7f5ab80cd940 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.445+0000 7f5abca4e640 1 -- 172.21.15.16:0/2025401388 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac032810 con 0x7f5ab80cd940 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.446+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2025401388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab80cd940 msgr2=0x7f5ab80cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.446+0000 7f5abfcb4640 1 --2- 172.21.15.16:0/2025401388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab80cd940 0x7f5ab80cddd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0097a0 tx=0x7f5aac02a180 comp rx=0 tx=0).stop 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.446+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2025401388 shutdown_connections 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.446+0000 7f5abfcb4640 1 --2- 172.21.15.16:0/2025401388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab80cd940 0x7f5ab80cddd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:30.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.446+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2025401388 >> 172.21.15.16:0/2025401388 conn(0x7f5ab806c3e0 msgr2=0x7f5ab806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:30.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.446+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2025401388 shutdown_connections 2024-05-11T01:13:30.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.446+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2025401388 wait complete. 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.447+0000 7f5abfcb4640 1 Processor -- start 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.447+0000 7f5abfcb4640 1 -- start start 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abfcb4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ab80cd940 0x7f5ab81542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abfcb4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab81402d0 0x7f5ab815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abfcb4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ab8140b00 0x7f5ab815c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abfcb4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab80b2d40 con 0x7f5ab81402d0 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abfcb4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab81406b0 con 0x7f5ab80cd940 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abfcb4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab80b2ec0 con 0x7f5ab8140b00 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abd24f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab81402d0 0x7f5ab815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:30.449 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abd24f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab81402d0 0x7f5ab815c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42764/0 (socket says 172.21.15.16:42764) 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abd24f640 1 -- 172.21.15.16:0/2738242356 learned_addr learned my addr 172.21.15.16:0/2738242356 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abda50640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ab80cd940 0x7f5ab81542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.448+0000 7f5abe251640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ab8140b00 0x7f5ab815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abd24f640 1 -- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ab8140b00 msgr2=0x7f5ab815c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abd24f640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ab8140b00 0x7f5ab815c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abd24f640 1 -- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ab80cd940 msgr2=0x7f5ab81542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abd24f640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ab80cd940 0x7f5ab81542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abd24f640 1 -- 172.21.15.16:0/2738242356 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab8132710 con 0x7f5ab81402d0 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abda50640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ab80cd940 0x7f5ab81542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abe251640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ab8140b00 0x7f5ab815c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abd24f640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab81402d0 0x7f5ab815c3c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0097a0 tx=0x7f5aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5ab67fc640 1 -- 172.21.15.16:0/2738242356 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac037040 con 0x7f5ab81402d0 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5ab67fc640 1 -- 172.21.15.16:0/2738242356 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aac004250 con 0x7f5ab81402d0 2024-05-11T01:13:30.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5ab67fc640 1 -- 172.21.15.16:0/2738242356 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac032e20 con 0x7f5ab81402d0 2024-05-11T01:13:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab81574d0 con 0x7f5ab81402d0 2024-05-11T01:13:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.449+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab81577b0 con 0x7f5ab81402d0 2024-05-11T01:13:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.450+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab8135080 con 0x7f5ab81402d0 2024-05-11T01:13:30.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.451+0000 7f5ab67fc640 1 -- 172.21.15.16:0/2738242356 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f5aac030770 con 0x7f5ab81402d0 2024-05-11T01:13:30.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.451+0000 7f5ab67fc640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5aa40764d0 0x7f5aa4078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:30.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.451+0000 7f5ab67fc640 1 -- 172.21.15.16:0/2738242356 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6311+0+0 (secure 0 0 0) 0x7f5aac0b8df0 con 0x7f5ab81402d0 2024-05-11T01:13:30.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.452+0000 7f5abda50640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5aa40764d0 0x7f5aa4078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:30.452 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.452+0000 7f5abda50640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5aa40764d0 0x7f5aa4078990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80012e0 tx=0x7f5aa8007f30 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:30.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.456+0000 7f5ab67fc640 1 -- 172.21.15.16:0/2738242356 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5aac0822e0 con 0x7f5ab81402d0 2024-05-11T01:13:30.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.676+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5ab806a5b0 con 0x7f5aa40764d0 2024-05-11T01:13:30.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.759+0000 7f5ab67fc640 1 -- 172.21.15.16:0/2738242356 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f5ab806a5b0 con 0x7f5aa40764d0 2024-05-11T01:13:30.759 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir2 2024-05-11T01:13:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5aa40764d0 msgr2=0x7f5aa4078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5aa40764d0 0x7f5aa4078990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80012e0 tx=0x7f5aa8007f30 comp rx=0 tx=0).stop 2024-05-11T01:13:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab81402d0 msgr2=0x7f5ab815c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:30.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab81402d0 0x7f5ab815c3c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0097a0 tx=0x7f5aac0046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:30.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 shutdown_connections 2024-05-11T01:13:30.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f5aa40764d0 0x7f5aa4078990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:30.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f5ab8140b00 0x7f5ab815c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:30.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab81402d0 0x7f5ab815c3c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:30.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 --2- 172.21.15.16:0/2738242356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ab80cd940 0x7f5ab81542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:30.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 >> 172.21.15.16:0/2738242356 conn(0x7f5ab806c3e0 msgr2=0x7f5ab8160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:30.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 shutdown_connections 2024-05-11T01:13:30.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:30.762+0000 7f5abfcb4640 1 -- 172.21.15.16:0/2738242356 wait complete. 2024-05-11T01:13:30.771 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2024-05-11T01:13:30.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.772 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2024-05-11T01:13:30.789 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:30.789 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:30.789 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:30.789 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:30.790 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:30.790 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:30.790 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:30.790 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:30.790 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:30.790 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:30.790 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:30.790 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:30.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.790 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:30.852 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:30.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.852 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:30.914 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:30.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.914 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:30.977 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:30.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:30.977 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:31.039 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:31.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:31.039 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:31.100 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:31.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:31.101 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:31.162 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:31.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:31.163 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:31.224 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:31.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:31.225 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:31.286 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:31.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:31.286 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:31.348 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:31.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:31.348 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:31.409 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:31.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:31.410 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:31.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:31.471 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2024-05-11T01:13:31.532 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir3 1m 2024-05-11T01:13:31.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.711+0000 7ff215d5f640 1 Processor -- start 2024-05-11T01:13:31.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.711+0000 7ff215d5f640 1 -- start start 2024-05-11T01:13:31.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.712+0000 7ff215d5f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21015f680 0x7ff2100d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:31.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.712+0000 7ff215d5f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff2100d0e40 0x7ff2100b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:31.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.712+0000 7ff215d5f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21006d600 con 0x7ff2100b5230 2024-05-11T01:13:31.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.712+0000 7ff215d5f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff2100b5680 con 0x7ff2100d0e40 2024-05-11T01:13:31.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.712+0000 7ff215d5f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff2100ce7f0 con 0x7ff21015f680 2024-05-11T01:13:31.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.712+0000 7ff20effd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff2100d0e40 0x7ff2100b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:31.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.712+0000 7ff20ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff2100b5230 0x7ff210163340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:52658/0 (socket says 172.21.15.16:52658) 2024-05-11T01:13:31.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.712+0000 7ff20ffff640 1 -- 172.21.15.16:0/146005965 learned_addr learned my addr 172.21.15.16:0/146005965 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:31.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.713+0000 7ff20f7fe640 1 --2- 172.21.15.16:0/146005965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21015f680 0x7ff2100d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:31.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.713+0000 7ff20effd640 1 -- 172.21.15.16:0/146005965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21015f680 msgr2=0x7ff2100d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:31.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.713+0000 7ff20effd640 1 --2- 172.21.15.16:0/146005965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21015f680 0x7ff2100d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:31.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.713+0000 7ff20effd640 1 -- 172.21.15.16:0/146005965 >> v1:172.21.15.16:6789/0 conn(0x7ff2100b5230 legacy=0x7ff210163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:31.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.713+0000 7ff20effd640 1 -- 172.21.15.16:0/146005965 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21006d8e0 con 0x7ff2100d0e40 2024-05-11T01:13:31.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.713+0000 7ff20e7fc640 1 -- 172.21.15.16:0/146005965 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327979293 0 0) 0x7ff21006d600 con 0x7ff2100b5230 2024-05-11T01:13:31.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.713+0000 7ff20effd640 1 --2- 172.21.15.16:0/146005965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100d0e40 0x7ff2100b4cf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097a0 tx=0x7ff20402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d5e67126c3344b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:31.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff20e7fc640 1 -- 172.21.15.16:0/146005965 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204037070 con 0x7ff2100d0e40 2024-05-11T01:13:31.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff20e7fc640 1 -- 172.21.15.16:0/146005965 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff204032440 con 0x7ff2100d0e40 2024-05-11T01:13:31.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff20e7fc640 1 -- 172.21.15.16:0/146005965 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204032810 con 0x7ff2100d0e40 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff215d5f640 1 -- 172.21.15.16:0/146005965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100d0e40 msgr2=0x7ff2100b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff215d5f640 1 --2- 172.21.15.16:0/146005965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100d0e40 0x7ff2100b4cf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff2040097a0 tx=0x7ff20402a180 comp rx=0 tx=0).stop 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff215d5f640 1 -- 172.21.15.16:0/146005965 shutdown_connections 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff215d5f640 1 --2- 172.21.15.16:0/146005965 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100d0e40 0x7ff2100b4cf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff215d5f640 1 --2- 172.21.15.16:0/146005965 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff21015f680 0x7ff2100d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff215d5f640 1 -- 172.21.15.16:0/146005965 >> 172.21.15.16:0/146005965 conn(0x7ff2100681c0 msgr2=0x7ff2100685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff215d5f640 1 -- 172.21.15.16:0/146005965 shutdown_connections 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.714+0000 7ff215d5f640 1 -- 172.21.15.16:0/146005965 wait complete. 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.715+0000 7ff215d5f640 1 Processor -- start 2024-05-11T01:13:31.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff215d5f640 1 -- start start 2024-05-11T01:13:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff215d5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100b5230 0x7ff210161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff215d5f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2100d0e40 0x7ff2101635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff215d5f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff21015f680 0x7ff2100b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff215d5f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff21006e180 con 0x7ff2100b5230 2024-05-11T01:13:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff215d5f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff21006dea0 con 0x7ff21015f680 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff215d5f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff2100d3e50 con 0x7ff2100d0e40 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff20f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100b5230 0x7ff210161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff20f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100b5230 0x7ff210161860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42780/0 (socket says 172.21.15.16:42780) 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff20f7fe640 1 -- 172.21.15.16:0/1010641081 learned_addr learned my addr 172.21.15.16:0/1010641081 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.716+0000 7ff20effd640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2100d0e40 0x7ff2101635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff20ffff640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff21015f680 0x7ff2100b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff20f7fe640 1 -- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2100d0e40 msgr2=0x7ff2101635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff20f7fe640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2100d0e40 0x7ff2101635f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff20f7fe640 1 -- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff21015f680 msgr2=0x7ff2100b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff20f7fe640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff21015f680 0x7ff2100b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff20f7fe640 1 -- 172.21.15.16:0/1010641081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21014e040 con 0x7ff2100b5230 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff20f7fe640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100b5230 0x7ff210161860 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff20000d5f0 tx=0x7ff20000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff1f7fff640 1 -- 172.21.15.16:0/1010641081 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2000125f0 con 0x7ff2100b5230 2024-05-11T01:13:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff1f7fff640 1 -- 172.21.15.16:0/1010641081 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff200019070 con 0x7ff2100b5230 2024-05-11T01:13:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21014e320 con 0x7ff2100b5230 2024-05-11T01:13:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff1f7fff640 1 -- 172.21.15.16:0/1010641081 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2000129d0 con 0x7ff2100b5230 2024-05-11T01:13:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.717+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff21014e8e0 con 0x7ff2100b5230 2024-05-11T01:13:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.718+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2100d3bf0 con 0x7ff2100b5230 2024-05-11T01:13:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.719+0000 7ff1f7fff640 1 -- 172.21.15.16:0/1010641081 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7ff200012b70 con 0x7ff2100b5230 2024-05-11T01:13:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.719+0000 7ff1f7fff640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff1fc0764d0 0x7ff1fc078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:31.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.719+0000 7ff1f7fff640 1 -- 172.21.15.16:0/1010641081 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6503+0+0 (secure 0 0 0) 0x7ff200097e70 con 0x7ff2100b5230 2024-05-11T01:13:31.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.720+0000 7ff20effd640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff1fc0764d0 0x7ff1fc078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:31.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.720+0000 7ff20effd640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff1fc0764d0 0x7ff1fc078990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff204034000 tx=0x7ff20402e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:31.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.724+0000 7ff1f7fff640 1 -- 172.21.15.16:0/1010641081 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff2100d3bf0 con 0x7ff2100b5230 2024-05-11T01:13:31.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:31.938+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7ff21014ddf0 con 0x7ff1fc0764d0 2024-05-11T01:13:32.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.015+0000 7ff1f7fff640 1 -- 172.21.15.16:0/1010641081 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7ff21014ddf0 con 0x7ff1fc0764d0 2024-05-11T01:13:32.015 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir3 2024-05-11T01:13:32.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.017+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff1fc0764d0 msgr2=0x7ff1fc078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:32.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.017+0000 7ff215d5f640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff1fc0764d0 0x7ff1fc078990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff204034000 tx=0x7ff20402e000 comp rx=0 tx=0).stop 2024-05-11T01:13:32.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.017+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100b5230 msgr2=0x7ff210161860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:32.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.017+0000 7ff215d5f640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100b5230 0x7ff210161860 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff20000d5f0 tx=0x7ff20000dab0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.018+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 shutdown_connections 2024-05-11T01:13:32.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.018+0000 7ff215d5f640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff1fc0764d0 0x7ff1fc078990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.018+0000 7ff215d5f640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff21015f680 0x7ff2100b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.018+0000 7ff215d5f640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2100d0e40 0x7ff2101635f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.018+0000 7ff215d5f640 1 --2- 172.21.15.16:0/1010641081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100b5230 0x7ff210161860 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.018+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 >> 172.21.15.16:0/1010641081 conn(0x7ff2100681c0 msgr2=0x7ff2100cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.018+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 shutdown_connections 2024-05-11T01:13:32.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.018+0000 7ff215d5f640 1 -- 172.21.15.16:0/1010641081 wait complete. 2024-05-11T01:13:32.027 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2024-05-11T01:13:32.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.028 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:32.045 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:32.046 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:32.046 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:32.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.046 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:32.107 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:32.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.108 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:32.170 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:32.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.171 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:32.233 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:32.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.233 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:32.295 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:32.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.295 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:32.357 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:32.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.357 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:32.420 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:32.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.420 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:32.486 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:32.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.486 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:32.553 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:32.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.553 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:32.626 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:32.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.626 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:32.688 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:32.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.688 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:32.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:32.762 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2024-05-11T01:13:32.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir4 1m 2024-05-11T01:13:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.968+0000 7f6cf2b46640 1 Processor -- start 2024-05-11T01:13:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.968+0000 7f6cf2b46640 1 -- start start 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf2b46640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6cec15d170 0x7f6cec06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf2b46640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 0x7f6cec0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf2b46640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cec15d550 con 0x7f6cec0733d0 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf2b46640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6cec0b19c0 con 0x7f6cec15d170 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf2b46640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6cec163f10 con 0x7f6cec0b1020 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf08e2640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6cec15d170 0x7f6cec06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf08e2640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6cec15d170 0x7f6cec06c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42582/0 (socket says 172.21.15.16:42582) 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf08e2640 1 -- 172.21.15.16:0/3722940089 learned_addr learned my addr 172.21.15.16:0/3722940089 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cebfff640 1 --2- 172.21.15.16:0/3722940089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 0x7f6cec0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.969+0000 7f6cf08e2640 1 -- 172.21.15.16:0/3722940089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 msgr2=0x7f6cec0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.970+0000 7f6cf08e2640 1 --2- 172.21.15.16:0/3722940089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 0x7f6cec0b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.970+0000 7f6cf08e2640 1 -- 172.21.15.16:0/3722940089 >> v1:172.21.15.16:6789/0 conn(0x7f6cec0733d0 legacy=0x7f6cec073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.970+0000 7f6cf08e2640 1 -- 172.21.15.16:0/3722940089 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec163300 con 0x7f6cec15d170 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.970+0000 7f6cf08e2640 1 --2- 172.21.15.16:0/3722940089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec06c9a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009870 tx=0x7f6ce402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d90be3e9d367a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.970+0000 7f6ceb7fe640 1 -- 172.21.15.16:0/3722940089 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4037070 con 0x7f6cec15d170 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.970+0000 7f6ceb7fe640 1 -- 172.21.15.16:0/3722940089 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce4032440 con 0x7f6cec15d170 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.970+0000 7f6ceb7fe640 1 -- 172.21.15.16:0/3722940089 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4032810 con 0x7f6cec15d170 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.971+0000 7f6cf2b46640 1 -- 172.21.15.16:0/3722940089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 msgr2=0x7f6cec06c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.971+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/3722940089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec06c9a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009870 tx=0x7f6ce402a130 comp rx=0 tx=0).stop 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.971+0000 7f6cf2b46640 1 -- 172.21.15.16:0/3722940089 shutdown_connections 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.971+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/3722940089 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 0x7f6cec0b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.971+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/3722940089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec06c9a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.971+0000 7f6cf2b46640 1 -- 172.21.15.16:0/3722940089 >> 172.21.15.16:0/3722940089 conn(0x7f6cec0d1fe0 msgr2=0x7f6cec0d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.971+0000 7f6cf2b46640 1 -- 172.21.15.16:0/3722940089 shutdown_connections 2024-05-11T01:13:32.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.971+0000 7f6cf2b46640 1 -- 172.21.15.16:0/3722940089 wait complete. 2024-05-11T01:13:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.972+0000 7f6cf2b46640 1 Processor -- start 2024-05-11T01:13:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.972+0000 7f6cf2b46640 1 -- start start 2024-05-11T01:13:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf2b46640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cec0733d0 0x7f6cec154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf2b46640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 0x7f6cec0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf2b46640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf2b46640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec163ba0 con 0x7f6cec15d170 2024-05-11T01:13:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf2b46640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6cec1638c0 con 0x7f6cec0733d0 2024-05-11T01:13:32.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf2b46640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6cec06cee0 con 0x7f6cec0b1020 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf10e3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf10e3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec0b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42592/0 (socket says 172.21.15.16:42592) 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.973+0000 7f6cf10e3640 1 -- 172.21.15.16:0/2946273531 learned_addr learned my addr 172.21.15.16:0/2946273531 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf08e2640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cec0733d0 0x7f6cec154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cebfff640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 0x7f6cec0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf10e3640 1 -- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 msgr2=0x7f6cec0b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf10e3640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 0x7f6cec0b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf10e3640 1 -- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cec0733d0 msgr2=0x7f6cec154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf10e3640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cec0733d0 0x7f6cec154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf10e3640 1 -- 172.21.15.16:0/2946273531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cec15da90 con 0x7f6cec15d170 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf10e3640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec0b2090 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00c700 tx=0x7f6cdc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6ce97fa640 1 -- 172.21.15.16:0/2946273531 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc003b70 con 0x7f6cec15d170 2024-05-11T01:13:32.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6ce97fa640 1 -- 172.21.15.16:0/2946273531 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc003d10 con 0x7f6cec15d170 2024-05-11T01:13:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6ce97fa640 1 -- 172.21.15.16:0/2946273531 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00aa70 con 0x7f6cec15d170 2024-05-11T01:13:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cec0afcf0 con 0x7f6cec15d170 2024-05-11T01:13:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.974+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cec15e010 con 0x7f6cec15d170 2024-05-11T01:13:32.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.975+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cec06a5b0 con 0x7f6cec15d170 2024-05-11T01:13:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.976+0000 7f6ce97fa640 1 -- 172.21.15.16:0/2946273531 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f6cdc00ac10 con 0x7f6cec15d170 2024-05-11T01:13:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.976+0000 7f6ce97fa640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6ccc0764d0 0x7f6ccc078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.977+0000 7f6ce97fa640 1 -- 172.21.15.16:0/2946273531 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6503+0+0 (secure 0 0 0) 0x7f6cdc097a10 con 0x7f6cec15d170 2024-05-11T01:13:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.977+0000 7f6cf08e2640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6ccc0764d0 0x7f6ccc078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:32.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.977+0000 7f6cf08e2640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6ccc0764d0 0x7f6ccc078990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4034000 tx=0x7f6ce402e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:32.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:32.981+0000 7f6ce97fa640 1 -- 172.21.15.16:0/2946273531 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6cdc060780 con 0x7f6cec15d170 2024-05-11T01:13:33.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.193+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f6cec0b17a0 con 0x7f6ccc0764d0 2024-05-11T01:13:33.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.320+0000 7f6ce97fa640 1 -- 172.21.15.16:0/2946273531 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f6cec0b17a0 con 0x7f6ccc0764d0 2024-05-11T01:13:33.320 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir4 2024-05-11T01:13:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.322+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6ccc0764d0 msgr2=0x7f6ccc078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6ccc0764d0 0x7f6ccc078990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4034000 tx=0x7f6ce402e000 comp rx=0 tx=0).stop 2024-05-11T01:13:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 msgr2=0x7f6cec0b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec0b2090 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00c700 tx=0x7f6cdc00cbc0 comp rx=0 tx=0).stop 2024-05-11T01:13:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 shutdown_connections 2024-05-11T01:13:33.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6ccc0764d0 0x7f6ccc078990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cec15d170 0x7f6cec0b2090 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cec0b1020 0x7f6cec0b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 --2- 172.21.15.16:0/2946273531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cec0733d0 0x7f6cec154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 >> 172.21.15.16:0/2946273531 conn(0x7f6cec0d1fe0 msgr2=0x7f6cec160d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 shutdown_connections 2024-05-11T01:13:33.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:33.323+0000 7f6cf2b46640 1 -- 172.21.15.16:0/2946273531 wait complete. 2024-05-11T01:13:33.333 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2024-05-11T01:13:33.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.333 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2024-05-11T01:13:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:33.350 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:33.351 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:33.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.351 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:33.414 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:33.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.415 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:33.477 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:33.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.478 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:33.550 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:33.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.550 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:33.619 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:33.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.619 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:33.681 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:33.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.681 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:33.742 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:33.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.743 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:33.806 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:33.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.806 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:33.868 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:33.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.868 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:33.931 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:33.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.931 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:33.992 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:33.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:33.992 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:34.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:34.053 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2024-05-11T01:13:34.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir5 1m 2024-05-11T01:13:34.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.261+0000 7f443e86d640 1 Processor -- start 2024-05-11T01:13:34.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.261+0000 7f443e86d640 1 -- start start 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f443e86d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4438163010 0x7f44380b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f443e86d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f44380b72c0 0x7f44380b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f443e86d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44381635d0 con 0x7f44380bae40 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f443e86d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f44380b76f0 con 0x7f44380b72c0 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f443e86d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f44381638b0 con 0x7f4438163010 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f4437fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f44380bae40 0x7f44381604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34828/0 (socket says 172.21.15.16:34828) 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f4437fff640 1 -- 172.21.15.16:0/1969287915 learned_addr learned my addr 172.21.15.16:0/1969287915 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f443ce0a640 1 --2- 172.21.15.16:0/1969287915 >> v2:172.21.15.174:3300/0 conn(0x7f44380b72c0 0x7f44380b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f44377fe640 1 --2- 172.21.15.16:0/1969287915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4438163010 0x7f44380b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:34.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f4436ffd640 1 -- 172.21.15.16:0/1969287915 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412815311 0 0) 0x7f44381635d0 con 0x7f44380bae40 2024-05-11T01:13:34.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.262+0000 7f4436ffd640 1 -- 172.21.15.16:0/1969287915 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4424003520 con 0x7f44380bae40 2024-05-11T01:13:34.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.263+0000 7f44377fe640 1 -- 172.21.15.16:0/1969287915 >> v2:172.21.15.174:3300/0 conn(0x7f44380b72c0 msgr2=0x7f44380b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:34.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.263+0000 7f4436ffd640 1 -- 172.21.15.16:0/1969287915 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1118807290 0 0) 0x7f4424003520 con 0x7f44380bae40 2024-05-11T01:13:34.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.263+0000 7f44377fe640 1 --2- 172.21.15.16:0/1969287915 >> v2:172.21.15.174:3300/0 conn(0x7f44380b72c0 0x7f44380b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.263+0000 7f44377fe640 1 -- 172.21.15.16:0/1969287915 >> v1:172.21.15.16:6789/0 conn(0x7f44380bae40 legacy=0x7f44381604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:34.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.263+0000 7f44377fe640 1 -- 172.21.15.16:0/1969287915 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4438163b90 con 0x7f4438163010 2024-05-11T01:13:34.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.263+0000 7f443ce0a640 1 --2- 172.21.15.16:0/1969287915 >> v2:172.21.15.174:3300/0 conn(0x7f44380b72c0 0x7f44380b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:34.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.263+0000 7f44377fe640 1 --2- 172.21.15.16:0/1969287915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4438163010 0x7f44380b6d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f44200097a0 tx=0x7f442002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc5bac7fdbf174d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f4436ffd640 1 -- 172.21.15.16:0/1969287915 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4420037070 con 0x7f4438163010 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f4436ffd640 1 -- 172.21.15.16:0/1969287915 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442002ab10 con 0x7f4438163010 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f4436ffd640 1 -- 172.21.15.16:0/1969287915 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44280016f0 con 0x7f4438163010 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f443e86d640 1 -- 172.21.15.16:0/1969287915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4438163010 msgr2=0x7f44380b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f443e86d640 1 --2- 172.21.15.16:0/1969287915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4438163010 0x7f44380b6d80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f44200097a0 tx=0x7f442002a080 comp rx=0 tx=0).stop 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f443e86d640 1 -- 172.21.15.16:0/1969287915 shutdown_connections 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f443e86d640 1 --2- 172.21.15.16:0/1969287915 >> v2:172.21.15.174:3300/0 conn(0x7f44380b72c0 0x7f44380b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f443e86d640 1 --2- 172.21.15.16:0/1969287915 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4438163010 0x7f44380b6d80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f443e86d640 1 -- 172.21.15.16:0/1969287915 >> 172.21.15.16:0/1969287915 conn(0x7f4438074140 msgr2=0x7f44380d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f443e86d640 1 -- 172.21.15.16:0/1969287915 shutdown_connections 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.264+0000 7f443e86d640 1 -- 172.21.15.16:0/1969287915 wait complete. 2024-05-11T01:13:34.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.265+0000 7f443e86d640 1 Processor -- start 2024-05-11T01:13:34.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.266+0000 7f443e86d640 1 -- start start 2024-05-11T01:13:34.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.266+0000 7f443e86d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44380b72c0 0x7f4438157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:34.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.266+0000 7f443e86d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44380bae40 0x7f44380b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:34.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.266+0000 7f443e86d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4438163010 0x7f44380b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:34.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.266+0000 7f443e86d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44380b42b0 con 0x7f44380b72c0 2024-05-11T01:13:34.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.266+0000 7f443e86d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f44380bb220 con 0x7f4438163010 2024-05-11T01:13:34.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.266+0000 7f443e86d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f44380b4430 con 0x7f44380bae40 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44380b72c0 0x7f4438157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44380b72c0 0x7f4438157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42608/0 (socket says 172.21.15.16:42608) 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 -- 172.21.15.16:0/3318762051 learned_addr learned my addr 172.21.15.16:0/3318762051 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f44377fe640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44380bae40 0x7f44380b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f443ce0a640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4438163010 0x7f44380b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 -- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44380bae40 msgr2=0x7f44380b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44380bae40 0x7f44380b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 -- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4438163010 msgr2=0x7f44380b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4438163010 0x7f44380b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 -- 172.21.15.16:0/3318762051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4438157a60 con 0x7f44380b72c0 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f443ce0a640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4438163010 0x7f44380b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4437fff640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44380b72c0 0x7f4438157520 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f442800c730 tx=0x7f442800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:34.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4434ff9640 1 -- 172.21.15.16:0/3318762051 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428017070 con 0x7f44380b72c0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4434ff9640 1 -- 172.21.15.16:0/3318762051 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4428005ad0 con 0x7f44380b72c0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44380cced0 con 0x7f44380b72c0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f4434ff9640 1 -- 172.21.15.16:0/3318762051 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428007070 con 0x7f44380b72c0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.267+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44380c8e90 con 0x7f44380b72c0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.268+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f443806a5b0 con 0x7f44380b72c0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.269+0000 7f4434ff9640 1 -- 172.21.15.16:0/3318762051 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f442801a070 con 0x7f44380b72c0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.269+0000 7f4434ff9640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f44180764d0 0x7f4418078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.270+0000 7f4434ff9640 1 -- 172.21.15.16:0/3318762051 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6551+0+0 (secure 0 0 0) 0x7f4428097180 con 0x7f44380b72c0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.270+0000 7f44377fe640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f44180764d0 0x7f4418078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:34.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.270+0000 7f44377fe640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f44180764d0 0x7f4418078990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4420034000 tx=0x7f442002e000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:34.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.274+0000 7f4434ff9640 1 -- 172.21.15.16:0/3318762051 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4428060520 con 0x7f44380b72c0 2024-05-11T01:13:34.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.490+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f44380ba270 con 0x7f44180764d0 2024-05-11T01:13:34.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.633+0000 7f4434ff9640 1 -- 172.21.15.16:0/3318762051 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f44380ba270 con 0x7f44180764d0 2024-05-11T01:13:34.633 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir5 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f44180764d0 msgr2=0x7f4418078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f44180764d0 0x7f4418078990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4420034000 tx=0x7f442002e000 comp rx=0 tx=0).stop 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44380b72c0 msgr2=0x7f4438157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44380b72c0 0x7f4438157520 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f442800c730 tx=0x7f442800cbf0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 shutdown_connections 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f44180764d0 0x7f4418078990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4438163010 0x7f44380b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f44380bae40 0x7f44380b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 --2- 172.21.15.16:0/3318762051 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f44380b72c0 0x7f4438157520 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:34.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 >> 172.21.15.16:0/3318762051 conn(0x7f4438074140 msgr2=0x7f44380d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:34.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 shutdown_connections 2024-05-11T01:13:34.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:34.635+0000 7f443e86d640 1 -- 172.21.15.16:0/3318762051 wait complete. 2024-05-11T01:13:34.645 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2024-05-11T01:13:34.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:34.645 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:34.664 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:34.665 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:34.665 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:34.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:34.665 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:34.725 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:34.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:34.725 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:34.786 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:34.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:34.786 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:34.847 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:34.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:34.848 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:34.909 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:34.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:34.910 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:34.971 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:34.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:34.971 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:35.032 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:35.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.032 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:35.095 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:35.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.095 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:35.166 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:35.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.166 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:35.227 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:35.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.227 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:35.289 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:35.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.289 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:35.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.351 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2024-05-11T01:13:35.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir6 1m 2024-05-11T01:13:35.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.564+0000 7fa0cba64640 1 Processor -- start 2024-05-11T01:13:35.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.564+0000 7fa0cba64640 1 -- start start 2024-05-11T01:13:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0cba64640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 0x7fa0c40d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0cba64640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa0c40bac80 0x7fa0c40d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0cba64640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0c40d00e0 0x7fa0c40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0cba64640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c415fa90 con 0x7fa0c40d00e0 2024-05-11T01:13:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0cba64640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c40d3750 con 0x7fa0c40bac80 2024-05-11T01:13:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0cba64640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c40d39f0 con 0x7fa0c415f6b0 2024-05-11T01:13:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0ca001640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0c40d00e0 0x7fa0c40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0c8fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa0c40bac80 0x7fa0c40d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0c9800640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 0x7fa0c40d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0c8fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa0c40bac80 0x7fa0c40d4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:39238/0 (socket says 172.21.15.16:39238) 2024-05-11T01:13:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0ca001640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0c40d00e0 0x7fa0c40d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42618/0 (socket says 172.21.15.16:42618) 2024-05-11T01:13:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0c8fff640 1 -- 172.21.15.16:0/3954492043 learned_addr learned my addr 172.21.15.16:0/3954492043 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0ca001640 1 -- 172.21.15.16:0/3954492043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 msgr2=0x7fa0c40d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0ca001640 1 --2- 172.21.15.16:0/3954492043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 0x7fa0c40d3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0ca001640 1 -- 172.21.15.16:0/3954492043 >> v2:172.21.15.174:3300/0 conn(0x7fa0c40bac80 msgr2=0x7fa0c40d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0ca001640 1 --2- 172.21.15.16:0/3954492043 >> v2:172.21.15.174:3300/0 conn(0x7fa0c40bac80 0x7fa0c40d4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0ca001640 1 -- 172.21.15.16:0/3954492043 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c40d3cd0 con 0x7fa0c40d00e0 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.565+0000 7fa0c8fff640 1 --2- 172.21.15.16:0/3954492043 >> v2:172.21.15.174:3300/0 conn(0x7fa0c40bac80 0x7fa0c40d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.566+0000 7fa0ca001640 1 --2- 172.21.15.16:0/3954492043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40d00e0 0x7fa0c40d0570 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40d63d0 tx=0x7fa0b402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c97c4f06dd1315 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.566+0000 7fa0c3fff640 1 -- 172.21.15.16:0/3954492043 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4037070 con 0x7fa0c40d00e0 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.566+0000 7fa0c3fff640 1 -- 172.21.15.16:0/3954492043 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4032440 con 0x7fa0c40d00e0 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.566+0000 7fa0c3fff640 1 -- 172.21.15.16:0/3954492043 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4032810 con 0x7fa0c40d00e0 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 -- 172.21.15.16:0/3954492043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40d00e0 msgr2=0x7fa0c40d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 --2- 172.21.15.16:0/3954492043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40d00e0 0x7fa0c40d0570 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40d63d0 tx=0x7fa0b402a1a0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 -- 172.21.15.16:0/3954492043 shutdown_connections 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 --2- 172.21.15.16:0/3954492043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40d00e0 0x7fa0c40d0570 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 --2- 172.21.15.16:0/3954492043 >> v2:172.21.15.174:3300/0 conn(0x7fa0c40bac80 0x7fa0c40d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 --2- 172.21.15.16:0/3954492043 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 0x7fa0c40d3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 -- 172.21.15.16:0/3954492043 >> 172.21.15.16:0/3954492043 conn(0x7fa0c4073f00 msgr2=0x7fa0c4074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:35.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 -- 172.21.15.16:0/3954492043 shutdown_connections 2024-05-11T01:13:35.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.567+0000 7fa0cba64640 1 -- 172.21.15.16:0/3954492043 wait complete. 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.569+0000 7fa0cba64640 1 Processor -- start 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.569+0000 7fa0cba64640 1 -- start start 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.569+0000 7fa0cba64640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40bac80 0x7fa0c40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.569+0000 7fa0cba64640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0c40d00e0 0x7fa0c40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.569+0000 7fa0cba64640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 0x7fa0c40b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.569+0000 7fa0cba64640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c40d4570 con 0x7fa0c40bac80 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.569+0000 7fa0cba64640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c40d4290 con 0x7fa0c40d00e0 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.569+0000 7fa0cba64640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c40d4fd0 con 0x7fa0c415f6b0 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40bac80 0x7fa0c40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40bac80 0x7fa0c40cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42630/0 (socket says 172.21.15.16:42630) 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 -- 172.21.15.16:0/1555440125 learned_addr learned my addr 172.21.15.16:0/1555440125 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0ca001640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 0x7fa0c40b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c8fff640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0c40d00e0 0x7fa0c40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 -- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 msgr2=0x7fa0c40b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 0x7fa0c40b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 -- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0c40d00e0 msgr2=0x7fa0c40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0c40d00e0 0x7fa0c40b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 -- 172.21.15.16:0/1555440125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c40b5720 con 0x7fa0c40bac80 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c9800640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40bac80 0x7fa0c40cdf50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00efc0 tx=0x7fa0bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c1ffb640 1 -- 172.21.15.16:0/1555440125 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc018020 con 0x7fa0c40bac80 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c1ffb640 1 -- 172.21.15.16:0/1555440125 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0bc014480 con 0x7fa0c40bac80 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c40b5a00 con 0x7fa0c40bac80 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.570+0000 7fa0c1ffb640 1 -- 172.21.15.16:0/1555440125 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc014850 con 0x7fa0c40bac80 2024-05-11T01:13:35.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.571+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c40b5fc0 con 0x7fa0c40bac80 2024-05-11T01:13:35.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.572+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c406a5b0 con 0x7fa0c40bac80 2024-05-11T01:13:35.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.572+0000 7fa0c1ffb640 1 -- 172.21.15.16:0/1555440125 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7fa0bc005d10 con 0x7fa0c40bac80 2024-05-11T01:13:35.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.573+0000 7fa0c1ffb640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa0b00764d0 0x7fa0b0078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:35.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.573+0000 7fa0c1ffb640 1 -- 172.21.15.16:0/1555440125 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6535+0+0 (secure 0 0 0) 0x7fa0bc098770 con 0x7fa0c40bac80 2024-05-11T01:13:35.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.573+0000 7fa0c8fff640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa0b00764d0 0x7fa0b0078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:35.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.575+0000 7fa0c8fff640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa0b00764d0 0x7fa0b0078990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40cf470 tx=0x7fa0b8008040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:35.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.579+0000 7fa0c1ffb640 1 -- 172.21.15.16:0/1555440125 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa0bc022070 con 0x7fa0c40bac80 2024-05-11T01:13:35.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.797+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa0c40cf6b0 con 0x7fa0b00764d0 2024-05-11T01:13:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.878+0000 7fa0c1ffb640 1 -- 172.21.15.16:0/1555440125 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fa0c40cf6b0 con 0x7fa0b00764d0 2024-05-11T01:13:35.877 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir6 2024-05-11T01:13:35.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa0b00764d0 msgr2=0x7fa0b0078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:35.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa0b00764d0 0x7fa0b0078990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40cf470 tx=0x7fa0b8008040 comp rx=0 tx=0).stop 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40bac80 msgr2=0x7fa0c40cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40bac80 0x7fa0c40cdf50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00efc0 tx=0x7fa0bc00c490 comp rx=0 tx=0).stop 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 shutdown_connections 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa0b00764d0 0x7fa0b0078990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa0c415f6b0 0x7fa0c40b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa0c40d00e0 0x7fa0c40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 --2- 172.21.15.16:0/1555440125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0c40bac80 0x7fa0c40cdf50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 >> 172.21.15.16:0/1555440125 conn(0x7fa0c4073f00 msgr2=0x7fa0c406de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 shutdown_connections 2024-05-11T01:13:35.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:35.880+0000 7fa0cba64640 1 -- 172.21.15.16:0/1555440125 wait complete. 2024-05-11T01:13:35.890 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2024-05-11T01:13:35.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.890 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2024-05-11T01:13:35.908 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:35.908 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:35.908 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:35.908 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:35.908 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:35.908 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:35.908 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:35.909 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:35.909 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:35.909 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:35.909 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:35.909 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:35.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.909 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:35.971 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:35.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:35.972 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:36.033 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:36.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.033 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:36.094 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:36.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.094 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:36.155 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:36.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.155 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:36.216 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:36.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.217 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:36.278 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:36.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.278 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:36.340 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:36.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.340 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:36.402 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:36.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.403 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:36.466 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:36.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.466 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:36.545 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:36.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.545 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:36.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:36.606 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2024-05-11T01:13:36.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir7 1m 2024-05-11T01:13:36.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.830+0000 7f7a0fb79640 1 Processor -- start 2024-05-11T01:13:36.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.830+0000 7f7a0fb79640 1 -- start start 2024-05-11T01:13:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0fb79640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a0815f6b0 0x7f7a080d3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0fb79640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a080d00e0 0x7f7a080d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0fb79640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a0815fa90 con 0x7f7a080bac80 2024-05-11T01:13:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0fb79640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7a080d3750 con 0x7f7a080d00e0 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0fb79640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7a080d39f0 con 0x7f7a0815f6b0 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0e116640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a080d00e0 0x7f7a080d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0e116640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a080d00e0 0x7f7a080d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42636/0 (socket says 172.21.15.16:42636) 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0e116640 1 -- 172.21.15.16:0/1286327624 learned_addr learned my addr 172.21.15.16:0/1286327624 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0d915640 1 --2- 172.21.15.16:0/1286327624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a0815f6b0 0x7f7a080d3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0e116640 1 -- 172.21.15.16:0/1286327624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a0815f6b0 msgr2=0x7f7a080d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0e116640 1 --2- 172.21.15.16:0/1286327624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a0815f6b0 0x7f7a080d3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0e116640 1 -- 172.21.15.16:0/1286327624 >> v1:172.21.15.174:6789/0 conn(0x7f7a080bac80 legacy=0x7f7a080d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.831+0000 7f7a0e116640 1 -- 172.21.15.16:0/1286327624 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a080d3cd0 con 0x7f7a080d00e0 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.832+0000 7f7a0e116640 1 --2- 172.21.15.16:0/1286327624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a080d00e0 0x7f7a080d0570 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009e50 tx=0x7f7a0002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bea38a16cb9e51 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.832+0000 7f7a0c913640 1 -- 172.21.15.16:0/1286327624 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00036070 con 0x7f7a080d00e0 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.832+0000 7f7a0c913640 1 -- 172.21.15.16:0/1286327624 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a00031600 con 0x7f7a080d00e0 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.832+0000 7f7a0c913640 1 -- 172.21.15.16:0/1286327624 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a000319d0 con 0x7f7a080d00e0 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.833+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1286327624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a080d00e0 msgr2=0x7f7a080d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.833+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1286327624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a080d00e0 0x7f7a080d0570 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009e50 tx=0x7f7a0002a7a0 comp rx=0 tx=0).stop 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.833+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1286327624 shutdown_connections 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.833+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1286327624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a080d00e0 0x7f7a080d0570 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.833+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1286327624 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a0815f6b0 0x7f7a080d3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.833+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1286327624 >> 172.21.15.16:0/1286327624 conn(0x7f7a08073f00 msgr2=0x7f7a08074310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:36.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.833+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1286327624 shutdown_connections 2024-05-11T01:13:36.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.833+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1286327624 wait complete. 2024-05-11T01:13:36.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.834+0000 7f7a0fb79640 1 Processor -- start 2024-05-11T01:13:36.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.834+0000 7f7a0fb79640 1 -- start start 2024-05-11T01:13:36.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0fb79640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a080bac80 0x7f7a080cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:36.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0fb79640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a080d00e0 0x7f7a08156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:36.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0fb79640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a0815f6b0 0x7f7a08158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:36.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0fb79640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7a080d4570 con 0x7f7a0815f6b0 2024-05-11T01:13:36.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0fb79640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7a080d4290 con 0x7f7a080d00e0 2024-05-11T01:13:36.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0fb79640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7a080b8400 con 0x7f7a080bac80 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a0815f6b0 0x7f7a08158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a0815f6b0 0x7f7a08158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42638/0 (socket says 172.21.15.16:42638) 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 -- 172.21.15.16:0/1245336659 learned_addr learned my addr 172.21.15.16:0/1245336659 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0d915640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a080bac80 0x7f7a080cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0d114640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a080d00e0 0x7f7a08156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 -- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a080bac80 msgr2=0x7f7a080cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a080bac80 0x7f7a080cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 -- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a080d00e0 msgr2=0x7f7a08156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a080d00e0 0x7f7a08156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 -- 172.21.15.16:0/1245336659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a080b4d30 con 0x7f7a0815f6b0 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0e116640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a0815f6b0 0x7f7a08158490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7a00034040 tx=0x7f7a00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f79fe7fc640 1 -- 172.21.15.16:0/1245336659 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00036050 con 0x7f7a0815f6b0 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f79fe7fc640 1 -- 172.21.15.16:0/1245336659 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a00042070 con 0x7f7a0815f6b0 2024-05-11T01:13:36.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a080b5010 con 0x7f7a0815f6b0 2024-05-11T01:13:36.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.835+0000 7f79fe7fc640 1 -- 172.21.15.16:0/1245336659 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00009510 con 0x7f7a0815f6b0 2024-05-11T01:13:36.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.836+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a080b55d0 con 0x7f7a0815f6b0 2024-05-11T01:13:36.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.836+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0806a5b0 con 0x7f7a0815f6b0 2024-05-11T01:13:36.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.837+0000 7f79fe7fc640 1 -- 172.21.15.16:0/1245336659 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f7a00007bf0 con 0x7f7a0815f6b0 2024-05-11T01:13:36.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.838+0000 7f79fe7fc640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f79ec0764d0 0x7f79ec078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:36.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.838+0000 7f79fe7fc640 1 -- 172.21.15.16:0/1245336659 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6663+0+0 (secure 0 0 0) 0x7f7a000b8ad0 con 0x7f7a0815f6b0 2024-05-11T01:13:36.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.838+0000 7f7a0d915640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f79ec0764d0 0x7f79ec078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:36.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.838+0000 7f7a0d915640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f79ec0764d0 0x7f79ec078990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009aa0 tx=0x7f7a04009190 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:36.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:36.842+0000 7f79fe7fc640 1 -- 172.21.15.16:0/1245336659 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a00081690 con 0x7f7a0815f6b0 2024-05-11T01:13:37.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.058+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f7a080742e0 con 0x7f79ec0764d0 2024-05-11T01:13:37.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.139+0000 7f79fe7fc640 1 -- 172.21.15.16:0/1245336659 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f7a080742e0 con 0x7f79ec0764d0 2024-05-11T01:13:37.139 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir7 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f79ec0764d0 msgr2=0x7f79ec078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f79ec0764d0 0x7f79ec078990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009aa0 tx=0x7f7a04009190 comp rx=0 tx=0).stop 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a0815f6b0 msgr2=0x7f7a08158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a0815f6b0 0x7f7a08158490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7a00034040 tx=0x7f7a00004a40 comp rx=0 tx=0).stop 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 shutdown_connections 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f79ec0764d0 0x7f79ec078990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a0815f6b0 0x7f7a08158490 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a080d00e0 0x7f7a08156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 --2- 172.21.15.16:0/1245336659 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7a080bac80 0x7f7a080cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:37.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.141+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 >> 172.21.15.16:0/1245336659 conn(0x7f7a08073f00 msgr2=0x7f7a08160a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:37.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.142+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 shutdown_connections 2024-05-11T01:13:37.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:37.142+0000 7f7a0fb79640 1 -- 172.21.15.16:0/1245336659 wait complete. 2024-05-11T01:13:37.151 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2024-05-11T01:13:37.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.151 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2024-05-11T01:13:37.168 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:37.169 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:37.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.170 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:37.232 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:37.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.232 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:37.294 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:37.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.294 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:37.355 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:37.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.355 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:37.416 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:37.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.417 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:37.478 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:37.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.479 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:37.554 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:37.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.554 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:37.615 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:37.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.615 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:37.677 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:37.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.677 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:37.738 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:37.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.738 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:37.801 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:37.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.801 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:37.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:37.862 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2024-05-11T01:13:37.923 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir8 1m 2024-05-11T01:13:38.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.071+0000 7f22e8b38640 1 Processor -- start 2024-05-11T01:13:38.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.071+0000 7f22e8b38640 1 -- start start 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e8b38640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22e415b260 0x7f22e4161c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e8b38640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e415e740 con 0x7f22e415e1d0 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e8b38640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e415ea20 con 0x7f22e40b4cf0 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e8b38640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f22e41617a0 con 0x7f22e415b260 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e259c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22e415b260 0x7f22e4161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e2d9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f22e415e1d0 0x7f22e40d0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34840/0 (socket says 172.21.15.16:34840) 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e2d9d640 1 -- 172.21.15.16:0/3349301159 learned_addr learned my addr 172.21.15.16:0/3349301159 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e259c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22e415b260 0x7f22e4161c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42648/0 (socket says 172.21.15.16:42648) 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e259c640 1 -- 172.21.15.16:0/3349301159 >> v1:172.21.15.174:6789/0 conn(0x7f22e40b4cf0 legacy=0x7f22e415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.072+0000 7f22e259c640 1 -- 172.21.15.16:0/3349301159 >> v1:172.21.15.16:6789/0 conn(0x7f22e415e1d0 legacy=0x7f22e40d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:38.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.073+0000 7f22e259c640 1 -- 172.21.15.16:0/3349301159 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e4161150 con 0x7f22e415b260 2024-05-11T01:13:38.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.073+0000 7f22e159a640 1 -- 172.21.15.16:0/3349301159 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329012692 0 0) 0x7f22e415e740 con 0x7f22e415e1d0 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.073+0000 7f22e259c640 1 --2- 172.21.15.16:0/3349301159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e415b260 0x7f22e4161c30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f22d40097a0 tx=0x7f22d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bb8c11eae608f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.073+0000 7f22e159a640 1 -- 172.21.15.16:0/3349301159 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4037070 con 0x7f22e415b260 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.073+0000 7f22e159a640 1 -- 172.21.15.16:0/3349301159 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d4032440 con 0x7f22e415b260 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.073+0000 7f22e159a640 1 -- 172.21.15.16:0/3349301159 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4032810 con 0x7f22e415b260 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.074+0000 7f22e8b38640 1 -- 172.21.15.16:0/3349301159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e415b260 msgr2=0x7f22e4161c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.074+0000 7f22e8b38640 1 --2- 172.21.15.16:0/3349301159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e415b260 0x7f22e4161c30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f22d40097a0 tx=0x7f22d402a1a0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.074+0000 7f22e8b38640 1 -- 172.21.15.16:0/3349301159 shutdown_connections 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.074+0000 7f22e8b38640 1 --2- 172.21.15.16:0/3349301159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e415b260 0x7f22e4161c30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.074+0000 7f22e8b38640 1 -- 172.21.15.16:0/3349301159 >> 172.21.15.16:0/3349301159 conn(0x7f22e40681c0 msgr2=0x7f22e40685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:38.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.074+0000 7f22e8b38640 1 -- 172.21.15.16:0/3349301159 shutdown_connections 2024-05-11T01:13:38.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.074+0000 7f22e8b38640 1 -- 172.21.15.16:0/3349301159 wait complete. 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.075+0000 7f22e8b38640 1 Processor -- start 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.075+0000 7f22e8b38640 1 -- start start 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e8b38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e40b4cf0 0x7f22e40c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e8b38640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e415b260 0x7f22e414d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e8b38640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e415e1d0 0x7f22e40cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e8b38640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f22e40b5320 con 0x7f22e40b4cf0 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e8b38640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f22e40b51a0 con 0x7f22e415e1d0 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e8b38640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f22e40b54a0 con 0x7f22e415b260 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e40b4cf0 0x7f22e40c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:38.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e259c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e40b4cf0 0x7f22e40c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42662/0 (socket says 172.21.15.16:42662) 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e259c640 1 -- 172.21.15.16:0/231020388 learned_addr learned my addr 172.21.15.16:0/231020388 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e1d9b640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e415b260 0x7f22e414d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.076+0000 7f22e2d9d640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e415e1d0 0x7f22e40cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22e259c640 1 -- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e415b260 msgr2=0x7f22e414d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22e259c640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e415b260 0x7f22e414d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22e259c640 1 -- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e415e1d0 msgr2=0x7f22e40cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22e259c640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e415e1d0 0x7f22e40cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22e259c640 1 -- 172.21.15.16:0/231020388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e41f7200 con 0x7f22e40b4cf0 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22e259c640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e40b4cf0 0x7f22e40c8980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000c00 tx=0x7f22d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22daffd640 1 -- 172.21.15.16:0/231020388 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4037040 con 0x7f22e40b4cf0 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22daffd640 1 -- 172.21.15.16:0/231020388 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d4042070 con 0x7f22e40b4cf0 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e41f74e0 con 0x7f22e40b4cf0 2024-05-11T01:13:38.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22daffd640 1 -- 172.21.15.16:0/231020388 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4030a70 con 0x7f22e40b4cf0 2024-05-11T01:13:38.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.077+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e41f7aa0 con 0x7f22e40b4cf0 2024-05-11T01:13:38.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.078+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e406a5b0 con 0x7f22e40b4cf0 2024-05-11T01:13:38.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.079+0000 7f22daffd640 1 -- 172.21.15.16:0/231020388 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f22d4030c10 con 0x7f22e40b4cf0 2024-05-11T01:13:38.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.079+0000 7f22daffd640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f22c40764d0 0x7f22c4078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:38.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.079+0000 7f22daffd640 1 -- 172.21.15.16:0/231020388 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6535+0+0 (secure 0 0 0) 0x7f22d40b8600 con 0x7f22e40b4cf0 2024-05-11T01:13:38.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.079+0000 7f22e1d9b640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f22c40764d0 0x7f22c4078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:38.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.080+0000 7f22e1d9b640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f22c40764d0 0x7f22c4078990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22e414dee0 tx=0x7f22cc009040 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:38.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.083+0000 7f22daffd640 1 -- 172.21.15.16:0/231020388 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f22d4081350 con 0x7f22e40b4cf0 2024-05-11T01:13:38.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.310+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f22e41f6fb0 con 0x7f22c40764d0 2024-05-11T01:13:38.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.402+0000 7f22daffd640 1 -- 172.21.15.16:0/231020388 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f22e41f6fb0 con 0x7f22c40764d0 2024-05-11T01:13:38.401 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir8 2024-05-11T01:13:38.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f22c40764d0 msgr2=0x7f22c4078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:38.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f22c40764d0 0x7f22c4078990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f22e414dee0 tx=0x7f22cc009040 comp rx=0 tx=0).stop 2024-05-11T01:13:38.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e40b4cf0 msgr2=0x7f22e40c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:38.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e40b4cf0 0x7f22e40c8980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000c00 tx=0x7f22d40046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 shutdown_connections 2024-05-11T01:13:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f22c40764d0 0x7f22c4078990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22e415e1d0 0x7f22e40cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f22e415b260 0x7f22e414d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 --2- 172.21.15.16:0/231020388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22e40b4cf0 0x7f22e40c8980 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 >> 172.21.15.16:0/231020388 conn(0x7f22e40681c0 msgr2=0x7f22e415ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 shutdown_connections 2024-05-11T01:13:38.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:38.404+0000 7f22e8b38640 1 -- 172.21.15.16:0/231020388 wait complete. 2024-05-11T01:13:38.414 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2024-05-11T01:13:38.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.414 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2024-05-11T01:13:38.432 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:38.433 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:38.434 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:38.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.434 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:38.498 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:38.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.498 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:38.562 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:38.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.562 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:38.623 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:38.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.624 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:38.686 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:38.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.686 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:38.751 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:38.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.751 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:38.813 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:38.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.813 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:38.874 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:38.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.875 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:38.936 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:38.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:38.937 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:38.999 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:38.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.000 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:39.062 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:39.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.062 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:39.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.124 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2024-05-11T01:13:39.182 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir9 1m 2024-05-11T01:13:39.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.343+0000 7f81813c8640 1 Processor -- start 2024-05-11T01:13:39.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.343+0000 7f81813c8640 1 -- start start 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f81813c8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f817c0d16c0 0x7f817c0d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f81813c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c15fd00 0x7f817c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f81813c8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817c0d2e30 con 0x7f817c160180 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f81813c8640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f817c0d3460 con 0x7f817c0d16c0 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f81813c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f817c160750 con 0x7f817c15fd00 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f817a7fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c15fd00 0x7f817c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f817affd640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f817c0d16c0 0x7f817c0d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f817a7fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c15fd00 0x7f817c0b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:58848/0 (socket says 172.21.15.16:58848) 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.344+0000 7f817a7fc640 1 -- 172.21.15.16:0/2434320974 learned_addr learned my addr 172.21.15.16:0/2434320974 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.345+0000 7f817a7fc640 1 -- 172.21.15.16:0/2434320974 >> v2:172.21.15.174:3300/0 conn(0x7f817c0d16c0 msgr2=0x7f817c0d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.345+0000 7f817a7fc640 1 --2- 172.21.15.16:0/2434320974 >> v2:172.21.15.174:3300/0 conn(0x7f817c0d16c0 0x7f817c0d38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.345+0000 7f817a7fc640 1 -- 172.21.15.16:0/2434320974 >> v1:172.21.15.174:6789/0 conn(0x7f817c160180 legacy=0x7f817c06d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:39.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.345+0000 7f817a7fc640 1 -- 172.21.15.16:0/2434320974 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c160a30 con 0x7f817c15fd00 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.345+0000 7f817a7fc640 1 --2- 172.21.15.16:0/2434320974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c15fd00 0x7f817c0b4cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f816c009870 tx=0x7f816c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec2f8cb21ac185db server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f8179ffb640 1 -- 172.21.15.16:0/2434320974 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c037070 con 0x7f817c15fd00 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f8179ffb640 1 -- 172.21.15.16:0/2434320974 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f816c032440 con 0x7f817c15fd00 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f8179ffb640 1 -- 172.21.15.16:0/2434320974 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c032810 con 0x7f817c15fd00 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f81813c8640 1 -- 172.21.15.16:0/2434320974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c15fd00 msgr2=0x7f817c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f81813c8640 1 --2- 172.21.15.16:0/2434320974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c15fd00 0x7f817c0b4cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f816c009870 tx=0x7f816c02a250 comp rx=0 tx=0).stop 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f81813c8640 1 -- 172.21.15.16:0/2434320974 shutdown_connections 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f81813c8640 1 --2- 172.21.15.16:0/2434320974 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c15fd00 0x7f817c0b4cf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f81813c8640 1 --2- 172.21.15.16:0/2434320974 >> v2:172.21.15.174:3300/0 conn(0x7f817c0d16c0 0x7f817c0d38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f81813c8640 1 -- 172.21.15.16:0/2434320974 >> 172.21.15.16:0/2434320974 conn(0x7f817c0681c0 msgr2=0x7f817c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:39.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f81813c8640 1 -- 172.21.15.16:0/2434320974 shutdown_connections 2024-05-11T01:13:39.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.346+0000 7f81813c8640 1 -- 172.21.15.16:0/2434320974 wait complete. 2024-05-11T01:13:39.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f81813c8640 1 Processor -- start 2024-05-11T01:13:39.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f81813c8640 1 -- start start 2024-05-11T01:13:39.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f81813c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c0d16c0 0x7f817c152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:39.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f81813c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f817c15fd00 0x7f817c0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:39.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f81813c8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c160180 0x7f817c0b8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:39.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f81813c8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f817c06f3d0 con 0x7f817c15fd00 2024-05-11T01:13:39.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f81813c8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f817c06f250 con 0x7f817c160180 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f81813c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f817c0d3e30 con 0x7f817c0d16c0 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.348+0000 7f817a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f817c15fd00 0x7f817c0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f817c15fd00 0x7f817c0b6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42668/0 (socket says 172.21.15.16:42668) 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817a7fc640 1 -- 172.21.15.16:0/3856262048 learned_addr learned my addr 172.21.15.16:0/3856262048 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817affd640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c0d16c0 0x7f817c152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817b7fe640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c160180 0x7f817c0b8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817a7fc640 1 -- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c0d16c0 msgr2=0x7f817c152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817a7fc640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c0d16c0 0x7f817c152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817a7fc640 1 -- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c160180 msgr2=0x7f817c0b8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817a7fc640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c160180 0x7f817c0b8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817a7fc640 1 -- 172.21.15.16:0/3856262048 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c0b8bf0 con 0x7f817c15fd00 2024-05-11T01:13:39.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817b7fe640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c160180 0x7f817c0b8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:39.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f817a7fc640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f817c15fd00 0x7f817c0b6a20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f816c000c00 tx=0x7f816c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:39.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f81737fe640 1 -- 172.21.15.16:0/3856262048 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c037040 con 0x7f817c15fd00 2024-05-11T01:13:39.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f81737fe640 1 -- 172.21.15.16:0/3856262048 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f816c042070 con 0x7f817c15fd00 2024-05-11T01:13:39.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817c0b8ed0 con 0x7f817c15fd00 2024-05-11T01:13:39.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f81737fe640 1 -- 172.21.15.16:0/3856262048 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816c030860 con 0x7f817c15fd00 2024-05-11T01:13:39.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.349+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817c0c80c0 con 0x7f817c15fd00 2024-05-11T01:13:39.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.350+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f817c06a5b0 con 0x7f817c15fd00 2024-05-11T01:13:39.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.351+0000 7f81737fe640 1 -- 172.21.15.16:0/3856262048 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f816c030a00 con 0x7f817c15fd00 2024-05-11T01:13:39.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.352+0000 7f81737fe640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f815c076500 0x7f815c0789c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:39.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.352+0000 7f81737fe640 1 -- 172.21.15.16:0/3856262048 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6743+0+0 (secure 0 0 0) 0x7f816c0b8490 con 0x7f817c15fd00 2024-05-11T01:13:39.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.352+0000 7f817affd640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f815c076500 0x7f815c0789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:39.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.352+0000 7f817affd640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f815c076500 0x7f815c0789c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8164009b40 tx=0x7f8164009190 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:39.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.356+0000 7f81737fe640 1 -- 172.21.15.16:0/3856262048 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f816c0817f0 con 0x7f817c15fd00 2024-05-11T01:13:39.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.589+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 --> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f817c0d06f0 con 0x7f815c076500 2024-05-11T01:13:39.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.679+0000 7f81737fe640 1 -- 172.21.15.16:0/3856262048 <== mgr.4607 v2:172.21.15.174:6832/2127220129 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f817c0d06f0 con 0x7f815c076500 2024-05-11T01:13:39.678 INFO:teuthology.orchestra.run.smithi016.stdout:Schedule removed for path /snap_test_dir1/dir9 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f815c076500 msgr2=0x7f815c0789c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f815c076500 0x7f815c0789c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8164009b40 tx=0x7f8164009190 comp rx=0 tx=0).stop 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f817c15fd00 msgr2=0x7f817c0b6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f817c15fd00 0x7f817c0b6a20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f816c000c00 tx=0x7f816c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 shutdown_connections 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f815c076500 0x7f815c0789c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f817c160180 0x7f817c0b8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f817c15fd00 0x7f817c0b6a20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 --2- 172.21.15.16:0/3856262048 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f817c0d16c0 0x7f817c152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 >> 172.21.15.16:0/3856262048 conn(0x7f817c0681c0 msgr2=0x7f817c15bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 shutdown_connections 2024-05-11T01:13:39.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:39.681+0000 7f81813c8640 1 -- 172.21.15.16:0/3856262048 wait complete. 2024-05-11T01:13:39.693 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2024-05-11T01:13:39.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.693 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2024-05-11T01:13:39.710 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:39.710 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:39.710 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:39.710 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:39.711 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:39.711 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:39.711 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:39.711 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:39.711 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:39.711 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:39.711 INFO:teuthology.orchestra.run.smithi016.stdout:scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:39.711 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_03_00_UTC 2024-05-11T01:13:39.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.711 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_03_00_UTC) 2024-05-11T01:13:39.778 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_04_00_UTC 2024-05-11T01:13:39.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.778 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_04_00_UTC) 2024-05-11T01:13:39.840 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_05_00_UTC 2024-05-11T01:13:39.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.841 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_05_00_UTC) 2024-05-11T01:13:39.903 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_06_00_UTC 2024-05-11T01:13:39.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.903 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_06_00_UTC) 2024-05-11T01:13:39.964 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_07_00_UTC 2024-05-11T01:13:39.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:39.965 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_07_00_UTC) 2024-05-11T01:13:40.027 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_08_00_UTC 2024-05-11T01:13:40.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:40.027 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_08_00_UTC) 2024-05-11T01:13:40.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_09_00_UTC 2024-05-11T01:13:40.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:40.089 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_09_00_UTC) 2024-05-11T01:13:40.151 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_10_00_UTC 2024-05-11T01:13:40.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:40.151 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_10_00_UTC) 2024-05-11T01:13:40.212 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_11_00_UTC 2024-05-11T01:13:40.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:40.213 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_11_00_UTC) 2024-05-11T01:13:40.307 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_12_00_UTC 2024-05-11T01:13:40.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:40.307 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_12_00_UTC) 2024-05-11T01:13:40.343 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_13_00_UTC 2024-05-11T01:13:40.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:40.343 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-05-11-01_13_00_UTC) 2024-05-11T01:13:40.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:40.408 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2024-05-11T01:13:40.475 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-05-11T01:13:40.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.631+0000 7f8ba5b11640 1 Processor -- start 2024-05-11T01:13:40.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.631+0000 7f8ba5b11640 1 -- start start 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8ba5b11640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ba0148e50 0x7f8ba00b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8ba5b11640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8ba006eb10 0x7f8ba0070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8ba5b11640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba0149230 con 0x7f8ba00707a0 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8ba5b11640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba0163290 con 0x7f8ba0148e50 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8ba5b11640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba0163570 con 0x7f8ba006eb10 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ba0148e50 0x7f8ba00b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ba0148e50 0x7f8ba00b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42684/0 (socket says 172.21.15.16:42684) 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9f7fe640 1 -- 172.21.15.16:0/1953724497 learned_addr learned my addr 172.21.15.16:0/1953724497 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9effd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8ba00707a0 0x7f8ba00b4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34856/0 (socket says 172.21.15.16:34856) 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9ffff640 1 --2- 172.21.15.16:0/1953724497 >> v2:172.21.15.174:3300/0 conn(0x7f8ba006eb10 0x7f8ba0070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:40.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9f7fe640 1 -- 172.21.15.16:0/1953724497 >> v2:172.21.15.174:3300/0 conn(0x7f8ba006eb10 msgr2=0x7f8ba0070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:40.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9f7fe640 1 --2- 172.21.15.16:0/1953724497 >> v2:172.21.15.174:3300/0 conn(0x7f8ba006eb10 0x7f8ba0070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:40.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9f7fe640 1 -- 172.21.15.16:0/1953724497 >> v1:172.21.15.16:6789/0 conn(0x7f8ba00707a0 legacy=0x7f8ba00b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:40.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.632+0000 7f8b9f7fe640 1 -- 172.21.15.16:0/1953724497 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba0163850 con 0x7f8ba0148e50 2024-05-11T01:13:40.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.633+0000 7f8b9f7fe640 1 --2- 172.21.15.16:0/1953724497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba0148e50 0x7f8ba00b66a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0149400 tx=0x7f8b9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd13f5311e62401 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:40.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.633+0000 7f8b9e7fc640 1 -- 172.21.15.16:0/1953724497 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90037070 con 0x7f8ba0148e50 2024-05-11T01:13:40.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.633+0000 7f8b9e7fc640 1 -- 172.21.15.16:0/1953724497 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b90032440 con 0x7f8ba0148e50 2024-05-11T01:13:40.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.633+0000 7f8b9e7fc640 1 -- 172.21.15.16:0/1953724497 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90032810 con 0x7f8ba0148e50 2024-05-11T01:13:40.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.634+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1953724497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba0148e50 msgr2=0x7f8ba00b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:40.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.634+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1953724497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba0148e50 0x7f8ba00b66a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0149400 tx=0x7f8b9002a1e0 comp rx=0 tx=0).stop 2024-05-11T01:13:40.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.634+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1953724497 shutdown_connections 2024-05-11T01:13:40.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.634+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1953724497 >> v2:172.21.15.174:3300/0 conn(0x7f8ba006eb10 0x7f8ba0070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:40.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.634+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1953724497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba0148e50 0x7f8ba00b66a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:40.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.634+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1953724497 >> 172.21.15.16:0/1953724497 conn(0x7f8ba00b8510 msgr2=0x7f8ba00b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:40.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.634+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1953724497 shutdown_connections 2024-05-11T01:13:40.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.634+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1953724497 wait complete. 2024-05-11T01:13:40.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.635+0000 7f8ba5b11640 1 Processor -- start 2024-05-11T01:13:40.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.635+0000 7f8ba5b11640 1 -- start start 2024-05-11T01:13:40.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8ba5b11640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ba006eb10 0x7f8ba0142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:40.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8ba5b11640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba00707a0 0x7f8ba0142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:40.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8ba5b11640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ba0148e50 0x7f8ba01f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:40.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8ba5b11640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba00b6d60 con 0x7f8ba00707a0 2024-05-11T01:13:40.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8ba5b11640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba00b6be0 con 0x7f8ba006eb10 2024-05-11T01:13:40.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8ba5b11640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba00b6140 con 0x7f8ba0148e50 2024-05-11T01:13:40.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba00707a0 0x7f8ba0142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba00707a0 0x7f8ba0142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42692/0 (socket says 172.21.15.16:42692) 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9effd640 1 -- 172.21.15.16:0/1507392641 learned_addr learned my addr 172.21.15.16:0/1507392641 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9ffff640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ba0148e50 0x7f8ba01f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9effd640 1 -- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ba0148e50 msgr2=0x7f8ba01f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9effd640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ba0148e50 0x7f8ba01f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9effd640 1 -- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ba006eb10 msgr2=0x7f8ba0142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9effd640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ba006eb10 0x7f8ba0142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.636+0000 7f8b9effd640 1 -- 172.21.15.16:0/1507392641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba01432c0 con 0x7f8ba00707a0 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.637+0000 7f8b9effd640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba00707a0 0x7f8ba0142d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8b94001eb0 tx=0x7f8b9400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.637+0000 7f8b87fff640 1 -- 172.21.15.16:0/1507392641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b940074e0 con 0x7f8ba00707a0 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.637+0000 7f8b87fff640 1 -- 172.21.15.16:0/1507392641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b94007680 con 0x7f8ba00707a0 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.637+0000 7f8b87fff640 1 -- 172.21.15.16:0/1507392641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b940049e0 con 0x7f8ba00707a0 2024-05-11T01:13:40.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.637+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba0141220 con 0x7f8ba00707a0 2024-05-11T01:13:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.637+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba01f67b0 con 0x7f8ba00707a0 2024-05-11T01:13:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.638+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba006a5b0 con 0x7f8ba00707a0 2024-05-11T01:13:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.638+0000 7f8b87fff640 1 -- 172.21.15.16:0/1507392641 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 13) ==== 98389+0+0 (secure 0 0 0) 0x7f8b9401a020 con 0x7f8ba00707a0 2024-05-11T01:13:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.639+0000 7f8b87fff640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8b8c0764d0 0x7f8b8c078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.639+0000 7f8b87fff640 1 -- 172.21.15.16:0/1507392641 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6807+0+0 (secure 0 0 0) 0x7f8b94097640 con 0x7f8ba00707a0 2024-05-11T01:13:40.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.639+0000 7f8b9f7fe640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8b8c0764d0 0x7f8b8c078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:40.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.640+0000 7f8b9f7fe640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8b8c0764d0 0x7f8b8c078990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b90034000 tx=0x7f8b9002c000 comp rx=0 tx=0).ready entity=mgr.4607 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:40.642 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.644+0000 7f8b87fff640 1 -- 172.21.15.16:0/1507392641 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8ba01432c0 con 0x7f8ba00707a0 2024-05-11T01:13:40.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:40.893+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) -- 0x7f8ba00d3d50 con 0x7f8ba00707a0 2024-05-11T01:13:41.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.519+0000 7f8b87fff640 1 -- 172.21.15.16:0/1507392641 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) ==== 93+0+0 (secure 0 0 0) 0x7f8b94060830 con 0x7f8ba00707a0 2024-05-11T01:13:41.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8b8c0764d0 msgr2=0x7f8b8c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:41.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8b8c0764d0 0x7f8b8c078990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b90034000 tx=0x7f8b9002c000 comp rx=0 tx=0).stop 2024-05-11T01:13:41.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba00707a0 msgr2=0x7f8ba0142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba00707a0 0x7f8ba0142d80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8b94001eb0 tx=0x7f8b9400c890 comp rx=0 tx=0).stop 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 shutdown_connections 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f8b8c0764d0 0x7f8b8c078990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8ba0148e50 0x7f8ba01f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ba00707a0 0x7f8ba0142d80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 --2- 172.21.15.16:0/1507392641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ba006eb10 0x7f8ba0142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 >> 172.21.15.16:0/1507392641 conn(0x7f8ba00b8510 msgr2=0x7f8ba0162690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 shutdown_connections 2024-05-11T01:13:41.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.522+0000 7f8ba5b11640 1 -- 172.21.15.16:0/1507392641 wait complete. 2024-05-11T01:13:41.535 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-11T01:13:41.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-11T01:13:41.575 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-11T01:13:41.621 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-11T01:13:41.621 INFO:tasks.cephfs.mount:Terminating background process 2024-05-11T01:13:41.621 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:13:41.621 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:41.638 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:13:41.638 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:41.638 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:41.640+0000 7f10bffd6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-11T01:13:41.642 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:41.643+0000 7feaa552f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-11T01:13:41.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-11T01:13:41.753 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:41.755+0000 7f10bffd6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:13:41.763 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:41.764+0000 7feaa552f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:13:41.801 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:41.803+0000 7f10bffd6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-11T01:13:41.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.804+0000 7f3acbdc8640 1 Processor -- start 2024-05-11T01:13:41.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.805+0000 7f3acbdc8640 1 -- start start 2024-05-11T01:13:41.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3acbdc8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40d4c00 0x7f3ac416a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3acbdc8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac4163820 con 0x7f3ac40d0000 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3acbdc8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac4163b00 con 0x7f3ac40baed0 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3acbdc8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac40d33f0 con 0x7f3ac40d4c00 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3ac9b64640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3ac40d0000 0x7f3ac40d03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34878/0 (socket says 172.21.15.16:34878) 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3ac9b64640 1 -- 172.21.15.16:0/4085079780 learned_addr learned my addr 172.21.15.16:0/4085079780 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3aca365640 1 --2- 172.21.15.16:0/4085079780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40d4c00 0x7f3ac416a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3ac8b62640 1 -- 172.21.15.16:0/4085079780 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622788558 0 0) 0x7f3ac4163820 con 0x7f3ac40d0000 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3ac8b62640 1 -- 172.21.15.16:0/4085079780 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ab0003520 con 0x7f3ac40d0000 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3ac8b62640 1 -- 172.21.15.16:0/4085079780 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745559826 0 0) 0x7f3ac4163b00 con 0x7f3ac40baed0 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3ac8b62640 1 -- 172.21.15.16:0/4085079780 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ac4163820 con 0x7f3ac40baed0 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3aca365640 1 -- 172.21.15.16:0/4085079780 >> v1:172.21.15.174:6789/0 conn(0x7f3ac40baed0 legacy=0x7f3ac4162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3aca365640 1 -- 172.21.15.16:0/4085079780 >> v1:172.21.15.16:6789/0 conn(0x7f3ac40d0000 legacy=0x7f3ac40d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:41.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.806+0000 7f3aca365640 1 -- 172.21.15.16:0/4085079780 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac40d36d0 con 0x7f3ac40d4c00 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.807+0000 7f3aca365640 1 --2- 172.21.15.16:0/4085079780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40d4c00 0x7f3ac416a0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009dc0 tx=0x7f3abc02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=346b8007a99791bc server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.807+0000 7f3ac8b62640 1 -- 172.21.15.16:0/4085079780 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc007740 con 0x7f3ac40d4c00 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.807+0000 7f3ac8b62640 1 -- 172.21.15.16:0/4085079780 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3abc0078e0 con 0x7f3ac40d4c00 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.807+0000 7f3ac8b62640 1 -- 172.21.15.16:0/4085079780 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3abc007cb0 con 0x7f3ac40d4c00 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.808+0000 7f3acbdc8640 1 -- 172.21.15.16:0/4085079780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40d4c00 msgr2=0x7f3ac416a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.808+0000 7f3acbdc8640 1 --2- 172.21.15.16:0/4085079780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40d4c00 0x7f3ac416a0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009dc0 tx=0x7f3abc02a6d0 comp rx=0 tx=0).stop 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.808+0000 7f3acbdc8640 1 -- 172.21.15.16:0/4085079780 shutdown_connections 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.808+0000 7f3acbdc8640 1 --2- 172.21.15.16:0/4085079780 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40d4c00 0x7f3ac416a0c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.808+0000 7f3acbdc8640 1 -- 172.21.15.16:0/4085079780 >> 172.21.15.16:0/4085079780 conn(0x7f3ac4074140 msgr2=0x7f3ac40b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.808+0000 7f3acbdc8640 1 -- 172.21.15.16:0/4085079780 shutdown_connections 2024-05-11T01:13:41.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.808+0000 7f3acbdc8640 1 -- 172.21.15.16:0/4085079780 wait complete. 2024-05-11T01:13:41.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.809+0000 7f3acbdc8640 1 Processor -- start 2024-05-11T01:13:41.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.809+0000 7f3acbdc8640 1 -- start start 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3acbdc8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40baed0 0x7f3ac415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3acbdc8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ac40d0000 0x7f3ac4152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3acbdc8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40d4c00 0x7f3ac40b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3acbdc8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac415f8d0 con 0x7f3ac40d0000 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3acbdc8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac415f750 con 0x7f3ac40d4c00 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3acbdc8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac416a600 con 0x7f3ac40baed0 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9363640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ac40d0000 0x7f3ac4152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9b64640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40baed0 0x7f3ac415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3aca365640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40d4c00 0x7f3ac40b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9b64640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40baed0 0x7f3ac415abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:58886/0 (socket says 172.21.15.16:58886) 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9363640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ac40d0000 0x7f3ac4152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42702/0 (socket says 172.21.15.16:42702) 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9b64640 1 -- 172.21.15.16:0/2301950350 learned_addr learned my addr 172.21.15.16:0/2301950350 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9b64640 1 -- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40d4c00 msgr2=0x7f3ac40b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:41.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9b64640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40d4c00 0x7f3ac40b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9b64640 1 -- 172.21.15.16:0/2301950350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ac40d0000 msgr2=0x7f3ac4152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9b64640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ac40d0000 0x7f3ac4152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.810+0000 7f3ac9b64640 1 -- 172.21.15.16:0/2301950350 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac4154390 con 0x7f3ac40baed0 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.811+0000 7f3ac9b64640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40baed0 0x7f3ac415abb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000c410 tx=0x7f3ac000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.811+0000 7f3aba7fc640 1 -- 172.21.15.16:0/2301950350 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0017070 con 0x7f3ac40baed0 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.811+0000 7f3aba7fc640 1 -- 172.21.15.16:0/2301950350 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac0005ce0 con 0x7f3ac40baed0 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.811+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac4151870 con 0x7f3ac40baed0 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.811+0000 7f3aba7fc640 1 -- 172.21.15.16:0/2301950350 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0007310 con 0x7f3ac40baed0 2024-05-11T01:13:41.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.811+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac4151e30 con 0x7f3ac40baed0 2024-05-11T01:13:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.812+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac406a5b0 con 0x7f3ac40baed0 2024-05-11T01:13:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.813+0000 7f3aba7fc640 1 -- 172.21.15.16:0/2301950350 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7f3ac001a070 con 0x7f3ac40baed0 2024-05-11T01:13:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.813+0000 7f3aba7fc640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa8076480 0x7f3aa8078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.813+0000 7f3ac9363640 1 -- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa8076480 msgr2=0x7f3aa8078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.813+0000 7f3aba7fc640 1 -- 172.21.15.16:0/2301950350 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(45..45 src has 1..45) ==== 6631+0+0 (secure 0 0 0) 0x7f3ac0096f90 con 0x7f3ac40baed0 2024-05-11T01:13:41.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.813+0000 7f3ac9363640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa8076480 0x7f3aa8078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:41.814 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:41.815+0000 7feaa552f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-11T01:13:41.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:41.818+0000 7f3aba7fc640 1 -- 172.21.15.16:0/2301950350 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3ac005fd30 con 0x7f3ac40baed0 2024-05-11T01:13:42.004 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:42.006+0000 7f10bffd6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-11T01:13:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.014+0000 7f3ac9363640 1 -- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa8076480 msgr2=0x7f3aa8078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:42.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.014+0000 7f3ac9363640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa8076480 0x7f3aa8078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:42.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.022+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3ac40008d0 con 0x7f3ac40baed0 2024-05-11T01:13:42.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.023+0000 7f3aba7fc640 1 -- 172.21.15.16:0/2301950350 <== mon.2 v2:172.21.15.174:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v45) ==== 80+0+357 (secure 0 0 0) 0x7f3ac0064030 con 0x7f3ac40baed0 2024-05-11T01:13:42.022 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.174:0/990588653 2024-05-12T01:02:03.135099+0000 2024-05-11T01:13:42.022 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.174:0/3333657563 2024-05-12T01:02:03.135099+0000 2024-05-11T01:13:42.022 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.174:0/2159563993 2024-05-12T01:02:03.135099+0000 2024-05-11T01:13:42.022 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.174:6833/704865226 2024-05-12T01:02:03.135099+0000 2024-05-11T01:13:42.022 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.174:6832/704865226 2024-05-12T01:02:03.135099+0000 2024-05-11T01:13:42.022 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.174:0/3687919634 2024-05-12T01:02:03.135099+0000 2024-05-11T01:13:42.023 INFO:teuthology.orchestra.run.smithi016.stderr:listed 6 entries 2024-05-11T01:13:42.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa8076480 msgr2=0x7f3aa8078940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:42.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa8076480 0x7f3aa8078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40baed0 msgr2=0x7f3ac415abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40baed0 0x7f3ac415abb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000c410 tx=0x7f3ac000c8d0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 shutdown_connections 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f3aa8076480 0x7f3aa8078940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3ac40d4c00 0x7f3ac40b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ac40d0000 0x7f3ac4152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 --2- 172.21.15.16:0/2301950350 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3ac40baed0 0x7f3ac415abb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 >> 172.21.15.16:0/2301950350 conn(0x7f3ac4074140 msgr2=0x7f3ac40d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 shutdown_connections 2024-05-11T01:13:42.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.025+0000 7f3acbdc8640 1 -- 172.21.15.16:0/2301950350 wait complete. 2024-05-11T01:13:42.032 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:42.033+0000 7feaa552f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-11T01:13:42.035 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-11T01:13:42.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:42.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-11T01:13:42.047 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:42.048+0000 7f10bffd6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-11T01:13:42.069 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:13:42.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:13:42.069 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-11T01:13:42.080 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:42.081+0000 7feaa552f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-11T01:13:42.096 INFO:tasks.cephfs.mount:Terminating background process 2024-05-11T01:13:42.096 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:13:42.096 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:42.112 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-11T01:13:42.112 INFO:tasks.cephfs.mount:Terminating background process 2024-05-11T01:13:42.112 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:13:42.112 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:42.153 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=11459 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-11T01:13:42.153 INFO:tasks.cephfs.mount:Terminating background process 2024-05-11T01:13:42.153 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:13:42.153 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:42.169 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-11T01:13:42.169 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:13:42.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.304+0000 7f6cde083640 1 Processor -- start 2024-05-11T01:13:42.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.304+0000 7f6cde083640 1 -- start start 2024-05-11T01:13:42.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cde083640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd8162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cde083640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6cd80d3bf0 0x7f6cd80d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cde083640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd8163820 con 0x7f6cd80d0000 2024-05-11T01:13:42.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cde083640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd8163b00 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cde083640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd80d33f0 con 0x7f6cd80baed0 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cd77fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6cd80d0000 0x7f6cd80d03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34894/0 (socket says 172.21.15.16:34894) 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cd77fe640 1 -- 172.21.15.16:0/4294483312 learned_addr learned my addr 172.21.15.16:0/4294483312 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cd7fff640 1 --2- 172.21.15.16:0/4294483312 >> v2:172.21.15.174:3300/0 conn(0x7f6cd80d3bf0 0x7f6cd80d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.305+0000 7f6cd6ffd640 1 --2- 172.21.15.16:0/4294483312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd8162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.306+0000 7f6cd67fc640 1 -- 172.21.15.16:0/4294483312 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551124621 0 0) 0x7f6cd8163820 con 0x7f6cd80d0000 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.306+0000 7f6cd67fc640 1 -- 172.21.15.16:0/4294483312 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cc0003520 con 0x7f6cd80d0000 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.306+0000 7f6cd6ffd640 1 -- 172.21.15.16:0/4294483312 >> v2:172.21.15.174:3300/0 conn(0x7f6cd80d3bf0 msgr2=0x7f6cd80d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.306+0000 7f6cd6ffd640 1 --2- 172.21.15.16:0/4294483312 >> v2:172.21.15.174:3300/0 conn(0x7f6cd80d3bf0 0x7f6cd80d4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.306+0000 7f6cd6ffd640 1 -- 172.21.15.16:0/4294483312 >> v1:172.21.15.16:6789/0 conn(0x7f6cd80d0000 legacy=0x7f6cd80d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.306+0000 7f6cd67fc640 1 -- 172.21.15.16:0/4294483312 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2967509981 0 0) 0x7f6cc0003520 con 0x7f6cd80d0000 2024-05-11T01:13:42.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.306+0000 7f6cd6ffd640 1 -- 172.21.15.16:0/4294483312 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd80d36d0 con 0x7f6cd80baed0 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.307+0000 7f6cd6ffd640 1 --2- 172.21.15.16:0/4294483312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd8162fd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097a0 tx=0x7f6ccc02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4babc56645ab95b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.307+0000 7f6cd67fc640 1 -- 172.21.15.16:0/4294483312 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc037070 con 0x7f6cd80baed0 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.307+0000 7f6cd67fc640 1 -- 172.21.15.16:0/4294483312 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ccc02aba0 con 0x7f6cd80baed0 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.307+0000 7f6cd67fc640 1 -- 172.21.15.16:0/4294483312 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80016f0 con 0x7f6cd80baed0 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.308+0000 7f6cde083640 1 -- 172.21.15.16:0/4294483312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 msgr2=0x7f6cd8162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.308+0000 7f6cde083640 1 --2- 172.21.15.16:0/4294483312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd8162fd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc0097a0 tx=0x7f6ccc02a110 comp rx=0 tx=0).stop 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.308+0000 7f6cde083640 1 -- 172.21.15.16:0/4294483312 shutdown_connections 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.308+0000 7f6cde083640 1 --2- 172.21.15.16:0/4294483312 >> v2:172.21.15.174:3300/0 conn(0x7f6cd80d3bf0 0x7f6cd80d4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.308+0000 7f6cde083640 1 --2- 172.21.15.16:0/4294483312 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd8162fd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.308+0000 7f6cde083640 1 -- 172.21.15.16:0/4294483312 >> 172.21.15.16:0/4294483312 conn(0x7f6cd8074140 msgr2=0x7f6cd80b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.308+0000 7f6cde083640 1 -- 172.21.15.16:0/4294483312 shutdown_connections 2024-05-11T01:13:42.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.308+0000 7f6cde083640 1 -- 172.21.15.16:0/4294483312 wait complete. 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.309+0000 7f6cde083640 1 Processor -- start 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.309+0000 7f6cde083640 1 -- start start 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cde083640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cde083640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd80d0000 0x7f6cd8154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cde083640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cd80d3bf0 0x7f6cd8154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cde083640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd815f750 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cde083640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd8163de0 con 0x7f6cd80d0000 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cde083640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd815f8d0 con 0x7f6cd80baed0 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cd7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cd80d3bf0 0x7f6cd8154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cd7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cd80d3bf0 0x7f6cd8154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42708/0 (socket says 172.21.15.16:42708) 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cd7fff640 1 -- 172.21.15.16:0/2820279250 learned_addr learned my addr 172.21.15.16:0/2820279250 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cd77fe640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.310+0000 7f6cd6ffd640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd80d0000 0x7f6cd8154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cd7fff640 1 -- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 msgr2=0x7f6cd80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cd7fff640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd80ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cd7fff640 1 -- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd80d0000 msgr2=0x7f6cd8154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cd7fff640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd80d0000 0x7f6cd8154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cd7fff640 1 -- 172.21.15.16:0/2820279250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd80b8680 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cd7fff640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cd80d3bf0 0x7f6cd8154b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009dd0 tx=0x7f6cd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cbffff640 1 -- 172.21.15.16:0/2820279250 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0018020 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cbffff640 1 -- 172.21.15.16:0/2820279250 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cd0014480 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd80b8960 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cbffff640 1 -- 172.21.15.16:0/2820279250 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0014870 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.311+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd80b8f20 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.312+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd806a5b0 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.313+0000 7f6cbffff640 1 -- 172.21.15.16:0/2820279250 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7f6cd0005d10 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.313+0000 7f6cbffff640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6cc4076480 0x7f6cc4078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.313+0000 7f6cd77fe640 1 -- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6cc4076480 msgr2=0x7f6cc4078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:42.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.313+0000 7f6cbffff640 1 -- 172.21.15.16:0/2820279250 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6503+0+0 (secure 0 0 0) 0x7f6cd0098800 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.313+0000 7f6cd77fe640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6cc4076480 0x7f6cc4078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:42.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.318+0000 7f6cbffff640 1 -- 172.21.15.16:0/2820279250 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6cd0022070 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.514+0000 7f6cd77fe640 1 -- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6cc4076480 msgr2=0x7f6cc4078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:42.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.514+0000 7f6cd77fe640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6cc4076480 0x7f6cc4078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:42.554 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:42.555+0000 7f10bffd6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-11T01:13:42.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.559+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cd815e410 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.559+0000 7f6cbffff640 1 -- 172.21.15.16:0/2820279250 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f6cd0010040 con 0x7f6cd80d3bf0 2024-05-11T01:13:42.558 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:42.558 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/325711019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":325711019},{"type":"v1","addr":"172.21.15.174:6836","nonce":325711019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2354391599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2354391599},{"type":"v1","addr":"172.21.15.16:6835","nonce":2354391599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4809,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2932760959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2932760959},{"type":"v1","addr":"172.21.15.174:6837","nonce":2932760959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:50.892297+0000","modified":"2024-05-11T01:01:53.909794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4812},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4812":{"gid":4812,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/2086463820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2086463820},{"type":"v1","addr":"172.21.15.16:6834","nonce":2086463820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4812,"qdb_cluster":[4812]},"id":2}]} 2024-05-11T01:13:42.559 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-05-11T01:13:42.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6cc4076480 msgr2=0x7f6cc4078940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6cc4076480 0x7f6cc4078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cd80d3bf0 msgr2=0x7f6cd8154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cd80d3bf0 0x7f6cd8154b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009dd0 tx=0x7f6cd000c490 comp rx=0 tx=0).stop 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 shutdown_connections 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6cc4076480 0x7f6cc4078940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cd80d3bf0 0x7f6cd8154b60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd80d0000 0x7f6cd8154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 --2- 172.21.15.16:0/2820279250 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6cd80baed0 0x7f6cd80ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 >> 172.21.15.16:0/2820279250 conn(0x7f6cd8074140 msgr2=0x7f6cd815e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 shutdown_connections 2024-05-11T01:13:42.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.561+0000 7f6cde083640 1 -- 172.21.15.16:0/2820279250 wait complete. 2024-05-11T01:13:42.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:13:42.617 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:42.618+0000 7feaa552f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-11T01:13:42.638 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:42.640+0000 7f10bffd6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-11T01:13:42.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.681+0000 7f487d6a9640 1 Processor -- start 2024-05-11T01:13:42.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.681+0000 7f487d6a9640 1 -- start start 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f487d6a9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f48780d0000 0x7f48780d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f487d6a9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f48780d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f487d6a9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48780d0920 con 0x7f48780baed0 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f487d6a9640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f4878163820 con 0x7f48780d0000 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f487d6a9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4878163b00 con 0x7f48780d3bf0 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f486ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f48780baed0 0x7f4878162fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34906/0 (socket says 172.21.15.16:34906) 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f486ffff640 1 -- 172.21.15.16:0/2521475750 learned_addr learned my addr 172.21.15.16:0/2521475750 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f48777fe640 1 --2- 172.21.15.16:0/2521475750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f48780d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f4876ffd640 1 --2- 172.21.15.16:0/2521475750 >> v2:172.21.15.174:3300/0 conn(0x7f48780d0000 0x7f48780d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f48767fc640 1 -- 172.21.15.16:0/2521475750 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671732546 0 0) 0x7f48780d0920 con 0x7f48780baed0 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f48767fc640 1 -- 172.21.15.16:0/2521475750 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4864003520 con 0x7f48780baed0 2024-05-11T01:13:42.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f48777fe640 1 -- 172.21.15.16:0/2521475750 >> v2:172.21.15.174:3300/0 conn(0x7f48780d0000 msgr2=0x7f48780d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f48777fe640 1 --2- 172.21.15.16:0/2521475750 >> v2:172.21.15.174:3300/0 conn(0x7f48780d0000 0x7f48780d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.682+0000 7f48777fe640 1 -- 172.21.15.16:0/2521475750 >> v1:172.21.15.16:6789/0 conn(0x7f48780baed0 legacy=0x7f4878162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.683+0000 7f48777fe640 1 -- 172.21.15.16:0/2521475750 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48780d33f0 con 0x7f48780d3bf0 2024-05-11T01:13:42.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.683+0000 7f4876ffd640 1 --2- 172.21.15.16:0/2521475750 >> v2:172.21.15.174:3300/0 conn(0x7f48780d0000 0x7f48780d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:42.683 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:42.684+0000 7f10bffd6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.683+0000 7f48777fe640 1 --2- 172.21.15.16:0/2521475750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f48780d4080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4870009d90 tx=0x7f487002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60cd05c46538a231 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.683+0000 7f48767fc640 1 -- 172.21.15.16:0/2521475750 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870007740 con 0x7f48780d3bf0 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f48767fc640 1 -- 172.21.15.16:0/2521475750 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48700078e0 con 0x7f48780d3bf0 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f48767fc640 1 -- 172.21.15.16:0/2521475750 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870007cb0 con 0x7f48780d3bf0 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f487d6a9640 1 -- 172.21.15.16:0/2521475750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 msgr2=0x7f48780d4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f487d6a9640 1 --2- 172.21.15.16:0/2521475750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f48780d4080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4870009d90 tx=0x7f487002a660 comp rx=0 tx=0).stop 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f487d6a9640 1 -- 172.21.15.16:0/2521475750 shutdown_connections 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f487d6a9640 1 --2- 172.21.15.16:0/2521475750 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f48780d4080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f487d6a9640 1 --2- 172.21.15.16:0/2521475750 >> v2:172.21.15.174:3300/0 conn(0x7f48780d0000 0x7f48780d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f487d6a9640 1 -- 172.21.15.16:0/2521475750 >> 172.21.15.16:0/2521475750 conn(0x7f4878074140 msgr2=0x7f48780b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f487d6a9640 1 -- 172.21.15.16:0/2521475750 shutdown_connections 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.684+0000 7f487d6a9640 1 -- 172.21.15.16:0/2521475750 wait complete. 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.685+0000 7f487d6a9640 1 Processor -- start 2024-05-11T01:13:42.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f487d6a9640 1 -- start start 2024-05-11T01:13:42.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f487d6a9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780baed0 0x7f48780cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f487d6a9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48780d0000 0x7f4878152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f487d6a9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f4878151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f487d6a9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f487815f750 con 0x7f48780baed0 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f487d6a9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4878163de0 con 0x7f48780d0000 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f487d6a9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f487815f8d0 con 0x7f48780d3bf0 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f4876ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780baed0 0x7f48780cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f4876ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780baed0 0x7f48780cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42714/0 (socket says 172.21.15.16:42714) 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f4876ffd640 1 -- 172.21.15.16:0/1996429290 learned_addr learned my addr 172.21.15.16:0/1996429290 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.686+0000 7f48777fe640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f4878151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f486ffff640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48780d0000 0x7f4878152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f4876ffd640 1 -- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 msgr2=0x7f4878151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f4876ffd640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f4878151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f4876ffd640 1 -- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48780d0000 msgr2=0x7f4878152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f4876ffd640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48780d0000 0x7f4878152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f4876ffd640 1 -- 172.21.15.16:0/1996429290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4878151e40 con 0x7f48780baed0 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f4876ffd640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780baed0 0x7f48780cc400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f486800e990 tx=0x7f486800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f486f7fe640 1 -- 172.21.15.16:0/1996429290 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868017070 con 0x7f48780baed0 2024-05-11T01:13:42.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f486f7fe640 1 -- 172.21.15.16:0/1996429290 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486800c9e0 con 0x7f48780baed0 2024-05-11T01:13:42.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4878153b50 con 0x7f48780baed0 2024-05-11T01:13:42.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f486f7fe640 1 -- 172.21.15.16:0/1996429290 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486800cdb0 con 0x7f48780baed0 2024-05-11T01:13:42.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.687+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4878154110 con 0x7f48780baed0 2024-05-11T01:13:42.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.688+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48780cc1d0 con 0x7f48780baed0 2024-05-11T01:13:42.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.689+0000 7f486f7fe640 1 -- 172.21.15.16:0/1996429290 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7f486801a070 con 0x7f48780baed0 2024-05-11T01:13:42.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.690+0000 7f486f7fe640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4858076480 0x7f4858078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:42.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.690+0000 7f486ffff640 1 -- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4858076480 msgr2=0x7f4858078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:42.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.690+0000 7f486f7fe640 1 -- 172.21.15.16:0/1996429290 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6503+0+0 (secure 0 0 0) 0x7f48680979e0 con 0x7f48780baed0 2024-05-11T01:13:42.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.690+0000 7f486ffff640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4858076480 0x7f4858078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:42.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.694+0000 7f486f7fe640 1 -- 172.21.15.16:0/1996429290 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f48780cc1d0 con 0x7f48780baed0 2024-05-11T01:13:42.710 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:42.711+0000 7feaa552f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-11T01:13:42.758 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:42.759+0000 7feaa552f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-11T01:13:42.853 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:42.854+0000 7f10bffd6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-11T01:13:42.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.891+0000 7f486ffff640 1 -- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4858076480 msgr2=0x7f4858078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:42.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.891+0000 7f486ffff640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4858076480 0x7f4858078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:42.897 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:42.899+0000 7f10bffd6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-11T01:13:42.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.933+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f487806a5b0 con 0x7f48780baed0 2024-05-11T01:13:42.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.934+0000 7f486f7fe640 1 -- 172.21.15.16:0/1996429290 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f48680607f0 con 0x7f48780baed0 2024-05-11T01:13:42.933 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:42.934 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/325711019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":325711019},{"type":"v1","addr":"172.21.15.174:6836","nonce":325711019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2354391599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2354391599},{"type":"v1","addr":"172.21.15.16:6835","nonce":2354391599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4809,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2932760959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2932760959},{"type":"v1","addr":"172.21.15.174:6837","nonce":2932760959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:50.892297+0000","modified":"2024-05-11T01:01:53.909794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4812},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4812":{"gid":4812,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/2086463820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2086463820},{"type":"v1","addr":"172.21.15.16:6834","nonce":2086463820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4812,"qdb_cluster":[4812]},"id":2}]} 2024-05-11T01:13:42.934 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-05-11T01:13:42.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4858076480 msgr2=0x7f4858078940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4858076480 0x7f4858078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780baed0 msgr2=0x7f48780cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780baed0 0x7f48780cc400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f486800e990 tx=0x7f486800ee50 comp rx=0 tx=0).stop 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 shutdown_connections 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4858076480 0x7f4858078940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48780d3bf0 0x7f4878151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48780d0000 0x7f4878152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 --2- 172.21.15.16:0/1996429290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48780baed0 0x7f48780cc400 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 >> 172.21.15.16:0/1996429290 conn(0x7f4878074140 msgr2=0x7f487815a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 shutdown_connections 2024-05-11T01:13:42.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:42.936+0000 7f487d6a9640 1 -- 172.21.15.16:0/1996429290 wait complete. 2024-05-11T01:13:42.937 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:42.937+0000 7feaa552f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-11T01:13:42.945 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:42.947+0000 7f10bffd6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-11T01:13:42.947 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:13:42.985 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:42.985+0000 7feaa552f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-11T01:13:43.037 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:43.038+0000 7feaa552f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-11T01:13:43.056 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:43.058+0000 7f10bffd6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:13:43.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.091+0000 7f43a1538640 1 Processor -- start 2024-05-11T01:13:43.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.091+0000 7f43a1538640 1 -- start start 2024-05-11T01:13:43.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f43a1538640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f439c0b6d70 0x7f439c0d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f43a1538640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f439c0b8380 0x7f439c0d45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f43a1538640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439c0d3800 con 0x7f439c0bab70 2024-05-11T01:13:43.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f43a1538640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f439c0d35b0 con 0x7f439c0b8380 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f43a1538640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f439c0d3ae0 con 0x7f439c0b6d70 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f439b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f439c0b8380 0x7f439c0d45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f43927fc640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f439c0bab70 0x7f439c0b7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55936/0 (socket says 172.21.15.16:55936) 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f439b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f439c0b8380 0x7f439c0d45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49290/0 (socket says 172.21.15.16:49290) 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f43927fc640 1 -- 172.21.15.16:0/3188011751 learned_addr learned my addr 172.21.15.16:0/3188011751 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f439affd640 1 --2- 172.21.15.16:0/3188011751 >> v2:172.21.15.174:3300/0 conn(0x7f439c0b6d70 0x7f439c0d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f439b7fe640 1 -- 172.21.15.16:0/3188011751 >> v2:172.21.15.174:3300/0 conn(0x7f439c0b6d70 msgr2=0x7f439c0d2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f439b7fe640 1 --2- 172.21.15.16:0/3188011751 >> v2:172.21.15.174:3300/0 conn(0x7f439c0b6d70 0x7f439c0d2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f439b7fe640 1 -- 172.21.15.16:0/3188011751 >> v1:172.21.15.16:6789/0 conn(0x7f439c0bab70 legacy=0x7f439c0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f439a7fc640 1 -- 172.21.15.16:0/3188011751 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503528979 0 0) 0x7f439c0d3800 con 0x7f439c0bab70 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.092+0000 7f439b7fe640 1 -- 172.21.15.16:0/3188011751 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439c0d3dc0 con 0x7f439c0b8380 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.093+0000 7f439b7fe640 1 --2- 172.21.15.16:0/3188011751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b8380 0x7f439c0d45c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f439c0d6300 tx=0x7f439402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f943a3ee2a744043 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.093+0000 7f439a7fc640 1 -- 172.21.15.16:0/3188011751 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394007740 con 0x7f439c0b8380 2024-05-11T01:13:43.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.093+0000 7f439a7fc640 1 -- 172.21.15.16:0/3188011751 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43940078e0 con 0x7f439c0b8380 2024-05-11T01:13:43.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.093+0000 7f439a7fc640 1 -- 172.21.15.16:0/3188011751 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4394007cb0 con 0x7f439c0b8380 2024-05-11T01:13:43.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.094+0000 7f43a1538640 1 -- 172.21.15.16:0/3188011751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b8380 msgr2=0x7f439c0d45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.094+0000 7f43a1538640 1 --2- 172.21.15.16:0/3188011751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b8380 0x7f439c0d45c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f439c0d6300 tx=0x7f439402a680 comp rx=0 tx=0).stop 2024-05-11T01:13:43.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.094+0000 7f43a1538640 1 -- 172.21.15.16:0/3188011751 shutdown_connections 2024-05-11T01:13:43.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.094+0000 7f43a1538640 1 --2- 172.21.15.16:0/3188011751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b8380 0x7f439c0d45c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.094+0000 7f43a1538640 1 --2- 172.21.15.16:0/3188011751 >> v2:172.21.15.174:3300/0 conn(0x7f439c0b6d70 0x7f439c0d2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.094+0000 7f43a1538640 1 -- 172.21.15.16:0/3188011751 >> 172.21.15.16:0/3188011751 conn(0x7f439c074140 msgr2=0x7f439c0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.094+0000 7f43a1538640 1 -- 172.21.15.16:0/3188011751 shutdown_connections 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.094+0000 7f43a1538640 1 -- 172.21.15.16:0/3188011751 wait complete. 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.095+0000 7f43a1538640 1 Processor -- start 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.095+0000 7f43a1538640 1 -- start start 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f43a1538640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b6d70 0x7f439c0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f43a1538640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f439c0b8380 0x7f439c162410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f43a1538640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c0bab70 0x7f439c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f43a1538640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f439c0b8830 con 0x7f439c0b6d70 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f43a1538640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f439c0bafd0 con 0x7f439c0b8380 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f43a1538640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f439c0b89b0 con 0x7f439c0bab70 2024-05-11T01:13:43.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f439affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b6d70 0x7f439c0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f439affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b6d70 0x7f439c0c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49306/0 (socket says 172.21.15.16:49306) 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f439affd640 1 -- 172.21.15.16:0/1497724966 learned_addr learned my addr 172.21.15.16:0/1497724966 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f43927fc640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f439c0b8380 0x7f439c162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f439b7fe640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c0bab70 0x7f439c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f439affd640 1 -- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c0bab70 msgr2=0x7f439c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f439affd640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c0bab70 0x7f439c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f439affd640 1 -- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f439c0b8380 msgr2=0x7f439c162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.096+0000 7f439affd640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f439c0b8380 0x7f439c162410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.097+0000 7f439affd640 1 -- 172.21.15.16:0/1497724966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439c0c9490 con 0x7f439c0b6d70 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.097+0000 7f43927fc640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f439c0b8380 0x7f439c162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.097+0000 7f439affd640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b6d70 0x7f439c0c8e20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f438c00e8a0 tx=0x7f438c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.097+0000 7f4393fff640 1 -- 172.21.15.16:0/1497724966 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c017070 con 0x7f439c0b6d70 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.097+0000 7f4393fff640 1 -- 172.21.15.16:0/1497724966 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f438c00c940 con 0x7f439c0b6d70 2024-05-11T01:13:43.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.097+0000 7f4393fff640 1 -- 172.21.15.16:0/1497724966 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c00cd30 con 0x7f439c0b6d70 2024-05-11T01:13:43.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.097+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f439c0c9770 con 0x7f439c0b6d70 2024-05-11T01:13:43.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.097+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f439c0c9d30 con 0x7f439c0b6d70 2024-05-11T01:13:43.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.098+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439c06a5b0 con 0x7f439c0b6d70 2024-05-11T01:13:43.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.099+0000 7f4393fff640 1 -- 172.21.15.16:0/1497724966 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7f438c01a070 con 0x7f439c0b6d70 2024-05-11T01:13:43.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.099+0000 7f4393fff640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f437c0764b0 0x7f437c078970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.099+0000 7f43927fc640 1 -- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f437c0764b0 msgr2=0x7f437c078970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:43.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.099+0000 7f4393fff640 1 -- 172.21.15.16:0/1497724966 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6503+0+0 (secure 0 0 0) 0x7f438c097d50 con 0x7f439c0b6d70 2024-05-11T01:13:43.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.099+0000 7f43927fc640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f437c0764b0 0x7f437c078970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:43.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.103+0000 7f4393fff640 1 -- 172.21.15.16:0/1497724966 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f438c09b030 con 0x7f439c0b6d70 2024-05-11T01:13:43.157 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:43.158+0000 7feaa552f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-11T01:13:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.300+0000 7f43927fc640 1 -- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f437c0764b0 msgr2=0x7f437c078970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.300+0000 7f43927fc640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f437c0764b0 0x7f437c078970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.306+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f439c0b4a30 con 0x7f439c0b6d70 2024-05-11T01:13:43.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.308+0000 7f4393fff640 1 -- 172.21.15.16:0/1497724966 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+18555 (secure 0 0 0) 0x7f438c060b70 con 0x7f439c0b6d70 2024-05-11T01:13:43.307 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:43.307 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":47,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:13:43.256440+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:48.556825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:49.853034+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.174:0/990588653":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/3333657563":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/2159563993":"2024-05-12T01:02:03.135099+0000","172.21.15.174:6833/704865226":"2024-05-12T01:02:03.135099+0000","172.21.15.174:6832/704865226":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/3687919634":"2024-05-12T01:02:03.135099+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":1},{"begin":28,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":49,"length":2},{"begin":55,"length":1},{"begin":60,"length":3},{"begin":66,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":81,"length":3},{"begin":87,"length":1},{"begin":93,"length":2},{"begin":98,"length":1},{"begin":103,"length":2},{"begin":108,"length":1},{"begin":193,"length":29}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":103,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":14,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":21,"length":2},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":33,"length":1},{"begin":36,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":43,"length":1},{"begin":46,"length":1},{"begin":48,"length":1},{"begin":54,"length":1},{"begin":57,"length":1},{"begin":59,"length":1},{"begin":65,"length":1},{"begin":67,"length":2},{"begin":70,"length":1},{"begin":75,"length":1},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":88,"length":2},{"begin":91,"length":2},{"begin":97,"length":1},{"begin":99,"length":2},{"begin":102,"length":1},{"begin":107,"length":1},{"begin":109,"length":2},{"begin":151,"length":42}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:13:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f437c0764b0 msgr2=0x7f437c078970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f437c0764b0 0x7f437c078970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b6d70 msgr2=0x7f439c0c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b6d70 0x7f439c0c8e20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f438c00e8a0 tx=0x7f438c00ed60 comp rx=0 tx=0).stop 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 shutdown_connections 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f437c0764b0 0x7f437c078970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f439c0bab70 0x7f439c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f439c0b8380 0x7f439c162410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 --2- 172.21.15.16:0/1497724966 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f439c0b6d70 0x7f439c0c8e20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 >> 172.21.15.16:0/1497724966 conn(0x7f439c074140 msgr2=0x7f439c0b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 shutdown_connections 2024-05-11T01:13:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.310+0000 7f43a1538640 1 -- 172.21.15.16:0/1497724966 wait complete. 2024-05-11T01:13:43.321 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-11T01:13:43.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:13:43.379 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:43.381+0000 7f10bffd6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-11T01:13:43.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.427+0000 7ff865a54640 1 Processor -- start 2024-05-11T01:13:43.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.427+0000 7ff865a54640 1 -- start start 2024-05-11T01:13:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff865a54640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8600d0000 0x7ff8600d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff865a54640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600d3bf0 0x7ff8600d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff865a54640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8600d0920 con 0x7ff8600baed0 2024-05-11T01:13:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff865a54640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff860163820 con 0x7ff8600d0000 2024-05-11T01:13:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff865a54640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff860163b00 con 0x7ff8600d3bf0 2024-05-11T01:13:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff85effd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8600d0000 0x7ff8600d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff85effd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8600d0000 0x7ff8600d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49320/0 (socket says 172.21.15.16:49320) 2024-05-11T01:13:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff85effd640 1 -- 172.21.15.16:0/1089410500 learned_addr learned my addr 172.21.15.16:0/1089410500 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.428+0000 7ff85f7fe640 1 --2- 172.21.15.16:0/1089410500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600d3bf0 0x7ff8600d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.429+0000 7ff85effd640 1 -- 172.21.15.16:0/1089410500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600d3bf0 msgr2=0x7ff8600d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.429+0000 7ff85effd640 1 --2- 172.21.15.16:0/1089410500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600d3bf0 0x7ff8600d4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.429+0000 7ff85effd640 1 -- 172.21.15.16:0/1089410500 >> v1:172.21.15.174:6789/0 conn(0x7ff8600baed0 legacy=0x7ff860162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.429+0000 7ff85effd640 1 -- 172.21.15.16:0/1089410500 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8600d33f0 con 0x7ff8600d0000 2024-05-11T01:13:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.429+0000 7ff85f7fe640 1 --2- 172.21.15.16:0/1089410500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600d3bf0 0x7ff8600d4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.429+0000 7ff85effd640 1 --2- 172.21.15.16:0/1089410500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d0000 0x7ff8600d03e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff848009870 tx=0x7ff84802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4242e6ace3623ded server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff85dffb640 1 -- 172.21.15.16:0/1089410500 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848037070 con 0x7ff8600d0000 2024-05-11T01:13:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff85dffb640 1 -- 172.21.15.16:0/1089410500 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff848032440 con 0x7ff8600d0000 2024-05-11T01:13:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff85dffb640 1 -- 172.21.15.16:0/1089410500 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848032810 con 0x7ff8600d0000 2024-05-11T01:13:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff865a54640 1 -- 172.21.15.16:0/1089410500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d0000 msgr2=0x7ff8600d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff865a54640 1 --2- 172.21.15.16:0/1089410500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d0000 0x7ff8600d03e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff848009870 tx=0x7ff84802a270 comp rx=0 tx=0).stop 2024-05-11T01:13:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff865a54640 1 -- 172.21.15.16:0/1089410500 shutdown_connections 2024-05-11T01:13:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff865a54640 1 --2- 172.21.15.16:0/1089410500 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600d3bf0 0x7ff8600d4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff865a54640 1 --2- 172.21.15.16:0/1089410500 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d0000 0x7ff8600d03e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff865a54640 1 -- 172.21.15.16:0/1089410500 >> 172.21.15.16:0/1089410500 conn(0x7ff860074140 msgr2=0x7ff8600b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff865a54640 1 -- 172.21.15.16:0/1089410500 shutdown_connections 2024-05-11T01:13:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.430+0000 7ff865a54640 1 -- 172.21.15.16:0/1089410500 wait complete. 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.432+0000 7ff865a54640 1 Processor -- start 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.432+0000 7ff865a54640 1 -- start start 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.432+0000 7ff865a54640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600baed0 0x7ff8600c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.432+0000 7ff865a54640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8600d0000 0x7ff8600ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.432+0000 7ff865a54640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d3bf0 0x7ff8600caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.432+0000 7ff865a54640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff86015f750 con 0x7ff8600d3bf0 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.432+0000 7ff865a54640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff860163de0 con 0x7ff8600d0000 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.432+0000 7ff865a54640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff86015f8d0 con 0x7ff8600baed0 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d3bf0 0x7ff8600caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d3bf0 0x7ff8600caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49326/0 (socket says 172.21.15.16:49326) 2024-05-11T01:13:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 -- 172.21.15.16:0/2216810998 learned_addr learned my addr 172.21.15.16:0/2216810998 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85e7fc640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8600d0000 0x7ff8600ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85effd640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600baed0 0x7ff8600c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 -- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600baed0 msgr2=0x7ff8600c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600baed0 0x7ff8600c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 -- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8600d0000 msgr2=0x7ff8600ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8600d0000 0x7ff8600ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 -- 172.21.15.16:0/2216810998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8600cdfe0 con 0x7ff8600d3bf0 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff85f7fe640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d3bf0 0x7ff8600caba0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff858009fa0 tx=0x7ff85800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff857fff640 1 -- 172.21.15.16:0/2216810998 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85801a070 con 0x7ff8600d3bf0 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff857fff640 1 -- 172.21.15.16:0/2216810998 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff858003bb0 con 0x7ff8600d3bf0 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff857fff640 1 -- 172.21.15.16:0/2216810998 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858004030 con 0x7ff8600d3bf0 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8600ce2c0 con 0x7ff8600d3bf0 2024-05-11T01:13:43.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.433+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8600ce880 con 0x7ff8600d3bf0 2024-05-11T01:13:43.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.434+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff86006a5b0 con 0x7ff8600d3bf0 2024-05-11T01:13:43.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.435+0000 7ff857fff640 1 -- 172.21.15.16:0/2216810998 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7ff85801d070 con 0x7ff8600d3bf0 2024-05-11T01:13:43.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.436+0000 7ff857fff640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff840076480 0x7ff840078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.436+0000 7ff857fff640 1 -- 172.21.15.16:0/2216810998 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6963+0+0 (secure 0 0 0) 0x7ff858098100 con 0x7ff8600d3bf0 2024-05-11T01:13:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.436+0000 7ff85effd640 1 -- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff840076480 msgr2=0x7ff840078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.436+0000 7ff85effd640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff840076480 0x7ff840078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.440+0000 7ff857fff640 1 -- 172.21.15.16:0/2216810998 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff858010070 con 0x7ff8600d3bf0 2024-05-11T01:13:43.502 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:43.504+0000 7f10bffd6040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-11T01:13:43.509 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:43.510+0000 7feaa552f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-11T01:13:43.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.637+0000 7ff85effd640 1 -- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff840076480 msgr2=0x7ff840078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:43.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.637+0000 7ff85effd640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff840076480 0x7ff840078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:43.644 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:43.645+0000 7feaa552f040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-11T01:13:43.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.676+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8601556c0 con 0x7ff8600d3bf0 2024-05-11T01:13:43.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.676+0000 7ff857fff640 1 -- 172.21.15.16:0/2216810998 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7ff858060c40 con 0x7ff8600d3bf0 2024-05-11T01:13:43.676 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:43.676 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/325711019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":325711019},{"type":"v1","addr":"172.21.15.174:6836","nonce":325711019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2354391599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2354391599},{"type":"v1","addr":"172.21.15.16:6835","nonce":2354391599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4809,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2932760959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2932760959},{"type":"v1","addr":"172.21.15.174:6837","nonce":2932760959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:50.892297+0000","modified":"2024-05-11T01:01:53.909794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4812},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4812":{"gid":4812,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/2086463820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2086463820},{"type":"v1","addr":"172.21.15.16:6834","nonce":2086463820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4812,"qdb_cluster":[4812]},"id":2}]} 2024-05-11T01:13:43.676 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-05-11T01:13:43.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff840076480 msgr2=0x7ff840078940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:43.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff840076480 0x7ff840078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d3bf0 msgr2=0x7ff8600caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d3bf0 0x7ff8600caba0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff858009fa0 tx=0x7ff85800d560 comp rx=0 tx=0).stop 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 shutdown_connections 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7ff840076480 0x7ff840078940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600d3bf0 0x7ff8600caba0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8600d0000 0x7ff8600ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 --2- 172.21.15.16:0/2216810998 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8600baed0 0x7ff8600c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 >> 172.21.15.16:0/2216810998 conn(0x7ff860074140 msgr2=0x7ff860154850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 shutdown_connections 2024-05-11T01:13:43.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.679+0000 7ff865a54640 1 -- 172.21.15.16:0/2216810998 wait complete. 2024-05-11T01:13:43.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:13:43.722 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:43.724+0000 7f10bffd6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-11T01:13:43.772 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:43.774+0000 7f10bffd6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-11T01:13:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.796+0000 7f6e9559e640 1 Processor -- start 2024-05-11T01:13:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.797+0000 7f6e9559e640 1 -- start start 2024-05-11T01:13:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.797+0000 7f6e9559e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6e9015f630 0x7f6e900d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.797+0000 7f6e9559e640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e9006d760 0x7f6e900d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.797+0000 7f6e9559e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9015fa10 con 0x7f6e900b0d10 2024-05-11T01:13:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.797+0000 7f6e9559e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6e900d1460 con 0x7f6e9015f630 2024-05-11T01:13:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.797+0000 7f6e9559e640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f6e900b05a0 con 0x7f6e9006d760 2024-05-11T01:13:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.798+0000 7f6e8ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6e9015f630 0x7f6e900d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.798+0000 7f6e8ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6e9015f630 0x7f6e900d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49334/0 (socket says 172.21.15.16:49334) 2024-05-11T01:13:43.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.798+0000 7f6e8ffff640 1 -- 172.21.15.16:0/2616205494 learned_addr learned my addr 172.21.15.16:0/2616205494 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:43.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.798+0000 7f6e94d9d640 1 --2- 172.21.15.16:0/2616205494 >> v2:172.21.15.174:3300/0 conn(0x7f6e9006d760 0x7f6e900d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.798+0000 7f6e8ffff640 1 -- 172.21.15.16:0/2616205494 >> v2:172.21.15.174:3300/0 conn(0x7f6e9006d760 msgr2=0x7f6e900d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:43.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.798+0000 7f6e8ffff640 1 --2- 172.21.15.16:0/2616205494 >> v2:172.21.15.174:3300/0 conn(0x7f6e9006d760 0x7f6e900d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.798+0000 7f6e8ffff640 1 -- 172.21.15.16:0/2616205494 >> v1:172.21.15.174:6789/0 conn(0x7f6e900b0d10 legacy=0x7f6e900cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.798+0000 7f6e8ffff640 1 -- 172.21.15.16:0/2616205494 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e900b0ad0 con 0x7f6e9015f630 2024-05-11T01:13:43.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.799+0000 7f6e8ffff640 1 --2- 172.21.15.16:0/2616205494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e9015f630 0x7f6e900d07c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e90074200 tx=0x7f6e8002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c09cc507e9d89f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:43.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.799+0000 7f6e8f7fe640 1 -- 172.21.15.16:0/2616205494 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80037070 con 0x7f6e9015f630 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.799+0000 7f6e8f7fe640 1 -- 172.21.15.16:0/2616205494 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e80032440 con 0x7f6e9015f630 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.799+0000 7f6e8f7fe640 1 -- 172.21.15.16:0/2616205494 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80032810 con 0x7f6e9015f630 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.799+0000 7f6e9559e640 1 -- 172.21.15.16:0/2616205494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e9015f630 msgr2=0x7f6e900d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.799+0000 7f6e9559e640 1 --2- 172.21.15.16:0/2616205494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e9015f630 0x7f6e900d07c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6e90074200 tx=0x7f6e8002a150 comp rx=0 tx=0).stop 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.800+0000 7f6e9559e640 1 -- 172.21.15.16:0/2616205494 shutdown_connections 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.800+0000 7f6e9559e640 1 --2- 172.21.15.16:0/2616205494 >> v2:172.21.15.174:3300/0 conn(0x7f6e9006d760 0x7f6e900d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.800+0000 7f6e9559e640 1 --2- 172.21.15.16:0/2616205494 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e9015f630 0x7f6e900d07c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.800+0000 7f6e9559e640 1 -- 172.21.15.16:0/2616205494 >> 172.21.15.16:0/2616205494 conn(0x7f6e900ce0d0 msgr2=0x7f6e900ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.800+0000 7f6e9559e640 1 -- 172.21.15.16:0/2616205494 shutdown_connections 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.800+0000 7f6e9559e640 1 -- 172.21.15.16:0/2616205494 wait complete. 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.801+0000 7f6e9559e640 1 Processor -- start 2024-05-11T01:13:43.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.801+0000 7f6e9559e640 1 -- start start 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e9559e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9006d760 0x7f6e90153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e9559e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e900b0d10 0x7f6e900b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e9559e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e9015f630 0x7f6e901620e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e9559e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90068260 con 0x7f6e900b0d10 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e9559e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90068820 con 0x7f6e9006d760 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e9559e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6e90068540 con 0x7f6e9015f630 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e900b0d10 0x7f6e900b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e8ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9006d760 0x7f6e90153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e900b0d10 0x7f6e900b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49344/0 (socket says 172.21.15.16:49344) 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e8ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9006d760 0x7f6e90153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:59448/0 (socket says 172.21.15.16:59448) 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e87fff640 1 -- 172.21.15.16:0/739413059 learned_addr learned my addr 172.21.15.16:0/739413059 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e94d9d640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e9015f630 0x7f6e901620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e8ffff640 1 -- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e9015f630 msgr2=0x7f6e901620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e8ffff640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e9015f630 0x7f6e901620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e8ffff640 1 -- 172.21.15.16:0/739413059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e900b0d10 msgr2=0x7f6e900b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e8ffff640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e900b0d10 0x7f6e900b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e8ffff640 1 -- 172.21.15.16:0/739413059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90145930 con 0x7f6e9006d760 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e87fff640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e900b0d10 0x7f6e900b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.802+0000 7f6e8ffff640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9006d760 0x7f6e90153250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e80031000 tx=0x7f6e800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.803+0000 7f6e8d7fa640 1 -- 172.21.15.16:0/739413059 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80041030 con 0x7f6e9006d760 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.803+0000 7f6e8d7fa640 1 -- 172.21.15.16:0/739413059 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e80030440 con 0x7f6e9006d760 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.803+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e90145c10 con 0x7f6e9006d760 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.803+0000 7f6e8d7fa640 1 -- 172.21.15.16:0/739413059 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80037040 con 0x7f6e9006d760 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.803+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e901461d0 con 0x7f6e9006d760 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.804+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e90050860 con 0x7f6e9006d760 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.804+0000 7f6e8d7fa640 1 -- 172.21.15.16:0/739413059 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7f6e80044070 con 0x7f6e9006d760 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.805+0000 7f6e8d7fa640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6e70076480 0x7f6e70078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.805+0000 7f6e87fff640 1 -- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6e70076480 msgr2=0x7f6e70078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.805+0000 7f6e8d7fa640 1 -- 172.21.15.16:0/739413059 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6963+0+0 (secure 0 0 0) 0x7f6e800b8240 con 0x7f6e9006d760 2024-05-11T01:13:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.805+0000 7f6e87fff640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6e70076480 0x7f6e70078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:43.809+0000 7f6e8d7fa640 1 -- 172.21.15.16:0/739413059 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6e80080e70 con 0x7f6e9006d760 2024-05-11T01:13:43.876 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:43.877+0000 7feaa552f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-11T01:13:43.890 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:43.892+0000 7f10bffd6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-11T01:13:43.929 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:43.930+0000 7feaa552f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-11T01:13:44.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.006+0000 7f6e87fff640 1 -- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6e70076480 msgr2=0x7f6e70078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:44.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.006+0000 7f6e87fff640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6e70076480 0x7f6e70078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:44.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.046+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e9006f9c0 con 0x7f6e9006d760 2024-05-11T01:13:44.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.047+0000 7f6e8d7fa640 1 -- 172.21.15.16:0/739413059 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f6e80085170 con 0x7f6e9006d760 2024-05-11T01:13:44.046 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/325711019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":325711019},{"type":"v1","addr":"172.21.15.174:6836","nonce":325711019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2354391599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2354391599},{"type":"v1","addr":"172.21.15.16:6835","nonce":2354391599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4809,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2932760959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2932760959},{"type":"v1","addr":"172.21.15.174:6837","nonce":2932760959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:01:50.892297+0000","modified":"2024-05-11T01:01:53.909794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4812},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4812":{"gid":4812,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/2086463820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2086463820},{"type":"v1","addr":"172.21.15.16:6834","nonce":2086463820}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4812,"qdb_cluster":[4812]},"id":2}]} 2024-05-11T01:13:44.046 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6e70076480 msgr2=0x7f6e70078940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6e70076480 0x7f6e70078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9006d760 msgr2=0x7f6e90153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9006d760 0x7f6e90153250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6e80031000 tx=0x7f6e800046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 shutdown_connections 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f6e70076480 0x7f6e70078940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6e9015f630 0x7f6e901620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e900b0d10 0x7f6e900b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 --2- 172.21.15.16:0/739413059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e9006d760 0x7f6e90153250 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 >> 172.21.15.16:0/739413059 conn(0x7f6e900ce0d0 msgr2=0x7f6e9006eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 shutdown_connections 2024-05-11T01:13:44.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.049+0000 7f6e9559e640 1 -- 172.21.15.16:0/739413059 wait complete. 2024-05-11T01:13:44.050 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:44.050+0000 7feaa552f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-11T01:13:44.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:13:44.158 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:44.160+0000 7f10bffd6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-11T01:13:44.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.164+0000 7f4c2c90a640 1 Processor -- start 2024-05-11T01:13:44.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.164+0000 7f4c2c90a640 1 -- start start 2024-05-11T01:13:44.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.165+0000 7f4c2c90a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4c280d0000 0x7f4c280d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.165+0000 7f4c2c90a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c280baed0 0x7f4c28162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.165+0000 7f4c2c90a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c280d0920 con 0x7f4c2806d3e0 2024-05-11T01:13:44.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.165+0000 7f4c2c90a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4c28163820 con 0x7f4c280d0000 2024-05-11T01:13:44.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.165+0000 7f4c2c90a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4c28163b00 con 0x7f4c280baed0 2024-05-11T01:13:44.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c2659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4c280d0000 0x7f4c280d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c2659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4c280d0000 0x7f4c280d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49350/0 (socket says 172.21.15.16:49350) 2024-05-11T01:13:44.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c26d9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4c2806d3e0 0x7f4c2806d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55946/0 (socket says 172.21.15.16:55946) 2024-05-11T01:13:44.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c2659c640 1 -- 172.21.15.16:0/4197120455 learned_addr learned my addr 172.21.15.16:0/4197120455 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:44.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c25d9b640 1 --2- 172.21.15.16:0/4197120455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c280baed0 0x7f4c28162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c2659c640 1 -- 172.21.15.16:0/4197120455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c280baed0 msgr2=0x7f4c28162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:44.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c2659c640 1 --2- 172.21.15.16:0/4197120455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c280baed0 0x7f4c28162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c2659c640 1 -- 172.21.15.16:0/4197120455 >> v1:172.21.15.16:6789/0 conn(0x7f4c2806d3e0 legacy=0x7f4c2806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.166+0000 7f4c2659c640 1 -- 172.21.15.16:0/4197120455 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c280d33f0 con 0x7f4c280d0000 2024-05-11T01:13:44.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.167+0000 7f4c2659c640 1 --2- 172.21.15.16:0/4197120455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280d0000 0x7f4c280d03e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009870 tx=0x7f4c1802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257a623675a2f0ff server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:44.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.167+0000 7f4c2559a640 1 -- 172.21.15.16:0/4197120455 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18037070 con 0x7f4c280d0000 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.167+0000 7f4c2559a640 1 -- 172.21.15.16:0/4197120455 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c18032440 con 0x7f4c280d0000 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.167+0000 7f4c2559a640 1 -- 172.21.15.16:0/4197120455 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18032810 con 0x7f4c280d0000 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.167+0000 7f4c2c90a640 1 -- 172.21.15.16:0/4197120455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280d0000 msgr2=0x7f4c280d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.167+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/4197120455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280d0000 0x7f4c280d03e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009870 tx=0x7f4c1802a250 comp rx=0 tx=0).stop 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.168+0000 7f4c2c90a640 1 -- 172.21.15.16:0/4197120455 shutdown_connections 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.168+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/4197120455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c280baed0 0x7f4c28162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.168+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/4197120455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280d0000 0x7f4c280d03e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.168+0000 7f4c2c90a640 1 -- 172.21.15.16:0/4197120455 >> 172.21.15.16:0/4197120455 conn(0x7f4c28074140 msgr2=0x7f4c280b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.168+0000 7f4c2c90a640 1 -- 172.21.15.16:0/4197120455 shutdown_connections 2024-05-11T01:13:44.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.168+0000 7f4c2c90a640 1 -- 172.21.15.16:0/4197120455 wait complete. 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.169+0000 7f4c2c90a640 1 Processor -- start 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.169+0000 7f4c2c90a640 1 -- start start 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c2c90a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c2806d3e0 0x7f4c280caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c2c90a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280baed0 0x7f4c28162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c2c90a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c280d0000 0x7f4c2815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c2c90a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c28163de0 con 0x7f4c280baed0 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c2c90a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4c28163510 con 0x7f4c280d0000 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c2c90a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2815f750 con 0x7f4c2806d3e0 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280baed0 0x7f4c28162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280baed0 0x7f4c28162240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49354/0 (socket says 172.21.15.16:49354) 2024-05-11T01:13:44.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c2659c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c2806d3e0 0x7f4c280caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 -- 172.21.15.16:0/2915337096 learned_addr learned my addr 172.21.15.16:0/2915337096 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c26d9d640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c280d0000 0x7f4c2815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 -- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c2806d3e0 msgr2=0x7f4c280caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c2806d3e0 0x7f4c280caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 -- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c280d0000 msgr2=0x7f4c2815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c280d0000 0x7f4c2815ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 -- 172.21.15.16:0/2915337096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c28161db0 con 0x7f4c280baed0 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c2659c640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c2806d3e0 0x7f4c280caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.170+0000 7f4c25d9b640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280baed0 0x7f4c28162240 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00e8a0 tx=0x7f4c1c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.171+0000 7f4c16ffd640 1 -- 172.21.15.16:0/2915337096 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c017070 con 0x7f4c280baed0 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.171+0000 7f4c16ffd640 1 -- 172.21.15.16:0/2915337096 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1c00c940 con 0x7f4c280baed0 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.171+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2815c4d0 con 0x7f4c280baed0 2024-05-11T01:13:44.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.171+0000 7f4c16ffd640 1 -- 172.21.15.16:0/2915337096 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00cd30 con 0x7f4c280baed0 2024-05-11T01:13:44.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.171+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c28162780 con 0x7f4c280baed0 2024-05-11T01:13:44.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.172+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2806a5b0 con 0x7f4c280baed0 2024-05-11T01:13:44.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.172+0000 7f4c16ffd640 1 -- 172.21.15.16:0/2915337096 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7f4c1c01a070 con 0x7f4c280baed0 2024-05-11T01:13:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.173+0000 7f4c16ffd640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4c08076480 0x7f4c08078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.173+0000 7f4c2659c640 1 -- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4c08076480 msgr2=0x7f4c08078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.173+0000 7f4c16ffd640 1 -- 172.21.15.16:0/2915337096 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6963+0+0 (secure 0 0 0) 0x7f4c1c097e90 con 0x7f4c280baed0 2024-05-11T01:13:44.174 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.173+0000 7f4c2659c640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4c08076480 0x7f4c08078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:44.176 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.177+0000 7f4c16ffd640 1 -- 172.21.15.16:0/2915337096 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4c1c060b70 con 0x7f4c280baed0 2024-05-11T01:13:44.202 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:44.204+0000 7f10bffd6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-11T01:13:44.342 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:44.343+0000 7feaa552f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-11T01:13:44.345 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:44.347+0000 7f10bffd6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-11T01:13:44.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.370+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c2815c280 con 0x7f4c280baed0 2024-05-11T01:13:44.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.372+0000 7f4c16ffd640 1 -- 172.21.15.16:0/2915337096 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+18555 (secure 0 0 0) 0x7f4c1c064e70 con 0x7f4c280baed0 2024-05-11T01:13:44.371 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:44.371 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":47,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:13:43.256440+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:01:48.556825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-11T01:01:49.853034+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":47,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.174:0/990588653":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/3333657563":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/2159563993":"2024-05-12T01:02:03.135099+0000","172.21.15.174:6833/704865226":"2024-05-12T01:02:03.135099+0000","172.21.15.174:6832/704865226":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/3687919634":"2024-05-12T01:02:03.135099+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":1},{"begin":28,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":49,"length":2},{"begin":55,"length":1},{"begin":60,"length":3},{"begin":66,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":81,"length":3},{"begin":87,"length":1},{"begin":93,"length":2},{"begin":98,"length":1},{"begin":103,"length":2},{"begin":108,"length":1},{"begin":193,"length":29}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":103,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":14,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":21,"length":2},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":33,"length":1},{"begin":36,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":43,"length":1},{"begin":46,"length":1},{"begin":48,"length":1},{"begin":54,"length":1},{"begin":57,"length":1},{"begin":59,"length":1},{"begin":65,"length":1},{"begin":67,"length":2},{"begin":70,"length":1},{"begin":75,"length":1},{"begin":77,"length":2},{"begin":80,"length":1},{"begin":86,"length":1},{"begin":88,"length":2},{"begin":91,"length":2},{"begin":97,"length":1},{"begin":99,"length":2},{"begin":102,"length":1},{"begin":107,"length":1},{"begin":109,"length":2},{"begin":151,"length":42}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:13:44.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2659c640 1 -- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4c08076480 msgr2=0x7f4c08078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2659c640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4c08076480 0x7f4c08078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4c08076480 msgr2=0x7f4c08078940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4c08076480 0x7f4c08078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280baed0 msgr2=0x7f4c28162240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280baed0 0x7f4c28162240 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00e8a0 tx=0x7f4c1c00ed60 comp rx=0 tx=0).stop 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 shutdown_connections 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7f4c08076480 0x7f4c08078940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c280d0000 0x7f4c2815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c280baed0 0x7f4c28162240 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 --2- 172.21.15.16:0/2915337096 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4c2806d3e0 0x7f4c280caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 >> 172.21.15.16:0/2915337096 conn(0x7f4c28074140 msgr2=0x7f4c280ba4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:44.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 shutdown_connections 2024-05-11T01:13:44.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.374+0000 7f4c2c90a640 1 -- 172.21.15.16:0/2915337096 wait complete. 2024-05-11T01:13:44.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-11T01:13:44.389 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:44.390+0000 7feaa552f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-11T01:13:44.478 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:44.480+0000 7f10bffd6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-11T01:13:44.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.491+0000 7fd173a54640 1 Processor -- start 2024-05-11T01:13:44.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.491+0000 7fd173a54640 1 -- start start 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd173a54640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0d0000 0x7fd16c0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd173a54640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c0d0920 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd173a54640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd16c163820 con 0x7fd16c0baed0 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd173a54640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c163b00 con 0x7fd16c0d0000 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd171ff1640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd16c0d3bf0 0x7fd16c0d4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55954/0 (socket says 172.21.15.16:55954) 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd171ff1640 1 -- 172.21.15.16:0/1985375087 learned_addr learned my addr 172.21.15.16:0/1985375087 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd1717f0640 1 --2- 172.21.15.16:0/1985375087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0d0000 0x7fd16c0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd163fff640 1 -- 172.21.15.16:0/1985375087 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337043362 0 0) 0x7fd16c0d0920 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd163fff640 1 -- 172.21.15.16:0/1985375087 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd158003520 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd163fff640 1 -- 172.21.15.16:0/1985375087 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421015792 0 0) 0x7fd16c163820 con 0x7fd16c0baed0 2024-05-11T01:13:44.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd163fff640 1 -- 172.21.15.16:0/1985375087 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd16c0d0920 con 0x7fd16c0baed0 2024-05-11T01:13:44.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd1717f0640 1 -- 172.21.15.16:0/1985375087 >> v1:172.21.15.174:6789/0 conn(0x7fd16c0baed0 legacy=0x7fd16c162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd1717f0640 1 -- 172.21.15.16:0/1985375087 >> v1:172.21.15.16:6789/0 conn(0x7fd16c0d3bf0 legacy=0x7fd16c0d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.492+0000 7fd1717f0640 1 -- 172.21.15.16:0/1985375087 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c0d33f0 con 0x7fd16c0d0000 2024-05-11T01:13:44.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.493+0000 7fd1717f0640 1 --2- 172.21.15.16:0/1985375087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0d0000 0x7fd16c0d03e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1680097d0 tx=0x7fd16802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28df207d7e204a00 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.493+0000 7fd163fff640 1 -- 172.21.15.16:0/1985375087 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168037070 con 0x7fd16c0d0000 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.493+0000 7fd163fff640 1 -- 172.21.15.16:0/1985375087 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168032440 con 0x7fd16c0d0000 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.493+0000 7fd163fff640 1 -- 172.21.15.16:0/1985375087 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1680327f0 con 0x7fd16c0d0000 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.494+0000 7fd173a54640 1 -- 172.21.15.16:0/1985375087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0d0000 msgr2=0x7fd16c0d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.494+0000 7fd173a54640 1 --2- 172.21.15.16:0/1985375087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0d0000 0x7fd16c0d03e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd1680097d0 tx=0x7fd16802a210 comp rx=0 tx=0).stop 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.494+0000 7fd173a54640 1 -- 172.21.15.16:0/1985375087 shutdown_connections 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.494+0000 7fd173a54640 1 --2- 172.21.15.16:0/1985375087 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0d0000 0x7fd16c0d03e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.494+0000 7fd173a54640 1 -- 172.21.15.16:0/1985375087 >> 172.21.15.16:0/1985375087 conn(0x7fd16c074140 msgr2=0x7fd16c0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.494+0000 7fd173a54640 1 -- 172.21.15.16:0/1985375087 shutdown_connections 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.494+0000 7fd173a54640 1 -- 172.21.15.16:0/1985375087 wait complete. 2024-05-11T01:13:44.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.495+0000 7fd173a54640 1 Processor -- start 2024-05-11T01:13:44.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd173a54640 1 -- start start 2024-05-11T01:13:44.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd173a54640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0baed0 0x7fd16c0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd173a54640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0d0000 0x7fd16c0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd173a54640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd16c0d3bf0 0x7fd16c0b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd173a54640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c15f750 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd173a54640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd16c163de0 con 0x7fd16c0d0000 2024-05-11T01:13:44.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd173a54640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd16c15f8d0 con 0x7fd16c0baed0 2024-05-11T01:13:44.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd171ff1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd16c0d3bf0 0x7fd16c0b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd171ff1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd16c0d3bf0 0x7fd16c0b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49370/0 (socket says 172.21.15.16:49370) 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd171ff1640 1 -- 172.21.15.16:0/1577485453 learned_addr learned my addr 172.21.15.16:0/1577485453 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.496+0000 7fd170fef640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0d0000 0x7fd16c0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd1717f0640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0baed0 0x7fd16c0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd171ff1640 1 -- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0baed0 msgr2=0x7fd16c0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd171ff1640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0baed0 0x7fd16c0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd171ff1640 1 -- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0d0000 msgr2=0x7fd16c0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd171ff1640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0d0000 0x7fd16c0cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd171ff1640 1 -- 172.21.15.16:0/1577485453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c0cb510 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd171ff1640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd16c0d3bf0 0x7fd16c0b9da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd16400cb40 tx=0x7fd16400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd161ffb640 1 -- 172.21.15.16:0/1577485453 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16400aca0 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd161ffb640 1 -- 172.21.15.16:0/1577485453 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd164012400 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd16c15fe10 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd161ffb640 1 -- 172.21.15.16:0/1577485453 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16400ae60 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.497+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd16c1603d0 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.498+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16c06a5b0 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.499+0000 7fd161ffb640 1 -- 172.21.15.16:0/1577485453 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7fd164012830 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.500+0000 7fd161ffb640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd150076480 0x7fd150078940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.500+0000 7fd1717f0640 1 -- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd150076480 msgr2=0x7fd150078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:44.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.500+0000 7fd161ffb640 1 -- 172.21.15.16:0/1577485453 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6963+0+0 (secure 0 0 0) 0x7fd1640983e0 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.500+0000 7fd1717f0640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd150076480 0x7fd150078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:44.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.504+0000 7fd161ffb640 1 -- 172.21.15.16:0/1577485453 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd16c0cb510 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.529 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:44.531+0000 7f10bffd6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-11T01:13:44.545 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:44.546+0000 7feaa552f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-11T01:13:44.584 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:44.585+0000 7f10bffd6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-11T01:13:44.626 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:44.628+0000 7f10bffd6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-11T01:13:44.687 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:44.688+0000 7feaa552f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-11T01:13:44.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.701+0000 7fd1717f0640 1 -- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd150076480 msgr2=0x7fd150078940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:44.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.701+0000 7fd1717f0640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd150076480 0x7fd150078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:44.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.735+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd16c0b7310 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.735 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-05-11T01:13:44.736+0000 7fb848c8f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-11T01:13:44.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.737+0000 7fd161ffb640 1 -- 172.21.15.16:0/1577485453 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7fd164060ee0 con 0x7fd16c0d3bf0 2024-05-11T01:13:44.736 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-11T01:13:44.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd150076480 msgr2=0x7fd150078940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:44.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd150076480 0x7fd150078940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd16c0d3bf0 msgr2=0x7fd16c0b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd16c0d3bf0 0x7fd16c0b9da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd16400cb40 tx=0x7fd16400a060 comp rx=0 tx=0).stop 2024-05-11T01:13:44.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 shutdown_connections 2024-05-11T01:13:44.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fd150076480 0x7fd150078940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd16c0d3bf0 0x7fd16c0b9da0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd16c0d0000 0x7fd16c0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 --2- 172.21.15.16:0/1577485453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd16c0baed0 0x7fd16c0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 >> 172.21.15.16:0/1577485453 conn(0x7fd16c074140 msgr2=0x7fd16c0b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:44.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.740+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 shutdown_connections 2024-05-11T01:13:44.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.741+0000 7fd173a54640 1 -- 172.21.15.16:0/1577485453 wait complete. 2024-05-11T01:13:44.741 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:44.741+0000 7feaa552f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-11T01:13:44.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-11T01:13:44.783 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-05-11T01:13:44.800 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:44.801+0000 7feaa552f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-11T01:13:44.847 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:44.847+0000 7feaa552f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-11T01:13:44.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.891+0000 7fa2992bd640 1 Processor -- start 2024-05-11T01:13:44.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.891+0000 7fa2992bd640 1 -- start start 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.892+0000 7fa2992bd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa294163010 0x7fa2940b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.892+0000 7fa2992bd640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2941635d0 con 0x7fa2940bae40 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.892+0000 7fa2992bd640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2941638b0 con 0x7fa2940b72c0 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.892+0000 7fa2992bd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa2940b76f0 con 0x7fa294163010 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.892+0000 7fa292ffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa2940bae40 0x7fa2941604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55962/0 (socket says 172.21.15.16:55962) 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.892+0000 7fa292ffd640 1 -- 172.21.15.16:0/1260208918 learned_addr learned my addr 172.21.15.16:0/1260208918 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.892+0000 7fa2927fc640 1 --2- 172.21.15.16:0/1260208918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa294163010 0x7fa2940b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.893+0000 7fa291ffb640 1 -- 172.21.15.16:0/1260208918 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592883493 0 0) 0x7fa2941635d0 con 0x7fa2940bae40 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.893+0000 7fa291ffb640 1 -- 172.21.15.16:0/1260208918 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa280003520 con 0x7fa2940bae40 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.893+0000 7fa291ffb640 1 -- 172.21.15.16:0/1260208918 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 795992231 0 0) 0x7fa2941638b0 con 0x7fa2940b72c0 2024-05-11T01:13:44.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.893+0000 7fa291ffb640 1 -- 172.21.15.16:0/1260208918 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2941635d0 con 0x7fa2940b72c0 2024-05-11T01:13:44.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.893+0000 7fa2927fc640 1 -- 172.21.15.16:0/1260208918 >> v1:172.21.15.174:6789/0 conn(0x7fa2940b72c0 legacy=0x7fa2940b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.893+0000 7fa2927fc640 1 -- 172.21.15.16:0/1260208918 >> v1:172.21.15.16:6789/0 conn(0x7fa2940bae40 legacy=0x7fa2941604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.893+0000 7fa2927fc640 1 -- 172.21.15.16:0/1260208918 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa294163b90 con 0x7fa294163010 2024-05-11T01:13:44.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.893+0000 7fa2927fc640 1 --2- 172.21.15.16:0/1260208918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa294163010 0x7fa2940b6d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2840097d0 tx=0x7fa28402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c25ea4f29dcd86b server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:44.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa291ffb640 1 -- 172.21.15.16:0/1260208918 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284037070 con 0x7fa294163010 2024-05-11T01:13:44.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa291ffb640 1 -- 172.21.15.16:0/1260208918 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa284032440 con 0x7fa294163010 2024-05-11T01:13:44.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa291ffb640 1 -- 172.21.15.16:0/1260208918 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284032810 con 0x7fa294163010 2024-05-11T01:13:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa2992bd640 1 -- 172.21.15.16:0/1260208918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa294163010 msgr2=0x7fa2940b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa2992bd640 1 --2- 172.21.15.16:0/1260208918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa294163010 0x7fa2940b6d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2840097d0 tx=0x7fa28402a180 comp rx=0 tx=0).stop 2024-05-11T01:13:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa2992bd640 1 -- 172.21.15.16:0/1260208918 shutdown_connections 2024-05-11T01:13:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa2992bd640 1 --2- 172.21.15.16:0/1260208918 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa294163010 0x7fa2940b6d80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa2992bd640 1 -- 172.21.15.16:0/1260208918 >> 172.21.15.16:0/1260208918 conn(0x7fa294074140 msgr2=0x7fa2940d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa2992bd640 1 -- 172.21.15.16:0/1260208918 shutdown_connections 2024-05-11T01:13:44.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.894+0000 7fa2992bd640 1 -- 172.21.15.16:0/1260208918 wait complete. 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.896+0000 7fa2992bd640 1 Processor -- start 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.896+0000 7fa2992bd640 1 -- start start 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.896+0000 7fa2992bd640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940b72c0 0x7fa29414b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.896+0000 7fa2992bd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2940bae40 0x7fa2940c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.896+0000 7fa2992bd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa294163010 0x7fa2940c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.896+0000 7fa2992bd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2940d46f0 con 0x7fa294163010 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.896+0000 7fa2992bd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa2940bb220 con 0x7fa2940bae40 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.896+0000 7fa2992bd640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa2940d4870 con 0x7fa2940b72c0 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa294163010 0x7fa2940c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa294163010 0x7fa2940c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49404/0 (socket says 172.21.15.16:49404) 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 -- 172.21.15.16:0/2591552486 learned_addr learned my addr 172.21.15.16:0/2591552486 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:44.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa292ffd640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940b72c0 0x7fa29414b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2927fc640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2940bae40 0x7fa2940c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 -- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940b72c0 msgr2=0x7fa29414b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940b72c0 0x7fa29414b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 -- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2940bae40 msgr2=0x7fa2940c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2940bae40 0x7fa2940c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 -- 172.21.15.16:0/2591552486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2940ce1d0 con 0x7fa294163010 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2937fe640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa294163010 0x7fa2940c9ed0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00c3c0 tx=0x7fa28c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c017070 con 0x7fa294163010 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c0052d0 con 0x7fa294163010 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2940ce4b0 con 0x7fa294163010 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c003830 con 0x7fa294163010 2024-05-11T01:13:44.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.897+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2940cea70 con 0x7fa294163010 2024-05-11T01:13:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.899+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa29406a5b0 con 0x7fa294163010 2024-05-11T01:13:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.899+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 14) ==== 98372+0+0 (secure 0 0 0) 0x7fa28c01a070 con 0x7fa294163010 2024-05-11T01:13:44.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.900+0000 7fa28b7fe640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa2740764b0 0x7fa274078970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.900+0000 7fa292ffd640 1 -- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa2740764b0 msgr2=0x7fa274078970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.900+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6417+0+0 (secure 0 0 0) 0x7fa28c096d10 con 0x7fa294163010 2024-05-11T01:13:44.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.900+0000 7fa292ffd640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa2740764b0 0x7fa274078970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-11T01:13:44.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:44.904+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa28c05fc10 con 0x7fa294163010 2024-05-11T01:13:45.021 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.021+0000 7f10bffd6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-11T01:13:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.101+0000 7fa292ffd640 1 -- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa2740764b0 msgr2=0x7fa274078970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6832/2127220129 2024-05-11T01:13:45.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.101+0000 7fa292ffd640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa2740764b0 0x7fa274078970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-11T01:13:45.135 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.136+0000 7f10bffd6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-11T01:13:45.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.137+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa2940d2fa0 con 0x7fa294163010 2024-05-11T01:13:45.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.145+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 15) ==== 97912+0+0 (secure 0 0 0) 0x7fa28c09d080 con 0x7fa294163010 2024-05-11T01:13:45.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.146+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa2740764b0 msgr2=0x7fa274078970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-11T01:13:45.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.146+0000 7fa28b7fe640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa2740764b0 0x7fa274078970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.194 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.194+0000 7f1040a90640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.194+0000 7f1040a90640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.194+0000 7f1040a90640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.194+0000 7f1040a90640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.194+0000 7f1040a90640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.195+0000 7f1044297640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.195+0000 7f1044297640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.195+0000 7f1044297640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.195+0000 7f1044297640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.195 INFO:tasks.ceph.mgr.x.smithi174.stderr:2024-05-11T01:13:45.195+0000 7f1044297640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-11T01:13:45.266 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:45.267+0000 7feaa552f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-11T01:13:45.388 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-05-11T01:13:45.389+0000 7feaa552f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-11T01:13:45.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.738+0000 7fa28b7fe640 1 -- 172.21.15.16:0/2591552486 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fa28c06be80 con 0x7fa294163010 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.740+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa294163010 msgr2=0x7fa2940c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.740+0000 7fa2992bd640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa294163010 0x7fa2940c9ed0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00c3c0 tx=0x7fa28c00c880 comp rx=0 tx=0).stop 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.741+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 shutdown_connections 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.741+0000 7fa2992bd640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:6832/2127220129,v1:172.21.15.174:6833/2127220129] conn(0x7fa2740764b0 0x7fa274078970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.741+0000 7fa2992bd640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa294163010 0x7fa2940c9ed0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.741+0000 7fa2992bd640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa2940bae40 0x7fa2940c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.741+0000 7fa2992bd640 1 --2- 172.21.15.16:0/2591552486 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa2940b72c0 0x7fa29414b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.741+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 >> 172.21.15.16:0/2591552486 conn(0x7fa294074140 msgr2=0x7fa2940b93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:45.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.741+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 shutdown_connections 2024-05-11T01:13:45.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.741+0000 7fa2992bd640 1 -- 172.21.15.16:0/2591552486 wait complete. 2024-05-11T01:13:45.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-11T01:13:45.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.906+0000 7fded20fc640 1 Processor -- start 2024-05-11T01:13:45.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.906+0000 7fded20fc640 1 -- start start 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fded20fc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdecc0bacf0 0x7fdecc0d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fded20fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0d2800 0x7fdecc0b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fded20fc640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdecc15fa70 con 0x7fdecc15f690 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fded20fc640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fdecc0d2c70 con 0x7fdecc0bacf0 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fded20fc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdecc0d50e0 con 0x7fdecc0d2800 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fdecb7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdecc15f690 0x7fdecc0d3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55964/0 (socket says 172.21.15.16:55964) 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fdecb7fe640 1 -- 172.21.15.16:0/1619298090 learned_addr learned my addr 172.21.15.16:0/1619298090 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596687067 0 0) 0x7fdecc15fa70 con 0x7fdecc15f690 2024-05-11T01:13:45.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fdecbfff640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0d2800 0x7fdecc0b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fdecaffd640 1 --2- 172.21.15.16:0/1619298090 >> v2:172.21.15.174:3300/0 conn(0x7fdecc0bacf0 0x7fdecc0d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.907+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb4003520 con 0x7fdecc15f690 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1553573813 0 0) 0x7fdeb4003520 con 0x7fdecc15f690 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0d2800 msgr2=0x7fdecc0b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0d2800 0x7fdecc0b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 >> v2:172.21.15.174:3300/0 conn(0x7fdecc0bacf0 msgr2=0x7fdecc0d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 --2- 172.21.15.16:0/1619298090 >> v2:172.21.15.174:3300/0 conn(0x7fdecc0bacf0 0x7fdecc0d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc0d4040 con 0x7fdecc15f690 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fdebc0016f0 con 0x7fdecc15f690 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 >> v1:172.21.15.16:6789/0 conn(0x7fdecc15f690 legacy=0x7fdecc0d3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeb4003a00 0x7fdeb4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4004800 0x7fdeb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0d2800 0x7fdeb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc0d2c70 con 0x7fdeb4003a00 2024-05-11T01:13:45.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc0d50e0 con 0x7fdeb4004800 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb400ba70 con 0x7fdecc0d2800 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdecb7fe640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeb4003a00 0x7fdeb4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdecaffd640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4004800 0x7fdeb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdecbfff640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0d2800 0x7fdeb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdecb7fe640 1 -- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0d2800 msgr2=0x7fdeb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdecb7fe640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0d2800 0x7fdeb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdecb7fe640 1 -- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4004800 msgr2=0x7fdeb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdecb7fe640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4004800 0x7fdeb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.908+0000 7fdecb7fe640 1 -- 172.21.15.16:0/1619298090 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb4003520 con 0x7fdeb4003a00 2024-05-11T01:13:45.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.909+0000 7fdecb7fe640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeb4003a00 0x7fdeb4003e20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c290 tx=0x7fdeb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b0d84d23cf3b57 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:45.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.909+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc007d50 con 0x7fdeb4003a00 2024-05-11T01:13:45.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.909+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc005ad0 con 0x7fdeb4003a00 2024-05-11T01:13:45.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.909+0000 7fdeca7fc640 1 -- 172.21.15.16:0/1619298090 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc007070 con 0x7fdeb4003a00 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.910+0000 7fded20fc640 1 -- 172.21.15.16:0/1619298090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeb4003a00 msgr2=0x7fdeb4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.910+0000 7fded20fc640 1 --2- 172.21.15.16:0/1619298090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeb4003a00 0x7fdeb4003e20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c290 tx=0x7fdeb4005830 comp rx=0 tx=0).stop 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.910+0000 7fdecbfff640 1 -- 172.21.15.16:0/1619298090 reap_dead start 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.910+0000 7fded20fc640 1 -- 172.21.15.16:0/1619298090 shutdown_connections 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.910+0000 7fded20fc640 1 -- 172.21.15.16:0/1619298090 >> 172.21.15.16:0/1619298090 conn(0x7fdecc073f60 msgr2=0x7fdecc074370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.910+0000 7fded20fc640 1 -- 172.21.15.16:0/1619298090 shutdown_connections 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.910+0000 7fded20fc640 1 -- 172.21.15.16:0/1619298090 wait complete. 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.911+0000 7fded20fc640 1 Processor -- start 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.911+0000 7fded20fc640 1 -- start start 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fded20fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4003a00 0x7fdecc0b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fded20fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0cb8b0 0x7fdecc0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:45.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fded20fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0c9c70 0x7fdecc0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fded20fc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc0d48e0 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fded20fc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc0d4600 con 0x7fdeb4003a00 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fded20fc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdecc0d4bc0 con 0x7fdecc0c9c70 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0cb8b0 0x7fdecc0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0cb8b0 0x7fdecc0c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49408/0 (socket says 172.21.15.16:49408) 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 -- 172.21.15.16:0/1578431963 learned_addr learned my addr 172.21.15.16:0/1578431963 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecbfff640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0c9c70 0x7fdecc0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecb7fe640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4003a00 0x7fdecc0b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 -- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0c9c70 msgr2=0x7fdecc0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0c9c70 0x7fdecc0ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 -- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4003a00 msgr2=0x7fdecc0b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4003a00 0x7fdecc0b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:45.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 -- 172.21.15.16:0/1578431963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc0b7030 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecb7fe640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4003a00 0x7fdecc0b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdecaffd640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0cb8b0 0x7fdecc0c9730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdec0011960 tx=0x7fdec0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.912+0000 7fdeb3fff640 1 -- 172.21.15.16:0/1578431963 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0019070 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.913+0000 7fdeb3fff640 1 -- 172.21.15.16:0/1578431963 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec0004240 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.913+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdecc0b7310 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.913+0000 7fdeb3fff640 1 -- 172.21.15.16:0/1578431963 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec000f820 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.913+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdecc0c9210 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.914+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdecc06a5b0 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.914+0000 7fdeb3fff640 1 -- 172.21.15.16:0/1578431963 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 15) ==== 97912+0+0 (secure 0 0 0) 0x7fdec001c070 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.915+0000 7fdeb3fff640 1 -- 172.21.15.16:0/1578431963 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6804+0+0 (secure 0 0 0) 0x7fdec0097760 con 0x7fdecc0cb8b0 2024-05-11T01:13:45.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:45.920+0000 7fdeb3fff640 1 -- 172.21.15.16:0/1578431963 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdec0060a70 con 0x7fdecc0cb8b0 2024-05-11T01:13:46.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.109+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdecc0b74e0 con 0x7fdecc0cb8b0 2024-05-11T01:13:46.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.150+0000 7fdeb3fff640 1 -- 172.21.15.16:0/1578431963 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 16) ==== 98039+0+0 (secure 0 0 0) 0x7fdec0012040 con 0x7fdecc0cb8b0 2024-05-11T01:13:46.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.150+0000 7fdeb3fff640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdeb807bd90 0x7fdeb807e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:46.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.151+0000 7fdecb7fe640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdeb807bd90 0x7fdeb807e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:46.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.152+0000 7fdecb7fe640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdeb807bd90 0x7fdeb807e180 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdebc007fd0 tx=0x7fdebc02d000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.740+0000 7fdeb3fff640 1 -- 172.21.15.16:0/1578431963 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7fdec00415b0 con 0x7fdecc0cb8b0 2024-05-11T01:13:46.739 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdeb807bd90 msgr2=0x7fdeb807e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdeb807bd90 0x7fdeb807e180 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdebc007fd0 tx=0x7fdebc02d000 comp rx=0 tx=0).stop 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0cb8b0 msgr2=0x7fdecc0c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0cb8b0 0x7fdecc0c9730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fdec0011960 tx=0x7fdec0011e20 comp rx=0 tx=0).stop 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 shutdown_connections 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdecc0c9c70 0x7fdecc0ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0cb8b0 0x7fdecc0c9730 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdeb807bd90 0x7fdeb807e180 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 --2- 172.21.15.16:0/1578431963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdeb4003a00 0x7fdecc0b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.744+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 >> 172.21.15.16:0/1578431963 conn(0x7fdecc073f60 msgr2=0x7fdecc15fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.745+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 shutdown_connections 2024-05-11T01:13:46.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.745+0000 7fded20fc640 1 -- 172.21.15.16:0/1578431963 wait complete. 2024-05-11T01:13:46.759 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-11T01:13:46.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.874+0000 7f99df662640 1 Processor -- start 2024-05-11T01:13:46.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.874+0000 7f99df662640 1 -- start start 2024-05-11T01:13:46.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99df662640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d815da00 0x7f99d80b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:46.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99df662640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f99d80b33e0 0x7f99d8157330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:46.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99df662640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f99d8157870 0x7f99d815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99df662640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f99d81612d0 con 0x7f99d8157870 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99df662640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f99d81615b0 con 0x7f99d80b33e0 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99df662640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f99d8161890 con 0x7f99d815da00 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99ddbff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f99d8157870 0x7f99d815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99ddbff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f99d8157870 0x7f99d815dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49416/0 (socket says 172.21.15.16:49416) 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99ddbff640 1 -- 172.21.15.16:0/1706017947 learned_addr learned my addr 172.21.15.16:0/1706017947 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99dd3fe640 1 --2- 172.21.15.16:0/1706017947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d815da00 0x7f99d80b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99dcbfd640 1 --2- 172.21.15.16:0/1706017947 >> v2:172.21.15.174:3300/0 conn(0x7f99d80b33e0 0x7f99d8157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99ddbff640 1 -- 172.21.15.16:0/1706017947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d815da00 msgr2=0x7f99d80b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99ddbff640 1 --2- 172.21.15.16:0/1706017947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d815da00 0x7f99d80b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99ddbff640 1 -- 172.21.15.16:0/1706017947 >> v2:172.21.15.174:3300/0 conn(0x7f99d80b33e0 msgr2=0x7f99d8157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99ddbff640 1 --2- 172.21.15.16:0/1706017947 >> v2:172.21.15.174:3300/0 conn(0x7f99d80b33e0 0x7f99d8157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.875+0000 7f99ddbff640 1 -- 172.21.15.16:0/1706017947 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d8161b70 con 0x7f99d8157870 2024-05-11T01:13:46.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.876+0000 7f99ddbff640 1 --2- 172.21.15.16:0/1706017947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d8157870 0x7f99d815dde0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f99d80d1f40 tx=0x7f99d002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5a68c9a1c57b54 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:46.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.876+0000 7f99cffff640 1 -- 172.21.15.16:0/1706017947 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0036070 con 0x7f99d8157870 2024-05-11T01:13:46.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.876+0000 7f99cffff640 1 -- 172.21.15.16:0/1706017947 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d0031600 con 0x7f99d8157870 2024-05-11T01:13:46.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.876+0000 7f99cffff640 1 -- 172.21.15.16:0/1706017947 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d00319d0 con 0x7f99d8157870 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 -- 172.21.15.16:0/1706017947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d8157870 msgr2=0x7f99d815dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 --2- 172.21.15.16:0/1706017947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d8157870 0x7f99d815dde0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f99d80d1f40 tx=0x7f99d002a6a0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 -- 172.21.15.16:0/1706017947 shutdown_connections 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 --2- 172.21.15.16:0/1706017947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d8157870 0x7f99d815dde0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 --2- 172.21.15.16:0/1706017947 >> v2:172.21.15.174:3300/0 conn(0x7f99d80b33e0 0x7f99d8157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 --2- 172.21.15.16:0/1706017947 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d815da00 0x7f99d80b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 -- 172.21.15.16:0/1706017947 >> 172.21.15.16:0/1706017947 conn(0x7f99d806c5c0 msgr2=0x7f99d806c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 -- 172.21.15.16:0/1706017947 shutdown_connections 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.877+0000 7f99df662640 1 -- 172.21.15.16:0/1706017947 wait complete. 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.878+0000 7f99df662640 1 Processor -- start 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.878+0000 7f99df662640 1 -- start start 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99df662640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d80b33e0 0x7f99d813fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:46.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99df662640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d8157870 0x7f99d8144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99df662640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d815da00 0x7f99d81595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99df662640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f99d8160e80 con 0x7f99d815da00 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99df662640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f99d8157d00 con 0x7f99d8157870 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99df662640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f99d8161000 con 0x7f99d80b33e0 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99ddbff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d815da00 0x7f99d81595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99ddbff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d815da00 0x7f99d81595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49420/0 (socket says 172.21.15.16:49420) 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99ddbff640 1 -- 172.21.15.16:0/2104130658 learned_addr learned my addr 172.21.15.16:0/2104130658 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99dcbfd640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d8157870 0x7f99d8144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.879+0000 7f99dd3fe640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d80b33e0 0x7f99d813fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99ddbff640 1 -- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d80b33e0 msgr2=0x7f99d813fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99ddbff640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d80b33e0 0x7f99d813fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99ddbff640 1 -- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d8157870 msgr2=0x7f99d8144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99ddbff640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d8157870 0x7f99d8144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99ddbff640 1 -- 172.21.15.16:0/2104130658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d8142dc0 con 0x7f99d815da00 2024-05-11T01:13:46.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99ddbff640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d815da00 0x7f99d81595a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009f40 tx=0x7f99d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:46.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99cdffb640 1 -- 172.21.15.16:0/2104130658 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0036050 con 0x7f99d815da00 2024-05-11T01:13:46.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99cdffb640 1 -- 172.21.15.16:0/2104130658 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d0042070 con 0x7f99d815da00 2024-05-11T01:13:46.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99cdffb640 1 -- 172.21.15.16:0/2104130658 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0009510 con 0x7f99d815da00 2024-05-11T01:13:46.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d8158ac0 con 0x7f99d815da00 2024-05-11T01:13:46.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.880+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d815ab00 con 0x7f99d815da00 2024-05-11T01:13:46.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.881+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d806a5b0 con 0x7f99d815da00 2024-05-11T01:13:46.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.882+0000 7f99cdffb640 1 -- 172.21.15.16:0/2104130658 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 16) ==== 98039+0+0 (secure 0 0 0) 0x7f99d0007bd0 con 0x7f99d815da00 2024-05-11T01:13:46.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.882+0000 7f99cdffb640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99bc076120 0x7f99bc0785e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:46.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.883+0000 7f99cdffb640 1 -- 172.21.15.16:0/2104130658 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6366+0+0 (secure 0 0 0) 0x7f99d00b8200 con 0x7f99d815da00 2024-05-11T01:13:46.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.883+0000 7f99dd3fe640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99bc076120 0x7f99bc0785e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:46.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.884+0000 7f99dd3fe640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99bc076120 0x7f99bc0785e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f99d4006fd0 tx=0x7f99d4008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:46.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:46.887+0000 7f99cdffb640 1 -- 172.21.15.16:0/2104130658 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f99d00815c0 con 0x7f99d815da00 2024-05-11T01:13:47.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.085+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f99d80b6f70 con 0x7f99d815da00 2024-05-11T01:13:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.747+0000 7f99cdffb640 1 -- 172.21.15.16:0/2104130658 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 17) ==== 98145+0+0 (secure 0 0 0) 0x7f99d0005d10 con 0x7f99d815da00 2024-05-11T01:13:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.752+0000 7f99cdffb640 1 -- 172.21.15.16:0/2104130658 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7f99d00b2160 con 0x7f99d815da00 2024-05-11T01:13:47.751 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-05-11T01:13:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99bc076120 msgr2=0x7f99bc0785e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99bc076120 0x7f99bc0785e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f99d4006fd0 tx=0x7f99d4008040 comp rx=0 tx=0).stop 2024-05-11T01:13:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d815da00 msgr2=0x7f99d81595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d815da00 0x7f99d81595a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009f40 tx=0x7f99d0004a40 comp rx=0 tx=0).stop 2024-05-11T01:13:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 shutdown_connections 2024-05-11T01:13:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99d815da00 0x7f99d81595a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99bc076120 0x7f99bc0785e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99d8157870 0x7f99d8144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 --2- 172.21.15.16:0/2104130658 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f99d80b33e0 0x7f99d813fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 >> 172.21.15.16:0/2104130658 conn(0x7f99d806c5c0 msgr2=0x7f99d815bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 shutdown_connections 2024-05-11T01:13:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.756+0000 7f99df662640 1 -- 172.21.15.16:0/2104130658 wait complete. 2024-05-11T01:13:47.769 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-11T01:13:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.878+0000 7f8056124640 1 Processor -- start 2024-05-11T01:13:47.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.878+0000 7f8056124640 1 -- start start 2024-05-11T01:13:47.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f8056124640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8050148e50 0x7f80500b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:47.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f8056124640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f80500707a0 0x7f8050070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f8056124640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80500b4c80 0x7f80500b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f8056124640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8050149230 con 0x7f8050148e50 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f8056124640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f8050163290 con 0x7f80500707a0 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f8056124640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f8050163570 con 0x7f80500b4c80 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8050148e50 0x7f80500b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8050148e50 0x7f80500b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49430/0 (socket says 172.21.15.16:49430) 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804f7fe640 1 -- 172.21.15.16:0/3560725176 learned_addr learned my addr 172.21.15.16:0/3560725176 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804effd640 1 --2- 172.21.15.16:0/3560725176 >> v2:172.21.15.174:3300/0 conn(0x7f80500707a0 0x7f8050070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804ffff640 1 --2- 172.21.15.16:0/3560725176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80500b4c80 0x7f80500b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804f7fe640 1 -- 172.21.15.16:0/3560725176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80500b4c80 msgr2=0x7f80500b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804f7fe640 1 --2- 172.21.15.16:0/3560725176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80500b4c80 0x7f80500b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804f7fe640 1 -- 172.21.15.16:0/3560725176 >> v2:172.21.15.174:3300/0 conn(0x7f80500707a0 msgr2=0x7f8050070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804f7fe640 1 --2- 172.21.15.16:0/3560725176 >> v2:172.21.15.174:3300/0 conn(0x7f80500707a0 0x7f8050070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.879+0000 7f804f7fe640 1 -- 172.21.15.16:0/3560725176 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8050163850 con 0x7f8050148e50 2024-05-11T01:13:47.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.880+0000 7f804f7fe640 1 --2- 172.21.15.16:0/3560725176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8050148e50 0x7f80500b66a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8050071720 tx=0x7f804002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b2549534d65d80 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:47.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.880+0000 7f804e7fc640 1 -- 172.21.15.16:0/3560725176 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040037070 con 0x7f8050148e50 2024-05-11T01:13:47.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.880+0000 7f804e7fc640 1 -- 172.21.15.16:0/3560725176 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8040032440 con 0x7f8050148e50 2024-05-11T01:13:47.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.880+0000 7f804e7fc640 1 -- 172.21.15.16:0/3560725176 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040032810 con 0x7f8050148e50 2024-05-11T01:13:47.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 -- 172.21.15.16:0/3560725176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8050148e50 msgr2=0x7f80500b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:47.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 --2- 172.21.15.16:0/3560725176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8050148e50 0x7f80500b66a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8050071720 tx=0x7f804002a1e0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 -- 172.21.15.16:0/3560725176 shutdown_connections 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 --2- 172.21.15.16:0/3560725176 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f80500b4c80 0x7f80500b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 --2- 172.21.15.16:0/3560725176 >> v2:172.21.15.174:3300/0 conn(0x7f80500707a0 0x7f8050070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 --2- 172.21.15.16:0/3560725176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8050148e50 0x7f80500b66a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 -- 172.21.15.16:0/3560725176 >> 172.21.15.16:0/3560725176 conn(0x7f80500b8510 msgr2=0x7f80500b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 -- 172.21.15.16:0/3560725176 shutdown_connections 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.881+0000 7f8056124640 1 -- 172.21.15.16:0/3560725176 wait complete. 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.882+0000 7f8056124640 1 Processor -- start 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.882+0000 7f8056124640 1 -- start start 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f8056124640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80500707a0 0x7f805015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f8056124640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80500b4c80 0x7f80500b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f8056124640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050148e50 0x7f805006db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:47.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f8056124640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f80500b6d60 con 0x7f80500707a0 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f8056124640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f80500b6be0 con 0x7f80500b4c80 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f8056124640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f80500b6140 con 0x7f8050148e50 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f804f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80500707a0 0x7f805015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f804f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80500707a0 0x7f805015ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49434/0 (socket says 172.21.15.16:49434) 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f804f7fe640 1 -- 172.21.15.16:0/3323849113 learned_addr learned my addr 172.21.15.16:0/3323849113 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f804effd640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80500b4c80 0x7f80500b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.883+0000 7f804ffff640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050148e50 0x7f805006db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f804f7fe640 1 -- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050148e50 msgr2=0x7f805006db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f804f7fe640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050148e50 0x7f805006db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f804f7fe640 1 -- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80500b4c80 msgr2=0x7f80500b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f804f7fe640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80500b4c80 0x7f80500b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f804f7fe640 1 -- 172.21.15.16:0/3323849113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805015f370 con 0x7f80500707a0 2024-05-11T01:13:47.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f804f7fe640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80500707a0 0x7f805015ee30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8040000c00 tx=0x7f80400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f8037fff640 1 -- 172.21.15.16:0/3323849113 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040041020 con 0x7f80500707a0 2024-05-11T01:13:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f8037fff640 1 -- 172.21.15.16:0/3323849113 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f804003d620 con 0x7f80500707a0 2024-05-11T01:13:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80500b4660 con 0x7f80500707a0 2024-05-11T01:13:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f8037fff640 1 -- 172.21.15.16:0/3323849113 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8040037040 con 0x7f80500707a0 2024-05-11T01:13:47.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.884+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f805013efe0 con 0x7f80500707a0 2024-05-11T01:13:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.885+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805006a5b0 con 0x7f80500707a0 2024-05-11T01:13:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.886+0000 7f8037fff640 1 -- 172.21.15.16:0/3323849113 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 98145+0+0 (secure 0 0 0) 0x7f8040044020 con 0x7f80500707a0 2024-05-11T01:13:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.886+0000 7f8037fff640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f803c076240 0x7f803c078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.886+0000 7f8037fff640 1 -- 172.21.15.16:0/3323849113 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7f80400b7b00 con 0x7f80500707a0 2024-05-11T01:13:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.886+0000 7f804effd640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f803c076240 0x7f803c078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.887+0000 7f804effd640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f803c076240 0x7f803c078700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f80500d28c0 tx=0x7f8044009190 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:47.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:47.890+0000 7f8037fff640 1 -- 172.21.15.16:0/3323849113 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f804004b030 con 0x7f80500707a0 2024-05-11T01:13:48.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.081+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8050146c20 con 0x7f80500707a0 2024-05-11T01:13:48.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.084+0000 7f8037fff640 1 -- 172.21.15.16:0/3323849113 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f8040080e00 con 0x7f80500707a0 2024-05-11T01:13:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.086+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f803c076240 msgr2=0x7f803c078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.086+0000 7f8056124640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f803c076240 0x7f803c078700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f80500d28c0 tx=0x7f8044009190 comp rx=0 tx=0).stop 2024-05-11T01:13:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.086+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80500707a0 msgr2=0x7f805015ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.086+0000 7f8056124640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80500707a0 0x7f805015ee30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8040000c00 tx=0x7f80400046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.087+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 shutdown_connections 2024-05-11T01:13:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.087+0000 7f8056124640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f8050148e50 0x7f805006db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.087+0000 7f8056124640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f803c076240 0x7f803c078700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.087+0000 7f8056124640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f80500b4c80 0x7f80500b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.087+0000 7f8056124640 1 --2- 172.21.15.16:0/3323849113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80500707a0 0x7f805015ee30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.087+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 >> 172.21.15.16:0/3323849113 conn(0x7f80500b8510 msgr2=0x7f8050147140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.087+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 shutdown_connections 2024-05-11T01:13:48.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.087+0000 7f8056124640 1 -- 172.21.15.16:0/3323849113 wait complete. 2024-05-11T01:13:48.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2024-05-11T01:13:48.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.207+0000 7f39a0b24640 1 Processor -- start 2024-05-11T01:13:48.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.207+0000 7f39a0b24640 1 -- start start 2024-05-11T01:13:48.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.208+0000 7f39a0b24640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f399c148e50 0x7f399c0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.208+0000 7f39a0b24640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f399c06eb10 0x7f399c070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.208+0000 7f39a0b24640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f399c149230 con 0x7f399c0707a0 2024-05-11T01:13:48.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.208+0000 7f39a0b24640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f399c163290 con 0x7f399c06eb10 2024-05-11T01:13:48.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.208+0000 7f39a0b24640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f399c163570 con 0x7f399c148e50 2024-05-11T01:13:48.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.208+0000 7f399ad9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f399c06eb10 0x7f399c070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.208+0000 7f399ad9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f399c06eb10 0x7f399c070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49436/0 (socket says 172.21.15.16:49436) 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.208+0000 7f399ad9d640 1 -- 172.21.15.16:0/1398347630 learned_addr learned my addr 172.21.15.16:0/1398347630 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.209+0000 7f399ad9d640 1 -- 172.21.15.16:0/1398347630 >> v2:172.21.15.174:3300/0 conn(0x7f399c148e50 msgr2=0x7f399c0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.209+0000 7f399a59c640 1 --2- 172.21.15.16:0/1398347630 >> v2:172.21.15.174:3300/0 conn(0x7f399c148e50 0x7f399c0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.209+0000 7f399ad9d640 1 --2- 172.21.15.16:0/1398347630 >> v2:172.21.15.174:3300/0 conn(0x7f399c148e50 0x7f399c0b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.209+0000 7f399ad9d640 1 -- 172.21.15.16:0/1398347630 >> v1:172.21.15.174:6789/0 conn(0x7f399c0707a0 legacy=0x7f399c0b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.209+0000 7f399ad9d640 1 -- 172.21.15.16:0/1398347630 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c163850 con 0x7f399c06eb10 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.209+0000 7f399a59c640 1 --2- 172.21.15.16:0/1398347630 >> v2:172.21.15.174:3300/0 conn(0x7f399c148e50 0x7f399c0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:48.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.209+0000 7f399ad9d640 1 --2- 172.21.15.16:0/1398347630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c070c30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f399c149400 tx=0x7f398c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5204e8323b3418 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f399959a640 1 -- 172.21.15.16:0/1398347630 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c036070 con 0x7f399c06eb10 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f399959a640 1 -- 172.21.15.16:0/1398347630 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c031600 con 0x7f399c06eb10 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f399959a640 1 -- 172.21.15.16:0/1398347630 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c0319d0 con 0x7f399c06eb10 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f39a0b24640 1 -- 172.21.15.16:0/1398347630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 msgr2=0x7f399c070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f39a0b24640 1 --2- 172.21.15.16:0/1398347630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c070c30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f399c149400 tx=0x7f398c02a5f0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f39a0b24640 1 -- 172.21.15.16:0/1398347630 shutdown_connections 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f39a0b24640 1 --2- 172.21.15.16:0/1398347630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c070c30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f39a0b24640 1 --2- 172.21.15.16:0/1398347630 >> v2:172.21.15.174:3300/0 conn(0x7f399c148e50 0x7f399c0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f39a0b24640 1 -- 172.21.15.16:0/1398347630 >> 172.21.15.16:0/1398347630 conn(0x7f399c0b8510 msgr2=0x7f399c0b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f39a0b24640 1 -- 172.21.15.16:0/1398347630 shutdown_connections 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.210+0000 7f39a0b24640 1 -- 172.21.15.16:0/1398347630 wait complete. 2024-05-11T01:13:48.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f39a0b24640 1 Processor -- start 2024-05-11T01:13:48.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f39a0b24640 1 -- start start 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f39a0b24640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f39a0b24640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399c0707a0 0x7f399c1f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f39a0b24640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f399c148e50 0x7f399c1f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f39a0b24640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f399c0b6d60 con 0x7f399c06eb10 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f39a0b24640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f399c0b6be0 con 0x7f399c148e50 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f39a0b24640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f399c0b6140 con 0x7f399c0707a0 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f399a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.212+0000 7f399a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c0aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49446/0 (socket says 172.21.15.16:49446) 2024-05-11T01:13:48.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f399a59c640 1 -- 172.21.15.16:0/370937609 learned_addr learned my addr 172.21.15.16:0/370937609 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f3999d9b640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399c0707a0 0x7f399c1f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f399a59c640 1 -- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399c0707a0 msgr2=0x7f399c1f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f399a59c640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399c0707a0 0x7f399c1f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f399a59c640 1 -- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f399c148e50 msgr2=0x7f399c1f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f399a59c640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f399c148e50 0x7f399c1f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f399a59c640 1 -- 172.21.15.16:0/370937609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c0d23d0 con 0x7f399c06eb10 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f399a59c640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c0aa4d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f399400c7f0 tx=0x7f399400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f3992ffd640 1 -- 172.21.15.16:0/370937609 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994015070 con 0x7f399c06eb10 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f3992ffd640 1 -- 172.21.15.16:0/370937609 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3994007a30 con 0x7f399c06eb10 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c0cf2d0 con 0x7f399c06eb10 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f3992ffd640 1 -- 172.21.15.16:0/370937609 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994007e00 con 0x7f399c06eb10 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.213+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c0cea30 con 0x7f399c06eb10 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.214+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f399c06a5b0 con 0x7f399c06eb10 2024-05-11T01:13:48.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.215+0000 7f3992ffd640 1 -- 172.21.15.16:0/370937609 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 98145+0+0 (secure 0 0 0) 0x7f3994018070 con 0x7f399c06eb10 2024-05-11T01:13:48.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.215+0000 7f3992ffd640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f397c076240 0x7f397c078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.215+0000 7f3992ffd640 1 -- 172.21.15.16:0/370937609 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7f3994097530 con 0x7f399c06eb10 2024-05-11T01:13:48.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.216+0000 7f3999d9b640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f397c076240 0x7f397c078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.216+0000 7f3999d9b640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f397c076240 0x7f397c078700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f399c146730 tx=0x7f3984008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.220+0000 7f3992ffd640 1 -- 172.21.15.16:0/370937609 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3994060e80 con 0x7f399c06eb10 2024-05-11T01:13:48.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.412+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) -- 0x7f399c0d3d50 con 0x7f399c06eb10 2024-05-11T01:13:48.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.416+0000 7f3992ffd640 1 -- 172.21.15.16:0/370937609 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v14) ==== 115+0+0 (secure 0 0 0) 0x7f3994067e20 con 0x7f399c06eb10 2024-05-11T01:13:48.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f397c076240 msgr2=0x7f397c078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f397c076240 0x7f397c078700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f399c146730 tx=0x7f3984008040 comp rx=0 tx=0).stop 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 msgr2=0x7f399c0aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c0aa4d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f399400c7f0 tx=0x7f399400cbf0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 shutdown_connections 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f397c076240 0x7f397c078700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f399c148e50 0x7f399c1f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f399c0707a0 0x7f399c1f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 --2- 172.21.15.16:0/370937609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399c06eb10 0x7f399c0aa4d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 >> 172.21.15.16:0/370937609 conn(0x7f399c0b8510 msgr2=0x7f399c068910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 shutdown_connections 2024-05-11T01:13:48.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.418+0000 7f39a0b24640 1 -- 172.21.15.16:0/370937609 wait complete. 2024-05-11T01:13:48.428 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-05-11T01:13:48.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.535+0000 7fef043a4640 1 Processor -- start 2024-05-11T01:13:48.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.535+0000 7fef043a4640 1 -- start start 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.536+0000 7fef043a4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feefc0b7490 0x7feefc0b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.536+0000 7fef043a4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc1635d0 con 0x7feefc0bae40 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.536+0000 7fef043a4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc1638b0 con 0x7feefc163010 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.536+0000 7fef043a4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7feefc163b90 con 0x7feefc0b7490 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.536+0000 7fef02140640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7feefc0bae40 0x7feefc1604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55968/0 (socket says 172.21.15.16:55968) 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.536+0000 7fef02140640 1 -- 172.21.15.16:0/229591272 learned_addr learned my addr 172.21.15.16:0/229591272 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.536+0000 7fef02941640 1 --2- 172.21.15.16:0/229591272 >> v2:172.21.15.16:3300/0 conn(0x7feefc0b7490 0x7feefc0b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.537+0000 7fef0113e640 1 -- 172.21.15.16:0/229591272 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004569818 0 0) 0x7feefc1635d0 con 0x7feefc0bae40 2024-05-11T01:13:48.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.537+0000 7fef0113e640 1 -- 172.21.15.16:0/229591272 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feee4003520 con 0x7feefc0bae40 2024-05-11T01:13:48.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.537+0000 7fef02941640 1 -- 172.21.15.16:0/229591272 >> v1:172.21.15.174:6789/0 conn(0x7feefc163010 legacy=0x7feefc0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.537+0000 7fef02941640 1 -- 172.21.15.16:0/229591272 >> v1:172.21.15.16:6789/0 conn(0x7feefc0bae40 legacy=0x7feefc1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.537+0000 7fef02941640 1 -- 172.21.15.16:0/229591272 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc163e70 con 0x7feefc0b7490 2024-05-11T01:13:48.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.537+0000 7fef02941640 1 --2- 172.21.15.16:0/229591272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc0b3d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feef40097a0 tx=0x7feef402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8959444c61faa02 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef0113e640 1 -- 172.21.15.16:0/229591272 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4037070 con 0x7feefc0b7490 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef0113e640 1 -- 172.21.15.16:0/229591272 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef4032440 con 0x7feefc0b7490 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef0113e640 1 -- 172.21.15.16:0/229591272 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4032810 con 0x7feefc0b7490 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef043a4640 1 -- 172.21.15.16:0/229591272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 msgr2=0x7feefc0b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef043a4640 1 --2- 172.21.15.16:0/229591272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc0b3d70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feef40097a0 tx=0x7feef402a1a0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef043a4640 1 -- 172.21.15.16:0/229591272 shutdown_connections 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef043a4640 1 --2- 172.21.15.16:0/229591272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc0b3d70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef043a4640 1 -- 172.21.15.16:0/229591272 >> 172.21.15.16:0/229591272 conn(0x7feefc074140 msgr2=0x7feefc0d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef043a4640 1 -- 172.21.15.16:0/229591272 shutdown_connections 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.538+0000 7fef043a4640 1 -- 172.21.15.16:0/229591272 wait complete. 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef043a4640 1 Processor -- start 2024-05-11T01:13:48.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef043a4640 1 -- start start 2024-05-11T01:13:48.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef043a4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef043a4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0bae40 0x7feefc154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef043a4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc163010 0x7feefc1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef043a4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0d4870 con 0x7feefc0b7490 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef043a4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feefc0d46f0 con 0x7feefc163010 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef043a4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7feefc0d49f0 con 0x7feefc0bae40 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef02140640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef02140640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49474/0 (socket says 172.21.15.16:49474) 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.540+0000 7fef02140640 1 -- 172.21.15.16:0/3310382277 learned_addr learned my addr 172.21.15.16:0/3310382277 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef0193f640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0bae40 0x7feefc154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef02140640 1 -- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0bae40 msgr2=0x7feefc154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef02941640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc163010 0x7feefc1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef02140640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0bae40 0x7feefc154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef02140640 1 -- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc163010 msgr2=0x7feefc1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef02140640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc163010 0x7feefc1571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef02140640 1 -- 172.21.15.16:0/3310382277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc154e80 con 0x7feefc0b7490 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef0193f640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0bae40 0x7feefc154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef02941640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc163010 0x7feefc1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef02140640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc153cb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7feeec00cbc0 tx=0x7feeec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7feefaffd640 1 -- 172.21.15.16:0/3310382277 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec00ad40 con 0x7feefc0b7490 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7feefaffd640 1 -- 172.21.15.16:0/3310382277 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec012400 con 0x7feefc0b7490 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc155160 con 0x7feefc0b7490 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7feefaffd640 1 -- 172.21.15.16:0/3310382277 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec0127f0 con 0x7feefc0b7490 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.541+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc0c92c0 con 0x7feefc0b7490 2024-05-11T01:13:48.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.542+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc06a5b0 con 0x7feefc0b7490 2024-05-11T01:13:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.543+0000 7feefaffd640 1 -- 172.21.15.16:0/3310382277 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 98145+0+0 (secure 0 0 0) 0x7feeec012990 con 0x7feefc0b7490 2024-05-11T01:13:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.543+0000 7feefaffd640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7feee8076240 0x7feee8078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.543+0000 7feefaffd640 1 -- 172.21.15.16:0/3310382277 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7feeec097d40 con 0x7feefc0b7490 2024-05-11T01:13:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.544+0000 7fef0193f640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7feee8076240 0x7feee8078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.544+0000 7fef0193f640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7feee8076240 0x7feee8078700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feefc0c8ea0 tx=0x7feef0009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.548+0000 7feefaffd640 1 -- 172.21.15.16:0/3310382277 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feeec061690 con 0x7feefc0b7490 2024-05-11T01:13:48.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.738+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) -- 0x7feefc155680 con 0x7feefc0b7490 2024-05-11T01:13:48.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.741+0000 7feefaffd640 1 -- 172.21.15.16:0/3310382277 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7feeec060f90 con 0x7feefc0b7490 2024-05-11T01:13:48.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7feee8076240 msgr2=0x7feee8078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7feee8076240 0x7feee8078700 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feefc0c8ea0 tx=0x7feef0009040 comp rx=0 tx=0).stop 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 msgr2=0x7feefc153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc153cb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7feeec00cbc0 tx=0x7feeec00a430 comp rx=0 tx=0).stop 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 shutdown_connections 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7feee8076240 0x7feee8078700 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feefc163010 0x7feefc1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7feefc0bae40 0x7feefc154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 --2- 172.21.15.16:0/3310382277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feefc0b7490 0x7feefc153cb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 >> 172.21.15.16:0/3310382277 conn(0x7feefc074140 msgr2=0x7feefc0b84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 shutdown_connections 2024-05-11T01:13:48.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.743+0000 7fef043a4640 1 -- 172.21.15.16:0/3310382277 wait complete. 2024-05-11T01:13:48.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2024-05-11T01:13:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.858+0000 7fd22d589640 1 Processor -- start 2024-05-11T01:13:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.858+0000 7fd22d589640 1 -- start start 2024-05-11T01:13:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd22d589640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280b6d70 0x7fd2280b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd22d589640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd2280bac10 0x7fd22806d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd22d589640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd228163e90 con 0x7fd22806d950 2024-05-11T01:13:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd22d589640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fd2280cfad0 con 0x7fd2280bac10 2024-05-11T01:13:48.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd22d589640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd2280b7690 con 0x7fd2280b6d70 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd2277fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd22806d950 0x7fd2280d3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55982/0 (socket says 172.21.15.16:55982) 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd2277fe640 1 -- 172.21.15.16:0/1885197217 learned_addr learned my addr 172.21.15.16:0/1885197217 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd2267fc640 1 --2- 172.21.15.16:0/1885197217 >> v2:172.21.15.174:3300/0 conn(0x7fd2280bac10 0x7fd22806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd226ffd640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280b6d70 0x7fd2280b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188833236 0 0) 0x7fd228163e90 con 0x7fd22806d950 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.859+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd210003520 con 0x7fd22806d950 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2929069325 0 0) 0x7fd210003520 con 0x7fd22806d950 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280b6d70 msgr2=0x7fd2280b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280b6d70 0x7fd2280b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 >> v2:172.21.15.174:3300/0 conn(0x7fd2280bac10 msgr2=0x7fd22806d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 --2- 172.21.15.16:0/1885197217 >> v2:172.21.15.174:3300/0 conn(0x7fd2280bac10 0x7fd22806d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd228163310 con 0x7fd22806d950 2024-05-11T01:13:48.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fd220001a70 con 0x7fd22806d950 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2267fc640 1 --2- 172.21.15.16:0/1885197217 >> v2:172.21.15.174:3300/0 conn(0x7fd2280bac10 0x7fd22806d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 >> v1:172.21.15.16:6789/0 conn(0x7fd22806d950 legacy=0x7fd2280d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280b6d70 0x7fd210003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd210003fd0 0x7fd210004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd2100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd2280cfad0 con 0x7fd210004d40 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2280b7690 con 0x7fd210003fd0 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd21000baa0 con 0x7fd2280b6d70 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2277fe640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd2100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2267fc640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd210003fd0 0x7fd210004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd226ffd640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280b6d70 0x7fd210003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2277fe640 1 -- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280b6d70 msgr2=0x7fd210003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:48.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2277fe640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280b6d70 0x7fd210003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2277fe640 1 -- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd210003fd0 msgr2=0x7fd210004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2277fe640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd210003fd0 0x7fd210004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2277fe640 1 -- 172.21.15.16:0/1885197217 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd210003520 con 0x7fd210004d40 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.860+0000 7fd2267fc640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd210003fd0 0x7fd210004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.861+0000 7fd2277fe640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd2100051c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd22000a920 tx=0x7fd210005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a151ac21ecb398d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.861+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22000a4c0 con 0x7fd210004d40 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.861+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22002f070 con 0x7fd210004d40 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.861+0000 7fd225ffb640 1 -- 172.21.15.16:0/1885197217 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22002bcb0 con 0x7fd210004d40 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.862+0000 7fd22d589640 1 -- 172.21.15.16:0/1885197217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 msgr2=0x7fd2100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.862+0000 7fd22d589640 1 --2- 172.21.15.16:0/1885197217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd2100051c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd22000a920 tx=0x7fd210005830 comp rx=0 tx=0).stop 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.862+0000 7fd2277fe640 1 -- 172.21.15.16:0/1885197217 reap_dead start 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.862+0000 7fd22d589640 1 -- 172.21.15.16:0/1885197217 shutdown_connections 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.862+0000 7fd22d589640 1 -- 172.21.15.16:0/1885197217 >> 172.21.15.16:0/1885197217 conn(0x7fd228074140 msgr2=0x7fd2280d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:48.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.862+0000 7fd22d589640 1 -- 172.21.15.16:0/1885197217 shutdown_connections 2024-05-11T01:13:48.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.862+0000 7fd22d589640 1 -- 172.21.15.16:0/1885197217 wait complete. 2024-05-11T01:13:48.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.863+0000 7fd22d589640 1 Processor -- start 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.863+0000 7fd22d589640 1 -- start start 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd22d589640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd22815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd22d589640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280cc3c0 0x7fd228159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd22d589640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280b9a90 0x7fd2280b9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd22d589640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd228163bb0 con 0x7fd210004d40 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd22d589640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281638d0 con 0x7fd2280b9a90 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd22d589640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd22815f830 con 0x7fd2280cc3c0 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd22815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd22815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49494/0 (socket says 172.21.15.16:49494) 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 -- 172.21.15.16:0/3607553453 learned_addr learned my addr 172.21.15.16:0/3607553453 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd2267fc640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280cc3c0 0x7fd228159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd2277fe640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280b9a90 0x7fd2280b9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 -- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280cc3c0 msgr2=0x7fd228159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280cc3c0 0x7fd228159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 -- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280b9a90 msgr2=0x7fd2280b9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280b9a90 0x7fd2280b9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 -- 172.21.15.16:0/3607553453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2280cc840 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.864+0000 7fd226ffd640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd22815a400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd2180119d0 tx=0x7fd218011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.865+0000 7fd20f7fe640 1 -- 172.21.15.16:0/3607553453 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21800faf0 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.865+0000 7fd20f7fe640 1 -- 172.21.15.16:0/3607553453 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21800fc90 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.865+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2280ccb10 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.865+0000 7fd20f7fe640 1 -- 172.21.15.16:0/3607553453 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218014640 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.865+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2280cd0d0 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.866+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd22806a5b0 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.866+0000 7fd20f7fe640 1 -- 172.21.15.16:0/3607553453 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 98145+0+0 (secure 0 0 0) 0x7fd218012040 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.867+0000 7fd20f7fe640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd214076270 0x7fd214078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.867+0000 7fd20f7fe640 1 -- 172.21.15.16:0/3607553453 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7fd218097cd0 con 0x7fd210004d40 2024-05-11T01:13:48.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.867+0000 7fd2267fc640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd214076270 0x7fd214078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:48.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.868+0000 7fd2267fc640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd214076270 0x7fd214078730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd2280cf4c0 tx=0x7fd21c008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:48.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:48.872+0000 7fd20f7fe640 1 -- 172.21.15.16:0/3607553453 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd218019030 con 0x7fd210004d40 2024-05-11T01:13:49.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.135+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) -- 0x7fd2280b4a30 con 0x7fd210004d40 2024-05-11T01:13:49.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.529+0000 7fd20f7fe640 1 -- 172.21.15.16:0/3607553453 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v435) ==== 158+0+0 (secure 0 0 0) 0x7fd218060f50 con 0x7fd210004d40 2024-05-11T01:13:49.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd214076270 msgr2=0x7fd214078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd214076270 0x7fd214078730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd2280cf4c0 tx=0x7fd21c008040 comp rx=0 tx=0).stop 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 msgr2=0x7fd22815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd22815a400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd2180119d0 tx=0x7fd218011e90 comp rx=0 tx=0).stop 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 shutdown_connections 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd214076270 0x7fd214078730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2280b9a90 0x7fd2280b9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd2280cc3c0 0x7fd228159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 --2- 172.21.15.16:0/3607553453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd210004d40 0x7fd22815a400 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 >> 172.21.15.16:0/3607553453 conn(0x7fd228074140 msgr2=0x7fd22815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 shutdown_connections 2024-05-11T01:13:49.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.531+0000 7fd22d589640 1 -- 172.21.15.16:0/3607553453 wait complete. 2024-05-11T01:13:49.543 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2024-05-11T01:13:49.543 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2024-05-11T01:13:49.543 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-05-11T01:13:49.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:13:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.653+0000 7f1574454640 1 Processor -- start 2024-05-11T01:13:49.652 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.653+0000 7f1574454640 1 -- start start 2024-05-11T01:13:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f1574454640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f156c06f140 0x7f156c0d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f1574454640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0d3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f1574454640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156c162fb0 con 0x7f156c15f530 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f1574454640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f156c163ea0 con 0x7f156c06f140 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f1574454640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f156c163290 con 0x7f156c0d3090 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15729f1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15719ef640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f156c06f140 0x7f156c0d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15729f1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0d3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:58208/0 (socket says 172.21.15.16:58208) 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15721f0640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f156c15f530 0x7f156c0cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:39704/0 (socket says 172.21.15.16:39704) 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15729f1640 1 -- 172.21.15.16:0/4055780635 learned_addr learned my addr 172.21.15.16:0/4055780635 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15729f1640 1 -- 172.21.15.16:0/4055780635 >> v2:172.21.15.174:3300/0 conn(0x7f156c06f140 msgr2=0x7f156c0d2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15729f1640 1 --2- 172.21.15.16:0/4055780635 >> v2:172.21.15.174:3300/0 conn(0x7f156c06f140 0x7f156c0d2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15729f1640 1 -- 172.21.15.16:0/4055780635 >> v1:172.21.15.174:6789/0 conn(0x7f156c15f530 legacy=0x7f156c0cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15729f1640 1 -- 172.21.15.16:0/4055780635 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c163570 con 0x7f156c0d3090 2024-05-11T01:13:49.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.654+0000 7f15719ef640 1 --2- 172.21.15.16:0/4055780635 >> v2:172.21.15.174:3300/0 conn(0x7f156c06f140 0x7f156c0d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.655+0000 7f15729f1640 1 --2- 172.21.15.16:0/4055780635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0d3520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1564009e50 tx=0x7f156402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3963a4f51437cbfc server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.655+0000 7f15711ee640 1 -- 172.21.15.16:0/4055780635 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564036070 con 0x7f156c0d3090 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.655+0000 7f15711ee640 1 -- 172.21.15.16:0/4055780635 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1564031600 con 0x7f156c0d3090 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.655+0000 7f15711ee640 1 -- 172.21.15.16:0/4055780635 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640319d0 con 0x7f156c0d3090 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.656+0000 7f1574454640 1 -- 172.21.15.16:0/4055780635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 msgr2=0x7f156c0d3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.656+0000 7f1574454640 1 --2- 172.21.15.16:0/4055780635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0d3520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1564009e50 tx=0x7f156402a710 comp rx=0 tx=0).stop 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.656+0000 7f1574454640 1 -- 172.21.15.16:0/4055780635 shutdown_connections 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.656+0000 7f1574454640 1 --2- 172.21.15.16:0/4055780635 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0d3520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.656+0000 7f1574454640 1 --2- 172.21.15.16:0/4055780635 >> v2:172.21.15.174:3300/0 conn(0x7f156c06f140 0x7f156c0d2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.656+0000 7f1574454640 1 -- 172.21.15.16:0/4055780635 >> 172.21.15.16:0/4055780635 conn(0x7f156c0681c0 msgr2=0x7f156c0685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:49.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.656+0000 7f1574454640 1 -- 172.21.15.16:0/4055780635 shutdown_connections 2024-05-11T01:13:49.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.656+0000 7f1574454640 1 -- 172.21.15.16:0/4055780635 wait complete. 2024-05-11T01:13:49.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.657+0000 7f1574454640 1 Processor -- start 2024-05-11T01:13:49.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.657+0000 7f1574454640 1 -- start start 2024-05-11T01:13:49.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f1574454640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f156c06f140 0x7f156c0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f1574454640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f1574454640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f156c15f530 0x7f156c0b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f1574454640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f156c0cfdf0 con 0x7f156c06f140 2024-05-11T01:13:49.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f1574454640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f156c163b30 con 0x7f156c15f530 2024-05-11T01:13:49.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f1574454640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f156c0cff70 con 0x7f156c0d3090 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f15721f0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f156c06f140 0x7f156c0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f15721f0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f156c06f140 0x7f156c0c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49508/0 (socket says 172.21.15.16:49508) 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f15721f0640 1 -- 172.21.15.16:0/321892582 learned_addr learned my addr 172.21.15.16:0/321892582 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f15719ef640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.658+0000 7f15729f1640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f156c15f530 0x7f156c0b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f15721f0640 1 -- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 msgr2=0x7f156c0b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f15721f0640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f15721f0640 1 -- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f156c15f530 msgr2=0x7f156c0b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f15721f0640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f156c15f530 0x7f156c0b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f15721f0640 1 -- 172.21.15.16:0/321892582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c0c8e40 con 0x7f156c06f140 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f15729f1640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f156c15f530 0x7f156c0b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f15721f0640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f156c06f140 0x7f156c0c8900 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1568001eb0 tx=0x7f156800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f1562ffd640 1 -- 172.21.15.16:0/321892582 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15680074e0 con 0x7f156c06f140 2024-05-11T01:13:49.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f1562ffd640 1 -- 172.21.15.16:0/321892582 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1568007680 con 0x7f156c06f140 2024-05-11T01:13:49.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f1562ffd640 1 -- 172.21.15.16:0/321892582 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15680049e0 con 0x7f156c06f140 2024-05-11T01:13:49.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156c1e8f00 con 0x7f156c06f140 2024-05-11T01:13:49.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.659+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f156c1e94c0 con 0x7f156c06f140 2024-05-11T01:13:49.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.660+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156c06a5b0 con 0x7f156c06f140 2024-05-11T01:13:49.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.660+0000 7f1562ffd640 1 -- 172.21.15.16:0/321892582 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 17) ==== 98145+0+0 (secure 0 0 0) 0x7f156801a020 con 0x7f156c06f140 2024-05-11T01:13:49.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.661+0000 7f1562ffd640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f1550076240 0x7f1550078700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.661+0000 7f1562ffd640 1 -- 172.21.15.16:0/321892582 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7f1568096dc0 con 0x7f156c06f140 2024-05-11T01:13:49.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.661+0000 7f15719ef640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f1550076240 0x7f1550078700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.662+0000 7f15719ef640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f1550076240 0x7f1550078700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f155c009560 tx=0x7f155c008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:49.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.665+0000 7f1562ffd640 1 -- 172.21.15.16:0/321892582 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1568060710 con 0x7f156c06f140 2024-05-11T01:13:49.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.749+0000 7f1562ffd640 1 -- 172.21.15.16:0/321892582 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f156805c2a0 con 0x7f156c06f140 2024-05-11T01:13:49.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.861+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f156c0c6400 con 0x7f156c06f140 2024-05-11T01:13:49.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.862+0000 7f1562ffd640 1 -- 172.21.15.16:0/321892582 <== mon.0 v2:172.21.15.16:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+14499 (secure 0 0 0) 0x7f156806d200 con 0x7f156c06f140 2024-05-11T01:13:49.861 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:49.862 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":51,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:13:47.741725+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.174:0/3993690094":"2024-05-12T01:13:45.139661+0000","172.21.15.174:0/3925966058":"2024-05-12T01:13:45.139661+0000","172.21.15.174:0/1910934249":"2024-05-12T01:13:45.139661+0000","172.21.15.174:0/3687919634":"2024-05-12T01:02:03.135099+0000","172.21.15.174:6833/704865226":"2024-05-12T01:02:03.135099+0000","172.21.15.16:6832/2086463820":"2024-05-12T01:13:44.736631+0000","172.21.15.174:0/115665805":"2024-05-12T01:13:45.139661+0000","172.21.15.174:6832/704865226":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/3333657563":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/990588653":"2024-05-12T01:02:03.135099+0000","172.21.15.174:0/2977765285":"2024-05-12T01:13:45.139661+0000","172.21.15.174:0/1943867453":"2024-05-12T01:13:45.139661+0000","172.21.15.174:6833/2127220129":"2024-05-12T01:13:45.139661+0000","172.21.15.174:0/3194764368":"2024-05-12T01:13:45.139661+0000","172.21.15.16:6834/2086463820":"2024-05-12T01:13:44.736631+0000","172.21.15.174:0/2159563993":"2024-05-12T01:02:03.135099+0000","172.21.15.174:6832/2127220129":"2024-05-12T01:13:45.139661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":1},{"begin":28,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":49,"length":2},{"begin":55,"length":1},{"begin":60,"length":3},{"begin":66,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":81,"length":3},{"begin":87,"length":1},{"begin":93,"length":2},{"begin":98,"length":1},{"begin":103,"length":2},{"begin":108,"length":1},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f1550076240 msgr2=0x7f1550078700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f1550076240 0x7f1550078700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f155c009560 tx=0x7f155c008040 comp rx=0 tx=0).stop 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f156c06f140 msgr2=0x7f156c0c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f156c06f140 0x7f156c0c8900 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1568001eb0 tx=0x7f156800c890 comp rx=0 tx=0).stop 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 shutdown_connections 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f1550076240 0x7f1550078700 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f156c15f530 0x7f156c0b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f156c0d3090 0x7f156c0b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 --2- 172.21.15.16:0/321892582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f156c06f140 0x7f156c0c8900 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 >> 172.21.15.16:0/321892582 conn(0x7f156c0681c0 msgr2=0x7f156c0b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 shutdown_connections 2024-05-11T01:13:49.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.864+0000 7f1574454640 1 -- 172.21.15.16:0/321892582 wait complete. 2024-05-11T01:13:49.874 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-11T01:01:03.770695+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-11T01:13:49.875 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-11T01:13:49.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.982+0000 7f7436f32640 1 Processor -- start 2024-05-11T01:13:49.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.982+0000 7f7436f32640 1 -- start start 2024-05-11T01:13:49.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7436f32640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f74300b5e30 0x7f74300b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7436f32640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74300b6210 0x7f74300ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7436f32640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7430072830 0x7f7430160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7436f32640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f7430161e00 con 0x7f74300b6210 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7436f32640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f74300cebc0 con 0x7f74300b5e30 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7436f32640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7430072d30 con 0x7f7430072830 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7427fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74300b6210 0x7f74300ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7427fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74300b6210 0x7f74300ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49520/0 (socket says 172.21.15.16:49520) 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7427fff640 1 -- 172.21.15.16:0/3412669956 learned_addr learned my addr 172.21.15.16:0/3412669956 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f74354cf640 1 --2- 172.21.15.16:0/3412669956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7430072830 0x7f7430160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7434cce640 1 --2- 172.21.15.16:0/3412669956 >> v2:172.21.15.174:3300/0 conn(0x7f74300b5e30 0x7f74300b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7427fff640 1 -- 172.21.15.16:0/3412669956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7430072830 msgr2=0x7f7430160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7427fff640 1 --2- 172.21.15.16:0/3412669956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7430072830 0x7f7430160f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7427fff640 1 -- 172.21.15.16:0/3412669956 >> v2:172.21.15.174:3300/0 conn(0x7f74300b5e30 msgr2=0x7f74300b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7427fff640 1 --2- 172.21.15.16:0/3412669956 >> v2:172.21.15.174:3300/0 conn(0x7f74300b5e30 0x7f74300b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7427fff640 1 -- 172.21.15.16:0/3412669956 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7430073010 con 0x7f74300b6210 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.983+0000 7f7434cce640 1 --2- 172.21.15.16:0/3412669956 >> v2:172.21.15.174:3300/0 conn(0x7f74300b5e30 0x7f74300b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.984+0000 7f7427fff640 1 --2- 172.21.15.16:0/3412669956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f74300ce680 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f743006e610 tx=0x7f742002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3640c12f5193e12e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.984+0000 7f74277fe640 1 -- 172.21.15.16:0/3412669956 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420037070 con 0x7f74300b6210 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.984+0000 7f74277fe640 1 -- 172.21.15.16:0/3412669956 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7420032440 con 0x7f74300b6210 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.984+0000 7f74277fe640 1 -- 172.21.15.16:0/3412669956 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420032810 con 0x7f74300b6210 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 -- 172.21.15.16:0/3412669956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 msgr2=0x7f74300ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 --2- 172.21.15.16:0/3412669956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f74300ce680 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f743006e610 tx=0x7f742002a140 comp rx=0 tx=0).stop 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 -- 172.21.15.16:0/3412669956 shutdown_connections 2024-05-11T01:13:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 --2- 172.21.15.16:0/3412669956 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7430072830 0x7f7430160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 --2- 172.21.15.16:0/3412669956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f74300ce680 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 --2- 172.21.15.16:0/3412669956 >> v2:172.21.15.174:3300/0 conn(0x7f74300b5e30 0x7f74300b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 -- 172.21.15.16:0/3412669956 >> 172.21.15.16:0/3412669956 conn(0x7f74300d1470 msgr2=0x7f74300d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:49.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 -- 172.21.15.16:0/3412669956 shutdown_connections 2024-05-11T01:13:49.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.985+0000 7f7436f32640 1 -- 172.21.15.16:0/3412669956 wait complete. 2024-05-11T01:13:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.986+0000 7f7436f32640 1 Processor -- start 2024-05-11T01:13:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.986+0000 7f7436f32640 1 -- start start 2024-05-11T01:13:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f7436f32640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7430072830 0x7f7430151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f7436f32640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74300b5e30 0x7f7430158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f7436f32640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f743015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f7436f32640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f74301614c0 con 0x7f74300b6210 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f7436f32640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f74300735d0 con 0x7f7430072830 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f7436f32640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7430161640 con 0x7f74300b5e30 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f74354cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f743015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f74354cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f743015eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49528/0 (socket says 172.21.15.16:49528) 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f74354cf640 1 -- 172.21.15.16:0/2442718032 learned_addr learned my addr 172.21.15.16:0/2442718032 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f7427fff640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74300b5e30 0x7f7430158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f7434cce640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7430072830 0x7f7430151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f74354cf640 1 -- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74300b5e30 msgr2=0x7f7430158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f74354cf640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74300b5e30 0x7f7430158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f74354cf640 1 -- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7430072830 msgr2=0x7f7430151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f74354cf640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7430072830 0x7f7430151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.987+0000 7f74354cf640 1 -- 172.21.15.16:0/2442718032 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74301588a0 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.988+0000 7f74354cf640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f743015eb50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f742800eed0 tx=0x7f742800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.988+0000 7f74257fa640 1 -- 172.21.15.16:0/2442718032 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428018020 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.988+0000 7f74257fa640 1 -- 172.21.15.16:0/2442718032 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742800bd30 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.988+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7430158b80 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.988+0000 7f74257fa640 1 -- 172.21.15.16:0/2442718032 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428014640 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.988+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7430159140 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.989+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f743006a5b0 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.989+0000 7f74257fa640 1 -- 172.21.15.16:0/2442718032 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f7428005d10 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.990+0000 7f74257fa640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f741c0762d0 0x7f741c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.990+0000 7f74257fa640 1 -- 172.21.15.16:0/2442718032 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7f7428097e90 con 0x7f74300b6210 2024-05-11T01:13:49.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.990+0000 7f7434cce640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f741c0762d0 0x7f741c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:49.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.991+0000 7f7434cce640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f741c0762d0 0x7f741c078790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f742c006fd0 tx=0x7f742c008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:49.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:49.994+0000 7f74257fa640 1 -- 172.21.15.16:0/2442718032 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7428022030 con 0x7f74300b6210 2024-05-11T01:13:50.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.185+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f743015d3d0 con 0x7f74300b6210 2024-05-11T01:13:50.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.185+0000 7f74257fa640 1 -- 172.21.15.16:0/2442718032 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f74280610b0 con 0x7f74300b6210 2024-05-11T01:13:50.184 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-05-11T01:13:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.187+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f741c0762d0 msgr2=0x7f741c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.187+0000 7f7436f32640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f741c0762d0 0x7f741c078790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f742c006fd0 tx=0x7f742c008040 comp rx=0 tx=0).stop 2024-05-11T01:13:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.187+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 msgr2=0x7f743015eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.187+0000 7f7436f32640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f743015eb50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f742800eed0 tx=0x7f742800b480 comp rx=0 tx=0).stop 2024-05-11T01:13:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.188+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 shutdown_connections 2024-05-11T01:13:50.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.188+0000 7f7436f32640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74300b6210 0x7f743015eb50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.188+0000 7f7436f32640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f74300b5e30 0x7f7430158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.188+0000 7f7436f32640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f741c0762d0 0x7f741c078790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.188+0000 7f7436f32640 1 --2- 172.21.15.16:0/2442718032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7430072830 0x7f7430151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.188+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 >> 172.21.15.16:0/2442718032 conn(0x7f74300d1470 msgr2=0x7f743015fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:50.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.188+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 shutdown_connections 2024-05-11T01:13:50.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.188+0000 7f7436f32640 1 -- 172.21.15.16:0/2442718032 wait complete. 2024-05-11T01:13:50.198 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2024-05-11T01:13:50.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.303+0000 7fe43a247640 1 Processor -- start 2024-05-11T01:13:50.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.303+0000 7fe43a247640 1 -- start start 2024-05-11T01:13:50.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe43a247640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe434160360 0x7fe434160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:50.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe43a247640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4340d0d40 0x7fe4340b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe43a247640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4340d11f0 0x7fe4340b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe43a247640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe434160c80 con 0x7fe434160360 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe43a247640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fe4340d1770 con 0x7fe4340d0d40 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe43a247640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe434163300 con 0x7fe4340d11f0 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe4337fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe434160360 0x7fe434160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe4337fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe434160360 0x7fe434160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49534/0 (socket says 172.21.15.16:49534) 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe4337fe640 1 -- 172.21.15.16:0/2973173246 learned_addr learned my addr 172.21.15.16:0/2973173246 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe433fff640 1 --2- 172.21.15.16:0/2973173246 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4340d11f0 0x7fe4340b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe432ffd640 1 --2- 172.21.15.16:0/2973173246 >> v2:172.21.15.174:3300/0 conn(0x7fe4340d0d40 0x7fe4340b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe4337fe640 1 -- 172.21.15.16:0/2973173246 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4340d11f0 msgr2=0x7fe4340b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe4337fe640 1 --2- 172.21.15.16:0/2973173246 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4340d11f0 0x7fe4340b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe4337fe640 1 -- 172.21.15.16:0/2973173246 >> v2:172.21.15.174:3300/0 conn(0x7fe4340d0d40 msgr2=0x7fe4340b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:50.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe4337fe640 1 --2- 172.21.15.16:0/2973173246 >> v2:172.21.15.174:3300/0 conn(0x7fe4340d0d40 0x7fe4340b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.304+0000 7fe4337fe640 1 -- 172.21.15.16:0/2973173246 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4341635e0 con 0x7fe434160360 2024-05-11T01:13:50.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.305+0000 7fe4337fe640 1 --2- 172.21.15.16:0/2973173246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe434160360 0x7fe434160740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe4340d1a50 tx=0x7fe42402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d23c5d59ad18ca server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:50.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.305+0000 7fe4327fc640 1 -- 172.21.15.16:0/2973173246 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424037070 con 0x7fe434160360 2024-05-11T01:13:50.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.305+0000 7fe4327fc640 1 -- 172.21.15.16:0/2973173246 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe424032440 con 0x7fe434160360 2024-05-11T01:13:50.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.305+0000 7fe4327fc640 1 -- 172.21.15.16:0/2973173246 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424032810 con 0x7fe434160360 2024-05-11T01:13:50.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.305+0000 7fe43a247640 1 -- 172.21.15.16:0/2973173246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe434160360 msgr2=0x7fe434160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:50.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.305+0000 7fe43a247640 1 --2- 172.21.15.16:0/2973173246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe434160360 0x7fe434160740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe4340d1a50 tx=0x7fe42402a1e0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.306+0000 7fe43a247640 1 -- 172.21.15.16:0/2973173246 shutdown_connections 2024-05-11T01:13:50.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.306+0000 7fe43a247640 1 --2- 172.21.15.16:0/2973173246 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe4340d11f0 0x7fe4340b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.306+0000 7fe43a247640 1 --2- 172.21.15.16:0/2973173246 >> v2:172.21.15.174:3300/0 conn(0x7fe4340d0d40 0x7fe4340b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.306+0000 7fe43a247640 1 --2- 172.21.15.16:0/2973173246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe434160360 0x7fe434160740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.306+0000 7fe43a247640 1 -- 172.21.15.16:0/2973173246 >> 172.21.15.16:0/2973173246 conn(0x7fe4340681c0 msgr2=0x7fe4340685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:50.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.306+0000 7fe43a247640 1 -- 172.21.15.16:0/2973173246 shutdown_connections 2024-05-11T01:13:50.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.306+0000 7fe43a247640 1 -- 172.21.15.16:0/2973173246 wait complete. 2024-05-11T01:13:50.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.307+0000 7fe43a247640 1 Processor -- start 2024-05-11T01:13:50.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.307+0000 7fe43a247640 1 -- start start 2024-05-11T01:13:50.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe43a247640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4340d0d40 0x7fe4340c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:50.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe43a247640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340d11f0 0x7fe4340ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:50.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe43a247640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe434160360 0x7fe4340ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:50.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe43a247640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe4341640c0 con 0x7fe4340d0d40 2024-05-11T01:13:50.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe43a247640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe434163ba0 con 0x7fe4340d11f0 2024-05-11T01:13:50.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe43a247640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe4340c79f0 con 0x7fe434160360 2024-05-11T01:13:50.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4340d0d40 0x7fe4340c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:50.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4340d0d40 0x7fe4340c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49546/0 (socket says 172.21.15.16:49546) 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 -- 172.21.15.16:0/4239717145 learned_addr learned my addr 172.21.15.16:0/4239717145 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe433fff640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe434160360 0x7fe4340ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe432ffd640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340d11f0 0x7fe4340ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 -- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe434160360 msgr2=0x7fe4340ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe434160360 0x7fe4340ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 -- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340d11f0 msgr2=0x7fe4340ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340d11f0 0x7fe4340ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 -- 172.21.15.16:0/4239717145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4340c7cd0 con 0x7fe4340d0d40 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe4337fe640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4340d0d40 0x7fe4340c5f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe424000c00 tx=0x7fe4240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:50.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe41bfff640 1 -- 172.21.15.16:0/4239717145 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424041020 con 0x7fe4340d0d40 2024-05-11T01:13:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe41bfff640 1 -- 172.21.15.16:0/4239717145 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4240306c0 con 0x7fe4340d0d40 2024-05-11T01:13:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4340c7fb0 con 0x7fe4340d0d40 2024-05-11T01:13:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.308+0000 7fe41bfff640 1 -- 172.21.15.16:0/4239717145 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424037040 con 0x7fe4340d0d40 2024-05-11T01:13:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.309+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4340c8570 con 0x7fe4340d0d40 2024-05-11T01:13:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.310+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe43406a5b0 con 0x7fe4340d0d40 2024-05-11T01:13:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.310+0000 7fe41bfff640 1 -- 172.21.15.16:0/4239717145 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fe424044020 con 0x7fe4340d0d40 2024-05-11T01:13:50.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.311+0000 7fe41bfff640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe4200762d0 0x7fe420078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:50.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.311+0000 7fe41bfff640 1 -- 172.21.15.16:0/4239717145 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7fe4240b7ed0 con 0x7fe4340d0d40 2024-05-11T01:13:50.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.311+0000 7fe432ffd640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe4200762d0 0x7fe420078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:50.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.311+0000 7fe432ffd640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe4200762d0 0x7fe420078790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe428006fd0 tx=0x7fe428008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:50.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.315+0000 7fe41bfff640 1 -- 172.21.15.16:0/4239717145 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe42404b030 con 0x7fe4340d0d40 2024-05-11T01:13:50.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:50.588+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) -- 0x7fe434164240 con 0x7fe4340d0d40 2024-05-11T01:13:51.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.535+0000 7fe41bfff640 1 -- 172.21.15.16:0/4239717145 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v437) ==== 157+0+0 (secure 0 0 0) 0x7fe424081740 con 0x7fe4340d0d40 2024-05-11T01:13:51.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe4200762d0 msgr2=0x7fe420078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:51.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe4200762d0 0x7fe420078790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe428006fd0 tx=0x7fe428008040 comp rx=0 tx=0).stop 2024-05-11T01:13:51.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4340d0d40 msgr2=0x7fe4340c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:51.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4340d0d40 0x7fe4340c5f50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe424000c00 tx=0x7fe4240046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 shutdown_connections 2024-05-11T01:13:51.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe434160360 0x7fe4340ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe4200762d0 0x7fe420078790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4340d11f0 0x7fe4340ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 --2- 172.21.15.16:0/4239717145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe4340d0d40 0x7fe4340c5f50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 >> 172.21.15.16:0/4239717145 conn(0x7fe4340681c0 msgr2=0x7fe43415f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:51.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 shutdown_connections 2024-05-11T01:13:51.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.539+0000 7fe43a247640 1 -- 172.21.15.16:0/4239717145 wait complete. 2024-05-11T01:13:51.552 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-11T01:13:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.667+0000 7ff22eacf640 1 Processor -- start 2024-05-11T01:13:51.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.667+0000 7ff22eacf640 1 -- start start 2024-05-11T01:13:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.667+0000 7ff22eacf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2280bae40 0x7ff2281604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.667+0000 7ff22eacf640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff228163010 0x7ff2280b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:51.667 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.667+0000 7ff22eacf640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2281609e0 con 0x7ff2280b72c0 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.667+0000 7ff22eacf640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ff2280b76f0 con 0x7ff228163010 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.667+0000 7ff22eacf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff2281635d0 con 0x7ff2280bae40 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff22c86b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2280bae40 0x7ff2281604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff227fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff228163010 0x7ff2280b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff227fff640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ff228163010 0x7ff2280b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:59692/0 (socket says 172.21.15.16:59692) 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff22c86b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2280bae40 0x7ff2281604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:58262/0 (socket says 172.21.15.16:58262) 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff227fff640 1 -- 172.21.15.16:0/2274464701 learned_addr learned my addr 172.21.15.16:0/2274464701 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff2277fe640 1 -- 172.21.15.16:0/2274464701 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402936619 0 0) 0x7ff218001110 con 0x7ff2280b72c0 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff2277fe640 1 -- 172.21.15.16:0/2274464701 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff210003520 con 0x7ff2280b72c0 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff22c86b640 1 -- 172.21.15.16:0/2274464701 >> v2:172.21.15.174:3300/0 conn(0x7ff228163010 msgr2=0x7ff2280b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff22c86b640 1 --2- 172.21.15.16:0/2274464701 >> v2:172.21.15.174:3300/0 conn(0x7ff228163010 0x7ff2280b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff22c86b640 1 -- 172.21.15.16:0/2274464701 >> v1:172.21.15.174:6789/0 conn(0x7ff2280b72c0 legacy=0x7ff2280b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff22c86b640 1 -- 172.21.15.16:0/2274464701 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2281638b0 con 0x7ff2280bae40 2024-05-11T01:13:51.668 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.668+0000 7ff227fff640 1 --2- 172.21.15.16:0/2274464701 >> v2:172.21.15.174:3300/0 conn(0x7ff228163010 0x7ff2280b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.669+0000 7ff22c86b640 1 --2- 172.21.15.16:0/2274464701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2280bae40 0x7ff2281604a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff220009d90 tx=0x7ff22002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32fa135e3433ac68 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.669+0000 7ff2277fe640 1 -- 172.21.15.16:0/2274464701 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220031600 con 0x7ff2280bae40 2024-05-11T01:13:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.669+0000 7ff2277fe640 1 -- 172.21.15.16:0/2274464701 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2200317a0 con 0x7ff2280bae40 2024-05-11T01:13:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.669+0000 7ff2277fe640 1 -- 172.21.15.16:0/2274464701 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220031b50 con 0x7ff2280bae40 2024-05-11T01:13:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.670+0000 7ff22eacf640 1 -- 172.21.15.16:0/2274464701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2280bae40 msgr2=0x7ff2281604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.670+0000 7ff22eacf640 1 --2- 172.21.15.16:0/2274464701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2280bae40 0x7ff2281604a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff220009d90 tx=0x7ff22002a5d0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.670+0000 7ff22eacf640 1 -- 172.21.15.16:0/2274464701 shutdown_connections 2024-05-11T01:13:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.670+0000 7ff22eacf640 1 --2- 172.21.15.16:0/2274464701 >> v2:172.21.15.174:3300/0 conn(0x7ff228163010 0x7ff2280b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.670+0000 7ff22eacf640 1 --2- 172.21.15.16:0/2274464701 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff2280bae40 0x7ff2281604a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.670+0000 7ff22eacf640 1 -- 172.21.15.16:0/2274464701 >> 172.21.15.16:0/2274464701 conn(0x7ff228074140 msgr2=0x7ff2280d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.670+0000 7ff22eacf640 1 -- 172.21.15.16:0/2274464701 shutdown_connections 2024-05-11T01:13:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.670+0000 7ff22eacf640 1 -- 172.21.15.16:0/2274464701 wait complete. 2024-05-11T01:13:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.671+0000 7ff22eacf640 1 Processor -- start 2024-05-11T01:13:51.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.671+0000 7ff22eacf640 1 -- start start 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff22eacf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2280b72c0 0x7ff2280cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff22eacf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2280bae40 0x7ff2280cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff22eacf640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff228163010 0x7ff2281f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff22eacf640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2280bb220 con 0x7ff2280bae40 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff22eacf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff228163e70 con 0x7ff2280b72c0 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff22eacf640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff2280b4480 con 0x7ff228163010 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff227fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2280bae40 0x7ff2280cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff227fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2280bae40 0x7ff2280cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49556/0 (socket says 172.21.15.16:49556) 2024-05-11T01:13:51.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff227fff640 1 -- 172.21.15.16:0/1951367653 learned_addr learned my addr 172.21.15.16:0/1951367653 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff22c86b640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2280b72c0 0x7ff2280cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.672+0000 7ff22d06c640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff228163010 0x7ff2281f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff227fff640 1 -- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff228163010 msgr2=0x7ff2281f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff227fff640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff228163010 0x7ff2281f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff227fff640 1 -- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2280b72c0 msgr2=0x7ff2280cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff227fff640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2280b72c0 0x7ff2280cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff227fff640 1 -- 172.21.15.16:0/1951367653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2280cb350 con 0x7ff2280bae40 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff227fff640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2280bae40 0x7ff2280cb600 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00e9b0 tx=0x7ff21c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff2257fa640 1 -- 172.21.15.16:0/1951367653 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c017070 con 0x7ff2280bae40 2024-05-11T01:13:51.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff2257fa640 1 -- 172.21.15.16:0/1951367653 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21c00c9a0 con 0x7ff2280bae40 2024-05-11T01:13:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff2257fa640 1 -- 172.21.15.16:0/1951367653 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00cd50 con 0x7ff2280bae40 2024-05-11T01:13:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2280c9d70 con 0x7ff2280bae40 2024-05-11T01:13:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.673+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2280ca330 con 0x7ff2280bae40 2024-05-11T01:13:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.674+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22806e210 con 0x7ff2280bae40 2024-05-11T01:13:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.675+0000 7ff2257fa640 1 -- 172.21.15.16:0/1951367653 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7ff21c01a070 con 0x7ff2280bae40 2024-05-11T01:13:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.675+0000 7ff2257fa640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff2140762d0 0x7ff214078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.675+0000 7ff2257fa640 1 -- 172.21.15.16:0/1951367653 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7ff21c0974a0 con 0x7ff2280bae40 2024-05-11T01:13:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.676+0000 7ff22c86b640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff2140762d0 0x7ff214078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.676+0000 7ff22c86b640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff2140762d0 0x7ff214078790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff220034000 tx=0x7ff22002f000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:51.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.680+0000 7ff2257fa640 1 -- 172.21.15.16:0/1951367653 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff22806e210 con 0x7ff2280bae40 2024-05-11T01:13:51.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.871+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff2280d2fa0 con 0x7ff2280bae40 2024-05-11T01:13:51.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.874+0000 7ff2257fa640 1 -- 172.21.15.16:0/1951367653 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7ff21c060750 con 0x7ff2280bae40 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.876+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff2140762d0 msgr2=0x7ff214078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.876+0000 7ff22eacf640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff2140762d0 0x7ff214078790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff220034000 tx=0x7ff22002f000 comp rx=0 tx=0).stop 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.876+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2280bae40 msgr2=0x7ff2280cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.876+0000 7ff22eacf640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2280bae40 0x7ff2280cb600 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff21c00e9b0 tx=0x7ff21c00ee70 comp rx=0 tx=0).stop 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.877+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 shutdown_connections 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.877+0000 7ff22eacf640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff228163010 0x7ff2281f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.877+0000 7ff22eacf640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2280bae40 0x7ff2280cb600 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.877+0000 7ff22eacf640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff2140762d0 0x7ff214078790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.877+0000 7ff22eacf640 1 --2- 172.21.15.16:0/1951367653 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2280b72c0 0x7ff2280cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.877+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 >> 172.21.15.16:0/1951367653 conn(0x7ff228074140 msgr2=0x7ff228161ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:51.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.877+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 shutdown_connections 2024-05-11T01:13:51.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:51.877+0000 7ff22eacf640 1 -- 172.21.15.16:0/1951367653 wait complete. 2024-05-11T01:13:51.887 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-11T01:13:51.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-11T01:13:51.922 DEBUG:teuthology.orchestra.run.smithi174:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-11T01:13:51.965 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-11T01:13:51.965 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:13:51.965 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:51.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=11459 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-11T01:13:51.982 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:13:51.982 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:52.024 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-11T01:13:52.024 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:13:52.024 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:52.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=11459 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-11T01:13:52.041 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:13:52.041 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:13:52.082 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-11T01:13:52.082 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-11T01:13:52.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:13:52.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.187+0000 7f55a14c4640 1 Processor -- start 2024-05-11T01:13:52.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.187+0000 7f55a14c4640 1 -- start start 2024-05-11T01:13:52.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f55a14c4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f559c0cfc40 0x7f559c163b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f55a14c4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f559c070890 0x7f559c070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f55a14c4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f559c1630b0 con 0x7f559c0d0020 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f55a14c4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f559c1605f0 con 0x7f559c0cfc40 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f55a14c4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f559c1608d0 con 0x7f559c070890 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f559a7fc640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f559c0d0020 0x7f559c15fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55986/0 (socket says 172.21.15.16:55986) 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f559a7fc640 1 -- 172.21.15.16:0/142661462 learned_addr learned my addr 172.21.15.16:0/142661462 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f559affd640 1 --2- 172.21.15.16:0/142661462 >> v2:172.21.15.16:3300/0 conn(0x7f559c0cfc40 0x7f559c163b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f559b7fe640 1 --2- 172.21.15.16:0/142661462 >> v2:172.21.15.174:3300/0 conn(0x7f559c070890 0x7f559c070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f559affd640 1 -- 172.21.15.16:0/142661462 >> v2:172.21.15.174:3300/0 conn(0x7f559c070890 msgr2=0x7f559c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f559affd640 1 --2- 172.21.15.16:0/142661462 >> v2:172.21.15.174:3300/0 conn(0x7f559c070890 0x7f559c070ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f5599ffb640 1 -- 172.21.15.16:0/142661462 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823206754 0 0) 0x7f559c1630b0 con 0x7f559c0d0020 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.188+0000 7f559affd640 1 -- 172.21.15.16:0/142661462 >> v1:172.21.15.16:6789/0 conn(0x7f559c0d0020 legacy=0x7f559c15fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.189+0000 7f559affd640 1 -- 172.21.15.16:0/142661462 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c163370 con 0x7f559c0cfc40 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.189+0000 7f559affd640 1 --2- 172.21.15.16:0/142661462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c163b70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f559c073380 tx=0x7f559402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afecd9a30dee219 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.189+0000 7f5599ffb640 1 -- 172.21.15.16:0/142661462 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594007740 con 0x7f559c0cfc40 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.189+0000 7f5599ffb640 1 -- 172.21.15.16:0/142661462 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55940078e0 con 0x7f559c0cfc40 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.189+0000 7f5599ffb640 1 -- 172.21.15.16:0/142661462 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594007cb0 con 0x7f559c0cfc40 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.190+0000 7f55a14c4640 1 -- 172.21.15.16:0/142661462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 msgr2=0x7f559c163b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.190+0000 7f55a14c4640 1 --2- 172.21.15.16:0/142661462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c163b70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f559c073380 tx=0x7f559402a680 comp rx=0 tx=0).stop 2024-05-11T01:13:52.191 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:13:52.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.190+0000 7f55a14c4640 1 -- 172.21.15.16:0/142661462 shutdown_connections 2024-05-11T01:13:52.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.190+0000 7f55a14c4640 1 --2- 172.21.15.16:0/142661462 >> v2:172.21.15.174:3300/0 conn(0x7f559c070890 0x7f559c070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.190+0000 7f55a14c4640 1 --2- 172.21.15.16:0/142661462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c163b70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.190+0000 7f55a14c4640 1 -- 172.21.15.16:0/142661462 >> 172.21.15.16:0/142661462 conn(0x7f559c0b3de0 msgr2=0x7f559c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:52.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.190+0000 7f55a14c4640 1 -- 172.21.15.16:0/142661462 shutdown_connections 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.190+0000 7f55a14c4640 1 -- 172.21.15.16:0/142661462 wait complete. 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.191+0000 7f55a14c4640 1 Processor -- start 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.191+0000 7f55a14c4640 1 -- start start 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f55a14c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f559c070890 0x7f559c13ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f55a14c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c13a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f55a14c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f559c0d0020 0x7f559c0b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f55a14c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f559c0d04b0 con 0x7f559c0cfc40 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f55a14c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f559c15d3f0 con 0x7f559c0d0020 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f55a14c4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f559c073c40 con 0x7f559c070890 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f559a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c13a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f559a7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c13a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49584/0 (socket says 172.21.15.16:49584) 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f559a7fc640 1 -- 172.21.15.16:0/2488668532 learned_addr learned my addr 172.21.15.16:0/2488668532 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:52.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f559affd640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f559c070890 0x7f559c13ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.192+0000 7f559b7fe640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f559c0d0020 0x7f559c0b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f559a7fc640 1 -- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f559c070890 msgr2=0x7f559c13ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f559a7fc640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f559c070890 0x7f559c13ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f559a7fc640 1 -- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f559c0d0020 msgr2=0x7f559c0b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f559a7fc640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f559c0d0020 0x7f559c0b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f559a7fc640 1 -- 172.21.15.16:0/2488668532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c0b13a0 con 0x7f559c0cfc40 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f559a7fc640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c13a560 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f558400c410 tx=0x7f558400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f55937fe640 1 -- 172.21.15.16:0/2488668532 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55840074e0 con 0x7f559c0cfc40 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f55937fe640 1 -- 172.21.15.16:0/2488668532 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55840047e0 con 0x7f559c0cfc40 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c0b1680 con 0x7f559c0cfc40 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f55937fe640 1 -- 172.21.15.16:0/2488668532 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584004bd0 con 0x7f559c0cfc40 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.193+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c0b1080 con 0x7f559c0cfc40 2024-05-11T01:13:52.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.194+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c0d1710 con 0x7f559c0cfc40 2024-05-11T01:13:52.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.195+0000 7f55937fe640 1 -- 172.21.15.16:0/2488668532 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f5584011070 con 0x7f559c0cfc40 2024-05-11T01:13:52.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.195+0000 7f55937fe640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f557c076300 0x7f557c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.195+0000 7f55937fe640 1 -- 172.21.15.16:0/2488668532 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7f5584097380 con 0x7f559c0cfc40 2024-05-11T01:13:52.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.195+0000 7f559affd640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f557c076300 0x7f557c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.196+0000 7f559affd640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f557c076300 0x7f557c0787c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5594034000 tx=0x7f559402f000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:52.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.200+0000 7f55937fe640 1 -- 172.21.15.16:0/2488668532 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f559c0d1710 con 0x7f559c0cfc40 2024-05-11T01:13:52.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.429+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f559c06a5b0 con 0x7f559c0cfc40 2024-05-11T01:13:52.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.430+0000 7f55937fe640 1 -- 172.21.15.16:0/2488668532 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3869 (secure 0 0 0) 0x7f5584060b60 con 0x7f559c0cfc40 2024-05-11T01:13:52.429 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:52.430 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4493,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/325711019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":325711019},{"type":"v1","addr":"172.21.15.174:6836","nonce":325711019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4499,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2354391599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2354391599},{"type":"v1","addr":"172.21.15.16:6835","nonce":2354391599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4809,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2932760959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2932760959},{"type":"v1","addr":"172.21.15.174:6837","nonce":2932760959}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/146346066","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":146346066},{"type":"v1","addr":"172.21.15.16:6834","nonce":146346066}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-05-11T01:13:52.430 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2024-05-11T01:13:52.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f557c076300 msgr2=0x7f557c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f557c076300 0x7f557c0787c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5594034000 tx=0x7f559402f000 comp rx=0 tx=0).stop 2024-05-11T01:13:52.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 msgr2=0x7f559c13a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c13a560 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f558400c410 tx=0x7f558400c8d0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 shutdown_connections 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f557c076300 0x7f557c0787c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f559c0d0020 0x7f559c0b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f559c0cfc40 0x7f559c13a560 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 --2- 172.21.15.16:0/2488668532 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f559c070890 0x7f559c13ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 >> 172.21.15.16:0/2488668532 conn(0x7f559c0b3de0 msgr2=0x7f559c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 shutdown_connections 2024-05-11T01:13:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.432+0000 7f55a14c4640 1 -- 172.21.15.16:0/2488668532 wait complete. 2024-05-11T01:13:52.442 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-11T01:13:52.443 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-11T01:13:52.443 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-11T01:13:52.443 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:13:52.443 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-11T01:13:52.443 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-11T01:13:52.443 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-11T01:13:52.444 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:13:52.444 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-11T01:13:52.444 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-11T01:13:52.444 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-11T01:13:52.444 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:13:52.444 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-11T01:13:52.444 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-11T01:13:52.445 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-11T01:13:52.445 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:13:52.452 INFO:tasks.ceph.mds.a:Stopped 2024-05-11T01:13:52.452 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-11T01:13:52.454 INFO:tasks.ceph.mds.c:Stopped 2024-05-11T01:13:52.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-11T01:13:52.456 INFO:tasks.ceph.mds.b:Stopped 2024-05-11T01:13:52.456 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-11T01:13:52.457 INFO:tasks.ceph.mds.d:Stopped 2024-05-11T01:13:52.457 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-11T01:13:52.496 INFO:tasks.ceph.mds.a:Started 2024-05-11T01:13:52.496 DEBUG:teuthology.parallel:result is None 2024-05-11T01:13:52.498 INFO:tasks.ceph.mds.c:Started 2024-05-11T01:13:52.498 DEBUG:teuthology.parallel:result is None 2024-05-11T01:13:52.499 INFO:tasks.ceph.mds.b:Started 2024-05-11T01:13:52.499 DEBUG:teuthology.parallel:result is None 2024-05-11T01:13:52.499 INFO:tasks.ceph.mds.d:Started 2024-05-11T01:13:52.499 DEBUG:teuthology.parallel:result is None 2024-05-11T01:13:52.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-11T01:13:52.575 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-05-11T01:13:52.575 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-05-11T01:13:52.582 INFO:tasks.ceph.mds.d.smithi174.stdout:starting mds.d at 2024-05-11T01:13:52.582 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.609+0000 7ff8378c4640 1 Processor -- start 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.609+0000 7ff8378c4640 1 -- start start 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.610+0000 7ff8378c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d0000 0x7ff8300d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.610+0000 7ff8378c4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8300d0920 con 0x7ff8300baed0 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.610+0000 7ff8378c4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff830163820 con 0x7ff8300d3bf0 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.610+0000 7ff8378c4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff830163b00 con 0x7ff8300d0000 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.610+0000 7ff834e5f640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff8300baed0 0x7ff830162fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:55996/0 (socket says 172.21.15.16:55996) 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.611+0000 7ff834e5f640 1 -- 172.21.15.16:0/2124670175 learned_addr learned my addr 172.21.15.16:0/2124670175 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.611+0000 7ff835660640 1 --2- 172.21.15.16:0/2124670175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d0000 0x7ff8300d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.611+0000 7ff827fff640 1 -- 172.21.15.16:0/2124670175 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868944247 0 0) 0x7ff830163820 con 0x7ff8300d3bf0 2024-05-11T01:13:52.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.611+0000 7ff827fff640 1 -- 172.21.15.16:0/2124670175 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff81c003520 con 0x7ff8300d3bf0 2024-05-11T01:13:52.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.611+0000 7ff835660640 1 -- 172.21.15.16:0/2124670175 >> v1:172.21.15.174:6789/0 conn(0x7ff8300d3bf0 legacy=0x7ff8300d4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.611+0000 7ff835660640 1 -- 172.21.15.16:0/2124670175 >> v1:172.21.15.16:6789/0 conn(0x7ff8300baed0 legacy=0x7ff830162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.611+0000 7ff835660640 1 -- 172.21.15.16:0/2124670175 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8300d33f0 con 0x7ff8300d0000 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff835660640 1 --2- 172.21.15.16:0/2124670175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d0000 0x7ff8300d03e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0097d0 tx=0x7ff82c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b93dd09f2da2b7cf server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff827fff640 1 -- 172.21.15.16:0/2124670175 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c037070 con 0x7ff8300d0000 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff827fff640 1 -- 172.21.15.16:0/2124670175 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff82c032440 con 0x7ff8300d0000 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff827fff640 1 -- 172.21.15.16:0/2124670175 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0327f0 con 0x7ff8300d0000 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff8378c4640 1 -- 172.21.15.16:0/2124670175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d0000 msgr2=0x7ff8300d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff8378c4640 1 --2- 172.21.15.16:0/2124670175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d0000 0x7ff8300d03e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0097d0 tx=0x7ff82c02a210 comp rx=0 tx=0).stop 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff8378c4640 1 -- 172.21.15.16:0/2124670175 shutdown_connections 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff8378c4640 1 --2- 172.21.15.16:0/2124670175 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d0000 0x7ff8300d03e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff8378c4640 1 -- 172.21.15.16:0/2124670175 >> 172.21.15.16:0/2124670175 conn(0x7ff830074140 msgr2=0x7ff8300b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff8378c4640 1 -- 172.21.15.16:0/2124670175 shutdown_connections 2024-05-11T01:13:52.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.612+0000 7ff8378c4640 1 -- 172.21.15.16:0/2124670175 wait complete. 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff8378c4640 1 Processor -- start 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff8378c4640 1 -- start start 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff8378c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8300baed0 0x7ff8301f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff8378c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8300d0000 0x7ff8300ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff8378c4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d3bf0 0x7ff8300d5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff8378c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff83015f750 con 0x7ff8300d0000 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff8378c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff830163de0 con 0x7ff8300baed0 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff8378c4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff83015f8d0 con 0x7ff8300d3bf0 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff834e5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8300d0000 0x7ff8300ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff834e5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8300d0000 0x7ff8300ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49628/0 (socket says 172.21.15.16:49628) 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.614+0000 7ff834e5f640 1 -- 172.21.15.16:0/1873113987 learned_addr learned my addr 172.21.15.16:0/1873113987 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff835660640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8300baed0 0x7ff8301f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff835e61640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d3bf0 0x7ff8300d5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff834e5f640 1 -- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d3bf0 msgr2=0x7ff8300d5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff834e5f640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d3bf0 0x7ff8300d5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff834e5f640 1 -- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8300baed0 msgr2=0x7ff8301f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff834e5f640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8300baed0 0x7ff8301f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff834e5f640 1 -- 172.21.15.16:0/1873113987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff830161ca0 con 0x7ff8300d0000 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff835e61640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d3bf0 0x7ff8300d5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff834e5f640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8300d0000 0x7ff8300ce9f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c400 tx=0x7ff82000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff825ffb640 1 -- 172.21.15.16:0/1873113987 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff820017070 con 0x7ff8300d0000 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff825ffb640 1 -- 172.21.15.16:0/1873113987 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff820005ce0 con 0x7ff8300d0000 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff825ffb640 1 -- 172.21.15.16:0/1873113987 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8200072d0 con 0x7ff8300d0000 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff830161f80 con 0x7ff8300d0000 2024-05-11T01:13:52.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.615+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff830162540 con 0x7ff8300d0000 2024-05-11T01:13:52.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.616+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff83006a5b0 con 0x7ff8300d0000 2024-05-11T01:13:52.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.617+0000 7ff825ffb640 1 -- 172.21.15.16:0/1873113987 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7ff82001a070 con 0x7ff8300d0000 2024-05-11T01:13:52.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.617+0000 7ff825ffb640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff814076300 0x7ff8140787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:52.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.617+0000 7ff825ffb640 1 -- 172.21.15.16:0/1873113987 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5952+0+0 (secure 0 0 0) 0x7ff8200968b0 con 0x7ff8300d0000 2024-05-11T01:13:52.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.618+0000 7ff835660640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff814076300 0x7ff8140787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:52.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.618+0000 7ff835660640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff814076300 0x7ff8140787c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff82c034000 tx=0x7ff82c02e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:52.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.622+0000 7ff825ffb640 1 -- 172.21.15.16:0/1873113987 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff82005fae0 con 0x7ff8300d0000 2024-05-11T01:13:52.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:52.825+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff8300cb360 con 0x7ff8300d0000 2024-05-11T01:13:53.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.544+0000 7ff825ffb640 1 -- 172.21.15.16:0/1873113987 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) ==== 97+0+0 (secure 0 0 0) 0x7ff820063de0 con 0x7ff8300d0000 2024-05-11T01:13:53.544 INFO:teuthology.orchestra.run.smithi016.stderr: removed all blocklist entries 2024-05-11T01:13:53.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff814076300 msgr2=0x7ff8140787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:53.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff814076300 0x7ff8140787c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff82c034000 tx=0x7ff82c02e000 comp rx=0 tx=0).stop 2024-05-11T01:13:53.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8300d0000 msgr2=0x7ff8300ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:53.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8300d0000 0x7ff8300ce9f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c400 tx=0x7ff82000c8c0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 shutdown_connections 2024-05-11T01:13:53.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff8300d3bf0 0x7ff8300d5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8300d0000 0x7ff8300ce9f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff814076300 0x7ff8140787c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 --2- 172.21.15.16:0/1873113987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff8300baed0 0x7ff8301f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 >> 172.21.15.16:0/1873113987 conn(0x7ff830074140 msgr2=0x7ff8300d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:53.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 shutdown_connections 2024-05-11T01:13:53.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.548+0000 7ff8378c4640 1 -- 172.21.15.16:0/1873113987 wait complete. 2024-05-11T01:13:53.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-11T01:13:53.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.672+0000 7fefc163f640 1 Processor -- start 2024-05-11T01:13:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.672+0000 7fefc163f640 1 -- start start 2024-05-11T01:13:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.673+0000 7fefc163f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.673+0000 7fefc163f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fefbc06f0b0 0x7fefbc1631d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.673+0000 7fefc163f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefbc071210 con 0x7fefbc0cefe0 2024-05-11T01:13:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.673+0000 7fefc163f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fefbc06f560 con 0x7fefbc06f0b0 2024-05-11T01:13:53.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.673+0000 7fefc163f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fefbc0d0cf0 con 0x7fefbc0cffc0 2024-05-11T01:13:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.674+0000 7fefba7fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.674+0000 7fefba7fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:48858/0 (socket says 172.21.15.16:48858) 2024-05-11T01:13:53.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.674+0000 7fefba7fc640 1 -- 172.21.15.16:0/4001964218 learned_addr learned my addr 172.21.15.16:0/4001964218 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.674+0000 7fefbb7fe640 1 --2- 172.21.15.16:0/4001964218 >> v2:172.21.15.174:3300/0 conn(0x7fefbc06f0b0 0x7fefbc1631d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.674+0000 7fefba7fc640 1 -- 172.21.15.16:0/4001964218 >> v2:172.21.15.174:3300/0 conn(0x7fefbc06f0b0 msgr2=0x7fefbc1631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.674+0000 7fefba7fc640 1 --2- 172.21.15.16:0/4001964218 >> v2:172.21.15.174:3300/0 conn(0x7fefbc06f0b0 0x7fefbc1631d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.674+0000 7fefba7fc640 1 -- 172.21.15.16:0/4001964218 >> v1:172.21.15.174:6789/0 conn(0x7fefbc0cefe0 legacy=0x7fefbc0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:53.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.674+0000 7fefba7fc640 1 -- 172.21.15.16:0/4001964218 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc0714f0 con 0x7fefbc0cffc0 2024-05-11T01:13:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.675+0000 7fefba7fc640 1 --2- 172.21.15.16:0/4001964218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b55b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009870 tx=0x7fefa402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a40d3d343228027f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.675+0000 7fefb9ffb640 1 -- 172.21.15.16:0/4001964218 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4037070 con 0x7fefbc0cffc0 2024-05-11T01:13:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.675+0000 7fefb9ffb640 1 -- 172.21.15.16:0/4001964218 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa4032440 con 0x7fefbc0cffc0 2024-05-11T01:13:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.675+0000 7fefb9ffb640 1 -- 172.21.15.16:0/4001964218 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa4032810 con 0x7fefbc0cffc0 2024-05-11T01:13:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.676+0000 7fefc163f640 1 -- 172.21.15.16:0/4001964218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 msgr2=0x7fefbc0b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:53.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.676+0000 7fefc163f640 1 --2- 172.21.15.16:0/4001964218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b55b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009870 tx=0x7fefa402a1c0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.676+0000 7fefc163f640 1 -- 172.21.15.16:0/4001964218 shutdown_connections 2024-05-11T01:13:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.676+0000 7fefc163f640 1 --2- 172.21.15.16:0/4001964218 >> v2:172.21.15.174:3300/0 conn(0x7fefbc06f0b0 0x7fefbc1631d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.676+0000 7fefc163f640 1 --2- 172.21.15.16:0/4001964218 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b55b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.676+0000 7fefc163f640 1 -- 172.21.15.16:0/4001964218 >> 172.21.15.16:0/4001964218 conn(0x7fefbc072b60 msgr2=0x7fefbc0681c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.676+0000 7fefc163f640 1 -- 172.21.15.16:0/4001964218 shutdown_connections 2024-05-11T01:13:53.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.676+0000 7fefc163f640 1 -- 172.21.15.16:0/4001964218 wait complete. 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.677+0000 7fefc163f640 1 Processor -- start 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.677+0000 7fefc163f640 1 -- start start 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefc163f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefbc06f0b0 0x7fefbc15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefc163f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefbc0cefe0 0x7fefbc0b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefc163f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefc163f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc0cf3c0 con 0x7fefbc06f0b0 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefc163f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc0d1220 con 0x7fefbc0cefe0 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefc163f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fefbc163710 con 0x7fefbc0cffc0 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefbc06f0b0 0x7fefbc15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefbc06f0b0 0x7fefbc15aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38160/0 (socket says 172.21.15.16:38160) 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 -- 172.21.15.16:0/1106261588 learned_addr learned my addr 172.21.15.16:0/1106261588 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefba7fc640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefbc0cefe0 0x7fefbc0b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:53.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbb7fe640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 -- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 msgr2=0x7fefbc0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 -- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefbc0cefe0 msgr2=0x7fefbc0b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefbc0cefe0 0x7fefbc0b7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 -- 172.21.15.16:0/1106261588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc0b8970 con 0x7fefbc06f0b0 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.678+0000 7fefbaffd640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefbc06f0b0 0x7fefbc15aa50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c870 tx=0x7fefb400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.679+0000 7fefb37fe640 1 -- 172.21.15.16:0/1106261588 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb4003b70 con 0x7fefbc06f0b0 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.679+0000 7fefb37fe640 1 -- 172.21.15.16:0/1106261588 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb4003d10 con 0x7fefbc06f0b0 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.679+0000 7fefb37fe640 1 -- 172.21.15.16:0/1106261588 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb400aa90 con 0x7fefbc06f0b0 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.679+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefbc0c6db0 con 0x7fefbc06f0b0 2024-05-11T01:13:53.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.679+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefbc0c7370 con 0x7fefbc06f0b0 2024-05-11T01:13:53.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.680+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefbc06a5b0 con 0x7fefbc06f0b0 2024-05-11T01:13:53.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.680+0000 7fefb37fe640 1 -- 172.21.15.16:0/1106261588 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fefb400ac30 con 0x7fefbc06f0b0 2024-05-11T01:13:53.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.681+0000 7fefb37fe640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fef9c0762d0 0x7fef9c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:53.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.681+0000 7fefb37fe640 1 -- 172.21.15.16:0/1106261588 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5221+0+0 (secure 0 0 0) 0x7fefb4097270 con 0x7fefbc06f0b0 2024-05-11T01:13:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.681+0000 7fefba7fc640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fef9c0762d0 0x7fef9c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:53.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.682+0000 7fefba7fc640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fef9c0762d0 0x7fef9c078790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefa4034000 tx=0x7fefa402e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:53.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.686+0000 7fefb37fe640 1 -- 172.21.15.16:0/1106261588 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fefb4060750 con 0x7fefbc06f0b0 2024-05-11T01:13:53.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.955+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fefbc070f50 con 0x7fefbc06f0b0 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.955+0000 7fefb37fe640 1 -- 172.21.15.16:0/1106261588 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fefb4064a50 con 0x7fefbc06f0b0 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_dump": [ 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.a", 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5m18ZJIBAA7zAsyHoQQooYHziHMr9fUQ==", 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.955 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.b", 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5mrUExLBAAN/gCmP67f9XLzKifNRagiw==", 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:13:53.956 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.c", 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5m6hODJxAAK9XmxeYzlY0MvVdtQD2bxQ==", 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.957 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.d", 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5mn2dBMxAA38Wxx8t36Kww9TwJ+FFW8Q==", 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.958 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.0", 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAnwz5m3HlEHRAA6Z8NONh+ZQzXoAjwLX+3xQ==", 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.1", 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAqwz5m55iZGxAA3NTF614jMZhlpM4tYEBKkQ==", 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.2", 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAtwz5m6VowGhAAmCPoZK5bb0bPWvTNHBRykQ==", 2024-05-11T01:13:53.960 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.3", 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAwwz5mbn/5GBAAFmx+UKt4TOsDDLu1NvO/xg==", 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.961 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.4", 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQA2wz5mHW6LIRAAoJJJ04swD7SsPX1eEyWtwA==", 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.962 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.5", 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQA5wz5mlZlNIBAArpMYv4k/n2pfGYRpao6y9g==", 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.6", 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQA8wz5m2QWbHhAAkG756Er+q0gg17SPmGEzeA==", 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.963 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.7", 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQA/wz5m3v3aHBAAoeD297XRIx25RQY6XMd4vA==", 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.0", 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5mBE92NxAAwjJJ4BDqTpd7qQZiD1YlYA==", 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow r", 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.1", 2024-05-11T01:13:53.965 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAmwz5mpmDeBBAAoDYEIl6yNYSP6cecHiuAOA==", 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.2", 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAmwz5mTECQARAAW1u1LX01lSAH9D0IFc52CA==", 2024-05-11T01:13:53.966 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.3", 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAmwz5mVXd+ChAAPBYtXP8NrccAP8qppA3JnA==", 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2024-05-11T01:13:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.admin", 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5m1eQwBBAAmqwFxl4DamxEWHidDzKgrA==", 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2024-05-11T01:13:53.968 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.x", 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5mbhnwHBAAwY5+kkQlvHmV7umsy3EEFw==", 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.y", 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQAlwz5m45Y3GRAAxdsBni25ybahhd/vsNP/1A==", 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2024-05-11T01:13:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:13:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fef9c0762d0 msgr2=0x7fef9c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fef9c0762d0 0x7fef9c078790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fefa4034000 tx=0x7fefa402e000 comp rx=0 tx=0).stop 2024-05-11T01:13:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefbc06f0b0 msgr2=0x7fefbc15aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:53.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefbc06f0b0 0x7fefbc15aa50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c870 tx=0x7fefb400cd30 comp rx=0 tx=0).stop 2024-05-11T01:13:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 shutdown_connections 2024-05-11T01:13:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fefbc0cffc0 0x7fefbc0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fef9c0762d0 0x7fef9c078790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefbc0cefe0 0x7fefbc0b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 --2- 172.21.15.16:0/1106261588 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefbc06f0b0 0x7fefbc15aa50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 >> 172.21.15.16:0/1106261588 conn(0x7fefbc072b60 msgr2=0x7fefbc0cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 shutdown_connections 2024-05-11T01:13:53.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:53.958+0000 7fefc163f640 1 -- 172.21.15.16:0/1106261588 wait complete. 2024-05-11T01:13:53.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-11T01:13:54.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.078+0000 7f2dbf1c1640 1 Processor -- start 2024-05-11T01:13:54.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.078+0000 7f2dbf1c1640 1 -- start start 2024-05-11T01:13:54.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbf1c1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2db8145ae0 0x7f2db815d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbf1c1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db80b4040 0x7f2db80b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbf1c1640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2db80b2cd0 0x7f2db80b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbf1c1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2db815ccc0 con 0x7f2db8145ae0 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbf1c1640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f2db815c6e0 con 0x7f2db80b2cd0 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbf1c1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2db8145ec0 con 0x7f2db80b4040 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbcf5d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2db8145ae0 0x7f2db815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbcf5d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2db8145ae0 0x7f2db815d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38170/0 (socket says 172.21.15.16:38170) 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.079+0000 7f2dbcf5d640 1 -- 172.21.15.16:0/272884898 learned_addr learned my addr 172.21.15.16:0/272884898 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.080+0000 7f2dbd75e640 1 --2- 172.21.15.16:0/272884898 >> v2:172.21.15.174:3300/0 conn(0x7f2db80b2cd0 0x7f2db80b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.080+0000 7f2db7fff640 1 --2- 172.21.15.16:0/272884898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db80b4040 0x7f2db80b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.080+0000 7f2dbcf5d640 1 -- 172.21.15.16:0/272884898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db80b4040 msgr2=0x7f2db80b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.080+0000 7f2dbcf5d640 1 --2- 172.21.15.16:0/272884898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db80b4040 0x7f2db80b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.080+0000 7f2dbcf5d640 1 -- 172.21.15.16:0/272884898 >> v2:172.21.15.174:3300/0 conn(0x7f2db80b2cd0 msgr2=0x7f2db80b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:54.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.080+0000 7f2dbcf5d640 1 --2- 172.21.15.16:0/272884898 >> v2:172.21.15.174:3300/0 conn(0x7f2db80b2cd0 0x7f2db80b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.080+0000 7f2dbcf5d640 1 -- 172.21.15.16:0/272884898 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db815d690 con 0x7f2db8145ae0 2024-05-11T01:13:54.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.080+0000 7f2dbcf5d640 1 --2- 172.21.15.16:0/272884898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db8145ae0 0x7f2db815d150 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2db8070530 tx=0x7f2da802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6535c54b458218bd server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:54.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2db77fe640 1 -- 172.21.15.16:0/272884898 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8037070 con 0x7f2db8145ae0 2024-05-11T01:13:54.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2db77fe640 1 -- 172.21.15.16:0/272884898 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da8032440 con 0x7f2db8145ae0 2024-05-11T01:13:54.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2db77fe640 1 -- 172.21.15.16:0/272884898 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8032810 con 0x7f2db8145ae0 2024-05-11T01:13:54.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/272884898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db8145ae0 msgr2=0x7f2db815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/272884898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db8145ae0 0x7f2db815d150 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2db8070530 tx=0x7f2da802a1e0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/272884898 shutdown_connections 2024-05-11T01:13:54.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/272884898 >> v2:172.21.15.174:3300/0 conn(0x7f2db80b2cd0 0x7f2db80b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/272884898 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db80b4040 0x7f2db80b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/272884898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db8145ae0 0x7f2db815d150 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/272884898 >> 172.21.15.16:0/272884898 conn(0x7f2db806fd90 msgr2=0x7f2db806c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/272884898 shutdown_connections 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.081+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/272884898 wait complete. 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.082+0000 7f2dbf1c1640 1 Processor -- start 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.082+0000 7f2dbf1c1640 1 -- start start 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2dbf1c1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db80b2cd0 0x7f2db81f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2dbf1c1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db80b4040 0x7f2db81f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2dbf1c1640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db8145ae0 0x7f2db80b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2dbf1c1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2db815c950 con 0x7f2db80b4040 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2dbf1c1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80b4d70 con 0x7f2db80b2cd0 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2dbf1c1640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2db8073b70 con 0x7f2db8145ae0 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2db7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db80b4040 0x7f2db81f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2db7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db80b4040 0x7f2db81f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38186/0 (socket says 172.21.15.16:38186) 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2db7fff640 1 -- 172.21.15.16:0/3263838972 learned_addr learned my addr 172.21.15.16:0/3263838972 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:54.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.083+0000 7f2dbd75e640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db8145ae0 0x7f2db80b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2dbcf5d640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db80b2cd0 0x7f2db81f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db7fff640 1 -- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db8145ae0 msgr2=0x7f2db80b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db7fff640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db8145ae0 0x7f2db80b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db7fff640 1 -- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db80b2cd0 msgr2=0x7f2db81f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db7fff640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db80b2cd0 0x7f2db81f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db7fff640 1 -- 172.21.15.16:0/3263838972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db81f6290 con 0x7f2db80b4040 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db7fff640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db80b4040 0x7f2db81f5d50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00d800 tx=0x7f2dac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db57fa640 1 -- 172.21.15.16:0/3263838972 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00b6c0 con 0x7f2db80b4040 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db57fa640 1 -- 172.21.15.16:0/3263838972 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dac019070 con 0x7f2db80b4040 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db813d090 con 0x7f2db80b4040 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2db57fa640 1 -- 172.21.15.16:0/3263838972 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00ba80 con 0x7f2db80b4040 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.084+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db813d650 con 0x7f2db80b4040 2024-05-11T01:13:54.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.085+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db806a5b0 con 0x7f2db80b4040 2024-05-11T01:13:54.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.086+0000 7f2db57fa640 1 -- 172.21.15.16:0/3263838972 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f2dac00bc20 con 0x7f2db80b4040 2024-05-11T01:13:54.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.087+0000 7f2db57fa640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2da40762d0 0x7f2da4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.087+0000 7f2db57fa640 1 -- 172.21.15.16:0/3263838972 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5221+0+0 (secure 0 0 0) 0x7f2dac097780 con 0x7f2db80b4040 2024-05-11T01:13:54.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.087+0000 7f2dbcf5d640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2da40762d0 0x7f2da4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.087+0000 7f2dbcf5d640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2da40762d0 0x7f2da4078790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2da8034000 tx=0x7f2da802e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:54.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.091+0000 7f2db57fa640 1 -- 172.21.15.16:0/3263838972 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2dac060c70 con 0x7f2db80b4040 2024-05-11T01:13:54.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.283+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2db8073440 con 0x7f2db80b4040 2024-05-11T01:13:54.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.283+0000 7f2db57fa640 1 -- 172.21.15.16:0/3263838972 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) ==== 84+0+65 (secure 0 0 0) 0x7f2dac064f70 con 0x7f2db80b4040 2024-05-11T01:13:54.283 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:54.283 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-05-11T01:13:54.283 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-05-11T01:13:54.283 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-05-11T01:13:54.283 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-05-11T01:13:54.283 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-05-11T01:13:54.283 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-05-11T01:13:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.285+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2da40762d0 msgr2=0x7f2da4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.285+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2da40762d0 0x7f2da4078790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2da8034000 tx=0x7f2da802e000 comp rx=0 tx=0).stop 2024-05-11T01:13:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.285+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db80b4040 msgr2=0x7f2db81f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.285+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db80b4040 0x7f2db81f5d50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00d800 tx=0x7f2dac00dcc0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.286+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 shutdown_connections 2024-05-11T01:13:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.286+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2db8145ae0 0x7f2db80b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.286+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2db80b4040 0x7f2db81f5d50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.286+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2da40762d0 0x7f2da4078790 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.286+0000 7f2dbf1c1640 1 --2- 172.21.15.16:0/3263838972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db80b2cd0 0x7f2db81f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.286+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 >> 172.21.15.16:0/3263838972 conn(0x7f2db806fd90 msgr2=0x7f2db806eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:54.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.286+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 shutdown_connections 2024-05-11T01:13:54.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.286+0000 7f2dbf1c1640 1 -- 172.21.15.16:0/3263838972 wait complete. 2024-05-11T01:13:54.296 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-11T01:13:54.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-11T01:13:54.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.404+0000 7f15c5512640 1 Processor -- start 2024-05-11T01:13:54.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.404+0000 7f15c5512640 1 -- start start 2024-05-11T01:13:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.405+0000 7f15c5512640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f15c0072670 0x7f15c0154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.405+0000 7f15c5512640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c00cdd20 con 0x7f15c0072290 2024-05-11T01:13:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.405+0000 7f15c5512640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c0161160 con 0x7f15c00cd7f0 2024-05-11T01:13:54.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.405+0000 7f15c5512640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f15c00cf800 con 0x7f15c0072670 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.405+0000 7f15beffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f15c0072290 0x7f15c015e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53262/0 (socket says 172.21.15.16:53262) 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.405+0000 7f15beffd640 1 -- 172.21.15.16:0/33529714 learned_addr learned my addr 172.21.15.16:0/33529714 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914182740 0 0) 0x7f15c00cdd20 con 0x7f15c0072290 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15ac003520 con 0x7f15c0072290 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bf7fe640 1 --2- 172.21.15.16:0/33529714 >> v2:172.21.15.174:3300/0 conn(0x7f15c0072670 0x7f15c0154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3401280943 0 0) 0x7f15ac003520 con 0x7f15c0072290 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 >> v2:172.21.15.174:3300/0 conn(0x7f15c0072670 msgr2=0x7f15c0154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 --2- 172.21.15.16:0/33529714 >> v2:172.21.15.174:3300/0 conn(0x7f15c0072670 0x7f15c0154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 >> v1:172.21.15.174:6789/0 conn(0x7f15c00cd7f0 legacy=0x7f15c0153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c0161440 con 0x7f15c0072290 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f15b0001a70 con 0x7f15c0072290 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 >> v1:172.21.15.16:6789/0 conn(0x7f15c0072290 legacy=0x7f15c015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15ac003a00 0x7f15ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac004800 0x7f15ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac005210 0x7f15ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac00c110 con 0x7f15ac003a00 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f15ac00c2c0 con 0x7f15ac005210 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f15ac00c4c0 con 0x7f15ac004800 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15beffd640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15ac003a00 0x7f15ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bf7fe640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac005210 0x7f15ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15be7fc640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac004800 0x7f15ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15beffd640 1 -- 172.21.15.16:0/33529714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac004800 msgr2=0x7f15ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15beffd640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac004800 0x7f15ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15beffd640 1 -- 172.21.15.16:0/33529714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac005210 msgr2=0x7f15ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15beffd640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15ac005210 0x7f15ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15beffd640 1 -- 172.21.15.16:0/33529714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ac003520 con 0x7f15ac003a00 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.406+0000 7f15bf7fe640 1 -- 172.21.15.16:0/33529714 reap_dead start 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.407+0000 7f15beffd640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15ac003a00 0x7f15ac003e00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f15b000a880 tx=0x7f15ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24218b669c08677d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:54.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.407+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b000a4d0 con 0x7f15ac003a00 2024-05-11T01:13:54.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.407+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b002f070 con 0x7f15ac003a00 2024-05-11T01:13:54.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.407+0000 7f15bdffb640 1 -- 172.21.15.16:0/33529714 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b002bc00 con 0x7f15ac003a00 2024-05-11T01:13:54.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.408+0000 7f15c5512640 1 -- 172.21.15.16:0/33529714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15ac003a00 msgr2=0x7f15ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.408+0000 7f15c5512640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15ac003a00 0x7f15ac003e00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f15b000a880 tx=0x7f15ac005830 comp rx=0 tx=0).stop 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.408+0000 7f15c5512640 1 -- 172.21.15.16:0/33529714 shutdown_connections 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.408+0000 7f15c5512640 1 --2- 172.21.15.16:0/33529714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15ac003a00 0x7f15ac003e00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.408+0000 7f15c5512640 1 -- 172.21.15.16:0/33529714 >> 172.21.15.16:0/33529714 conn(0x7f15c0070760 msgr2=0x7f15c0070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.408+0000 7f15c5512640 1 -- 172.21.15.16:0/33529714 shutdown_connections 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.408+0000 7f15c5512640 1 -- 172.21.15.16:0/33529714 wait complete. 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.409+0000 7f15c5512640 1 Processor -- start 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.409+0000 7f15c5512640 1 -- start start 2024-05-11T01:13:54.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15c5512640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac003a00 0x7f15c01517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15c5512640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15c01549f0 0x7f15c00c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15c5512640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15c0157e80 0x7f15c0158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15c5512640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f15c0161dc0 con 0x7f15c01549f0 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15c5512640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f15c0161c40 con 0x7f15c0157e80 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15c5512640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f15c015e300 con 0x7f15ac003a00 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15be7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15c01549f0 0x7f15c00c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15be7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15c01549f0 0x7f15c00c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38214/0 (socket says 172.21.15.16:38214) 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15be7fc640 1 -- 172.21.15.16:0/3852637421 learned_addr learned my addr 172.21.15.16:0/3852637421 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15beffd640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac003a00 0x7f15c01517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15bf7fe640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15c0157e80 0x7f15c0158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15be7fc640 1 -- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac003a00 msgr2=0x7f15c01517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15be7fc640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac003a00 0x7f15c01517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15be7fc640 1 -- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15c0157e80 msgr2=0x7f15c0158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:54.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15be7fc640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15c0157e80 0x7f15c0158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15be7fc640 1 -- 172.21.15.16:0/3852637421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c0154ed0 con 0x7f15c01549f0 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15bf7fe640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15c0157e80 0x7f15c0158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.410+0000 7f15beffd640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac003a00 0x7f15c01517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.411+0000 7f15be7fc640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15c01549f0 0x7f15c00c8cf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f15a800e4b0 tx=0x7f15a800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.411+0000 7f15b77fe640 1 -- 172.21.15.16:0/3852637421 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a80135f0 con 0x7f15c01549f0 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.411+0000 7f15b77fe640 1 -- 172.21.15.16:0/3852637421 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a801a070 con 0x7f15c01549f0 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.411+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c01551b0 con 0x7f15c01549f0 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.411+0000 7f15b77fe640 1 -- 172.21.15.16:0/3852637421 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a80139f0 con 0x7f15c01549f0 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.411+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c0155a50 con 0x7f15c01549f0 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.412+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c0155380 con 0x7f15c01549f0 2024-05-11T01:13:54.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.413+0000 7f15b77fe640 1 -- 172.21.15.16:0/3852637421 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f15a8013b90 con 0x7f15c01549f0 2024-05-11T01:13:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.413+0000 7f15b77fe640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f15a00762d0 0x7f15a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.413+0000 7f15b77fe640 1 -- 172.21.15.16:0/3852637421 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5221+0+0 (secure 0 0 0) 0x7f15a80977c0 con 0x7f15c01549f0 2024-05-11T01:13:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.414+0000 7f15beffd640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f15a00762d0 0x7f15a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:54.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.414+0000 7f15beffd640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f15a00762d0 0x7f15a0078790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15b0033000 tx=0x7f15b002e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:54.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.418+0000 7f15b77fe640 1 -- 172.21.15.16:0/3852637421 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f15a8061300 con 0x7f15c01549f0 2024-05-11T01:13:54.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:54.610+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f15c006a5b0 con 0x7f15c01549f0 2024-05-11T01:13:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.548+0000 7f15b77fe640 1 -- 172.21.15.16:0/3852637421 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) ==== 138+0+0 (secure 0 0 0) 0x7f15a8060c00 con 0x7f15c01549f0 2024-05-11T01:13:55.547 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-05-11T01:13:55.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f15a00762d0 msgr2=0x7f15a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:55.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f15a00762d0 0x7f15a0078790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15b0033000 tx=0x7f15b002e000 comp rx=0 tx=0).stop 2024-05-11T01:13:55.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15c01549f0 msgr2=0x7f15c00c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:55.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15c01549f0 0x7f15c00c8cf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f15a800e4b0 tx=0x7f15a800e970 comp rx=0 tx=0).stop 2024-05-11T01:13:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 shutdown_connections 2024-05-11T01:13:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f15a00762d0 0x7f15a0078790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15c0157e80 0x7f15c0158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15c01549f0 0x7f15c00c8cf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 --2- 172.21.15.16:0/3852637421 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f15ac003a00 0x7f15c01517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 >> 172.21.15.16:0/3852637421 conn(0x7f15c0070760 msgr2=0x7f15c0152710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 shutdown_connections 2024-05-11T01:13:55.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.551+0000 7f15c5512640 1 -- 172.21.15.16:0/3852637421 wait complete. 2024-05-11T01:13:55.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-11T01:13:55.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.685+0000 7fec55aa7640 1 Processor -- start 2024-05-11T01:13:55.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.685+0000 7fec55aa7640 1 -- start start 2024-05-11T01:13:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.686+0000 7fec55aa7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec5006f620 0x7fec5006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.686+0000 7fec55aa7640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5006ffe0 con 0x7fec500ae0d0 2024-05-11T01:13:55.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.686+0000 7fec55aa7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500d1060 con 0x7fec500d0230 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.686+0000 7fec55aa7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fec500d1340 con 0x7fec5006f620 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.686+0000 7fec4ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fec500ae0d0 0x7fec500ae560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53270/0 (socket says 172.21.15.16:53270) 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.686+0000 7fec4ffff640 1 -- 172.21.15.16:0/1585854799 learned_addr learned my addr 172.21.15.16:0/1585854799 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.686+0000 7fec4effd640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec5006f620 0x7fec5006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.686+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212042631 0 0) 0x7fec5006ffe0 con 0x7fec500ae0d0 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec38005730 con 0x7fec500ae0d0 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3925291720 0 0) 0x7fec38005730 con 0x7fec500ae0d0 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec5006f620 msgr2=0x7fec5006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec5006f620 0x7fec5006faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 >> v1:172.21.15.174:6789/0 conn(0x7fec500d0230 legacy=0x7fec500d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec500d1620 con 0x7fec500ae0d0 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fec48001a70 con 0x7fec500ae0d0 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 >> v1:172.21.15.16:6789/0 conn(0x7fec500ae0d0 legacy=0x7fec500ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:55.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38005bf0 0x7fec38005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec38006a10 0x7fec38006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec5006f620 0x7fec38007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec500d1340 con 0x7fec38006a10 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fec3800dd30 con 0x7fec38005bf0 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fec3800df30 con 0x7fec5006f620 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4effd640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec38006a10 0x7fec38006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4f7fe640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38005bf0 0x7fec38005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4ffff640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec5006f620 0x7fec38007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4effd640 1 -- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec5006f620 msgr2=0x7fec38007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4effd640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec5006f620 0x7fec38007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4effd640 1 -- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38005bf0 msgr2=0x7fec38005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4effd640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38005bf0 0x7fec38005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4effd640 1 -- 172.21.15.16:0/1585854799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec38005730 con 0x7fec38006a10 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.687+0000 7fec4f7fe640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38005bf0 0x7fec38005fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.688+0000 7fec4effd640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec38006a10 0x7fec38006e90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fec44009ac0 tx=0x7fec38007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0c62493be16bca server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.688+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44036070 con 0x7fec38006a10 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.688+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec44031400 con 0x7fec38006a10 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.688+0000 7fec4e7fc640 1 -- 172.21.15.16:0/1585854799 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44009690 con 0x7fec38006a10 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.689+0000 7fec55aa7640 1 -- 172.21.15.16:0/1585854799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec38006a10 msgr2=0x7fec38006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.689+0000 7fec55aa7640 1 --2- 172.21.15.16:0/1585854799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec38006a10 0x7fec38006e90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fec44009ac0 tx=0x7fec38007a40 comp rx=0 tx=0).stop 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.689+0000 7fec4ffff640 1 -- 172.21.15.16:0/1585854799 reap_dead start 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.689+0000 7fec55aa7640 1 -- 172.21.15.16:0/1585854799 shutdown_connections 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.689+0000 7fec55aa7640 1 -- 172.21.15.16:0/1585854799 >> 172.21.15.16:0/1585854799 conn(0x7fec500b2c80 msgr2=0x7fec500b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.689+0000 7fec55aa7640 1 -- 172.21.15.16:0/1585854799 shutdown_connections 2024-05-11T01:13:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.689+0000 7fec55aa7640 1 -- 172.21.15.16:0/1585854799 wait complete. 2024-05-11T01:13:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.690+0000 7fec55aa7640 1 Processor -- start 2024-05-11T01:13:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.690+0000 7fec55aa7640 1 -- start start 2024-05-11T01:13:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec55aa7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38006a10 0x7fec50146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec55aa7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501f2470 0x7fec5009ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec55aa7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec501f28d0 0x7fec5009bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec55aa7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fec5015c480 con 0x7fec501f2470 2024-05-11T01:13:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec55aa7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fec500d1be0 con 0x7fec38006a10 2024-05-11T01:13:55.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec55aa7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fec5015c600 con 0x7fec501f28d0 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501f2470 0x7fec5009ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec4effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501f2470 0x7fec5009ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38228/0 (socket says 172.21.15.16:38228) 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec4effd640 1 -- 172.21.15.16:0/184938489 learned_addr learned my addr 172.21.15.16:0/184938489 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec4f7fe640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38006a10 0x7fec50146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.691+0000 7fec4ffff640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec501f28d0 0x7fec5009bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec4effd640 1 -- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec501f28d0 msgr2=0x7fec5009bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec4effd640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec501f28d0 0x7fec5009bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec4effd640 1 -- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38006a10 msgr2=0x7fec50146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec4effd640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38006a10 0x7fec50146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec4effd640 1 -- 172.21.15.16:0/184938489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50157e40 con 0x7fec501f2470 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec4f7fe640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38006a10 0x7fec50146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec4effd640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501f2470 0x7fec5009ba70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fec44034040 tx=0x7fec44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec37fff640 1 -- 172.21.15.16:0/184938489 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44041020 con 0x7fec501f2470 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec37fff640 1 -- 172.21.15.16:0/184938489 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec4403c470 con 0x7fec501f2470 2024-05-11T01:13:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec50158120 con 0x7fec501f2470 2024-05-11T01:13:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec37fff640 1 -- 172.21.15.16:0/184938489 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44036040 con 0x7fec501f2470 2024-05-11T01:13:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.692+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec501586e0 con 0x7fec501f2470 2024-05-11T01:13:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.693+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec500b5210 con 0x7fec501f2470 2024-05-11T01:13:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.694+0000 7fec37fff640 1 -- 172.21.15.16:0/184938489 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fec44044020 con 0x7fec501f2470 2024-05-11T01:13:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.694+0000 7fec37fff640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fec3c076300 0x7fec3c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.694+0000 7fec37fff640 1 -- 172.21.15.16:0/184938489 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5591+0+0 (secure 0 0 0) 0x7fec440b7a20 con 0x7fec501f2470 2024-05-11T01:13:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.694+0000 7fec4f7fe640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fec3c076300 0x7fec3c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.695+0000 7fec4f7fe640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fec3c076300 0x7fec3c0787c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fec400055e0 tx=0x7fec40009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.699+0000 7fec37fff640 1 -- 172.21.15.16:0/184938489 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fec500b5210 con 0x7fec501f2470 2024-05-11T01:13:55.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:55.889+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fec500d0610 con 0x7fec501f2470 2024-05-11T01:13:56.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.556+0000 7fec37fff640 1 -- 172.21.15.16:0/184938489 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) ==== 170+0+0 (secure 0 0 0) 0x7fec500d0610 con 0x7fec501f2470 2024-05-11T01:13:56.555 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.560+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fec3c076300 msgr2=0x7fec3c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.560+0000 7fec55aa7640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fec3c076300 0x7fec3c0787c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fec400055e0 tx=0x7fec40009040 comp rx=0 tx=0).stop 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.560+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501f2470 msgr2=0x7fec5009ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.560+0000 7fec55aa7640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501f2470 0x7fec5009ba70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fec44034040 tx=0x7fec44004730 comp rx=0 tx=0).stop 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.560+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 shutdown_connections 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.560+0000 7fec55aa7640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fec501f28d0 0x7fec5009bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.560+0000 7fec55aa7640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec501f2470 0x7fec5009ba70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.561+0000 7fec55aa7640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fec3c076300 0x7fec3c0787c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.561+0000 7fec55aa7640 1 --2- 172.21.15.16:0/184938489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fec38006a10 0x7fec50146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.561+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 >> 172.21.15.16:0/184938489 conn(0x7fec500b2c80 msgr2=0x7fec500ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.561+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 shutdown_connections 2024-05-11T01:13:56.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.561+0000 7fec55aa7640 1 -- 172.21.15.16:0/184938489 wait complete. 2024-05-11T01:13:56.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-11T01:13:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.700+0000 7f99747af640 1 Processor -- start 2024-05-11T01:13:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.700+0000 7f99747af640 1 -- start start 2024-05-11T01:13:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.701+0000 7f99747af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0bae40 0x7f996c1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.701+0000 7f99747af640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f996c163010 0x7f996c0b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.701+0000 7f99747af640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996c1609e0 con 0x7f996c0b72c0 2024-05-11T01:13:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.701+0000 7f99747af640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f996c0b76f0 con 0x7f996c163010 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.701+0000 7f99747af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f996c1635d0 con 0x7f996c0bae40 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9972d4c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f996c0b72c0 0x7f996c0b3d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53272/0 (socket says 172.21.15.16:53272) 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9972d4c640 1 -- 172.21.15.16:0/1683529703 learned_addr learned my addr 172.21.15.16:0/1683529703 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529784056 0 0) 0x7f9964001110 con 0x7f996c0b72c0 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f997254b640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0bae40 0x7f996c1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9958003520 con 0x7f996c0b72c0 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971d4a640 1 --2- 172.21.15.16:0/1683529703 >> v2:172.21.15.174:3300/0 conn(0x7f996c163010 0x7f996c0b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4058978794 0 0) 0x7f9958003520 con 0x7f996c0b72c0 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0bae40 msgr2=0x7f996c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0bae40 0x7f996c1604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 >> v2:172.21.15.174:3300/0 conn(0x7f996c163010 msgr2=0x7f996c0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 --2- 172.21.15.16:0/1683529703 >> v2:172.21.15.174:3300/0 conn(0x7f996c163010 0x7f996c0b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c1638b0 con 0x7f996c0b72c0 2024-05-11T01:13:56.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f99640018c0 con 0x7f996c0b72c0 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 >> v1:172.21.15.16:6789/0 conn(0x7f996c0b72c0 legacy=0x7f996c0b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0bae40 0x7f9958003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9958003fd0 0x7f9958004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9958004d40 0x7f99580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f996c0b76f0 con 0x7f9958003fd0 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1635d0 con 0x7f9958004d40 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f995800baa0 con 0x7f996c0bae40 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f9971d4a640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9958003fd0 0x7f9958004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.702+0000 7f997254b640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0bae40 0x7f9958003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9972d4c640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9958004d40 0x7f99580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971d4a640 1 -- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0bae40 msgr2=0x7f9958003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971d4a640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f996c0bae40 0x7f9958003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971d4a640 1 -- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9958004d40 msgr2=0x7f99580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971d4a640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9958004d40 0x7f99580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971d4a640 1 -- 172.21.15.16:0/1683529703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958003520 con 0x7f9958003fd0 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971d4a640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9958003fd0 0x7f9958004800 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f995c009ac0 tx=0x7f9958005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e722ddbba816b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c036070 con 0x7f9958003fd0 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c031400 con 0x7f9958003fd0 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.703+0000 7f9971549640 1 -- 172.21.15.16:0/1683529703 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c009690 con 0x7f9958003fd0 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.704+0000 7f99747af640 1 -- 172.21.15.16:0/1683529703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9958003fd0 msgr2=0x7f9958004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.704+0000 7f99747af640 1 --2- 172.21.15.16:0/1683529703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9958003fd0 0x7f9958004800 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f995c009ac0 tx=0x7f9958005830 comp rx=0 tx=0).stop 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.704+0000 7f9972d4c640 1 -- 172.21.15.16:0/1683529703 reap_dead start 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.704+0000 7f99747af640 1 -- 172.21.15.16:0/1683529703 shutdown_connections 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.704+0000 7f99747af640 1 -- 172.21.15.16:0/1683529703 >> 172.21.15.16:0/1683529703 conn(0x7f996c074140 msgr2=0x7f996c0d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.704+0000 7f99747af640 1 -- 172.21.15.16:0/1683529703 shutdown_connections 2024-05-11T01:13:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.704+0000 7f99747af640 1 -- 172.21.15.16:0/1683529703 wait complete. 2024-05-11T01:13:56.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.705+0000 7f99747af640 1 Processor -- start 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.705+0000 7f99747af640 1 -- start start 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f99747af640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9958003fd0 0x7f996c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f99747af640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f996c1f8c10 0x7f996c1f9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f99747af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c155cc0 0x7f996c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f99747af640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f996c0bb220 con 0x7f996c1f8c10 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f99747af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f996c163e70 con 0x7f996c155cc0 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f99747af640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f996c1604a0 con 0x7f9958003fd0 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f9971d4a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f996c1f8c10 0x7f996c1f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f9971d4a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f996c1f8c10 0x7f996c1f9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38246/0 (socket says 172.21.15.16:38246) 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f9971d4a640 1 -- 172.21.15.16:0/175554831 learned_addr learned my addr 172.21.15.16:0/175554831 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f997254b640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9958003fd0 0x7f996c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f9972d4c640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c155cc0 0x7f996c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f9971d4a640 1 -- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9958003fd0 msgr2=0x7f996c150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:56.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f9971d4a640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9958003fd0 0x7f996c150e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f9971d4a640 1 -- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c155cc0 msgr2=0x7f996c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.706+0000 7f9971d4a640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c155cc0 0x7f996c156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.707+0000 7f9971d4a640 1 -- 172.21.15.16:0/175554831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c0cd180 con 0x7f996c1f8c10 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.707+0000 7f9972d4c640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c155cc0 0x7f996c156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.707+0000 7f9971d4a640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f996c1f8c10 0x7f996c1f9090 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f995c034040 tx=0x7f995c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.707+0000 7f9962ffd640 1 -- 172.21.15.16:0/175554831 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c040020 con 0x7f996c1f8c10 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.707+0000 7f9962ffd640 1 -- 172.21.15.16:0/175554831 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c003c60 con 0x7f996c1f8c10 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.707+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c0cd460 con 0x7f996c1f8c10 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.707+0000 7f9962ffd640 1 -- 172.21.15.16:0/175554831 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c036040 con 0x7f996c1f8c10 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.707+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c0cda20 con 0x7f996c1f8c10 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.708+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996c06a5b0 con 0x7f996c1f8c10 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.709+0000 7f9962ffd640 1 -- 172.21.15.16:0/175554831 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f995c043020 con 0x7f996c1f8c10 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.709+0000 7f9962ffd640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99500762d0 0x7f9950078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:56.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.709+0000 7f9962ffd640 1 -- 172.21.15.16:0/175554831 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5973+0+0 (secure 0 0 0) 0x7f995c0b7b70 con 0x7f996c1f8c10 2024-05-11T01:13:56.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.709+0000 7f997254b640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99500762d0 0x7f9950078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:56.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.710+0000 7f997254b640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99500762d0 0x7f9950078790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f996c0cbc40 tx=0x7f996800b040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:56.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.714+0000 7f9962ffd640 1 -- 172.21.15.16:0/175554831 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f995c04a030 con 0x7f996c1f8c10 2024-05-11T01:13:56.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:56.947+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f996c157630 con 0x7f996c1f8c10 2024-05-11T01:13:57.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.565+0000 7f9962ffd640 1 -- 172.21.15.16:0/175554831 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) ==== 172+0+0 (secure 0 0 0) 0x7f995c0044e0 con 0x7f996c1f8c10 2024-05-11T01:13:57.566 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 6 and data pool 7 2024-05-11T01:13:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.580+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99500762d0 msgr2=0x7f9950078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99500762d0 0x7f9950078790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f996c0cbc40 tx=0x7f996800b040 comp rx=0 tx=0).stop 2024-05-11T01:13:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f996c1f8c10 msgr2=0x7f996c1f9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f996c1f8c10 0x7f996c1f9090 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f995c034040 tx=0x7f995c004730 comp rx=0 tx=0).stop 2024-05-11T01:13:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 shutdown_connections 2024-05-11T01:13:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f99500762d0 0x7f9950078790 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f996c0cbc40 tx=0x7f996800b040 comp rx=0 tx=0).stop 2024-05-11T01:13:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f996c155cc0 0x7f996c156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f996c1f8c10 0x7f996c1f9090 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 --2- 172.21.15.16:0/175554831 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9958003fd0 0x7f996c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 >> 172.21.15.16:0/175554831 conn(0x7f996c074140 msgr2=0x7f996c160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:57.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.581+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 shutdown_connections 2024-05-11T01:13:57.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.582+0000 7f99747af640 1 -- 172.21.15.16:0/175554831 wait complete. 2024-05-11T01:13:57.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:13:57.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.713+0000 7f9e611e4640 1 Processor -- start 2024-05-11T01:13:57.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.713+0000 7f9e611e4640 1 -- start start 2024-05-11T01:13:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.714+0000 7f9e611e4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9e5c0d0000 0x7f9e5c0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.714+0000 7f9e611e4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.714+0000 7f9e611e4640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e5c0d0920 con 0x7f9e5c0baed0 2024-05-11T01:13:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.714+0000 7f9e611e4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f9e5c163820 con 0x7f9e5c0d0000 2024-05-11T01:13:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.714+0000 7f9e611e4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5c163b00 con 0x7f9e5c0d3bf0 2024-05-11T01:13:57.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e5b59e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e5b59e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0d4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:48976/0 (socket says 172.21.15.16:48976) 2024-05-11T01:13:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e5b59e640 1 -- 172.21.15.16:0/82471627 learned_addr learned my addr 172.21.15.16:0/82471627 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e5ad9d640 1 --2- 172.21.15.16:0/82471627 >> v2:172.21.15.174:3300/0 conn(0x7f9e5c0d0000 0x7f9e5c0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e5b59e640 1 -- 172.21.15.16:0/82471627 >> v2:172.21.15.174:3300/0 conn(0x7f9e5c0d0000 msgr2=0x7f9e5c0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e5b59e640 1 --2- 172.21.15.16:0/82471627 >> v2:172.21.15.174:3300/0 conn(0x7f9e5c0d0000 0x7f9e5c0d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e59d9b640 1 -- 172.21.15.16:0/82471627 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1055387934 0 0) 0x7f9e5c0d0920 con 0x7f9e5c0baed0 2024-05-11T01:13:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e5b59e640 1 -- 172.21.15.16:0/82471627 >> v1:172.21.15.174:6789/0 conn(0x7f9e5c0baed0 legacy=0x7f9e5c162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:57.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.715+0000 7f9e5b59e640 1 -- 172.21.15.16:0/82471627 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c0d33f0 con 0x7f9e5c0d3bf0 2024-05-11T01:13:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.716+0000 7f9e5b59e640 1 --2- 172.21.15.16:0/82471627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0d4080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009870 tx=0x7f9e5402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=129596706b3962bc server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.716+0000 7f9e59d9b640 1 -- 172.21.15.16:0/82471627 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54037070 con 0x7f9e5c0d3bf0 2024-05-11T01:13:57.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.716+0000 7f9e59d9b640 1 -- 172.21.15.16:0/82471627 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e54032440 con 0x7f9e5c0d3bf0 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.716+0000 7f9e59d9b640 1 -- 172.21.15.16:0/82471627 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54032810 con 0x7f9e5c0d3bf0 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.716+0000 7f9e611e4640 1 -- 172.21.15.16:0/82471627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 msgr2=0x7f9e5c0d4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.716+0000 7f9e611e4640 1 --2- 172.21.15.16:0/82471627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0d4080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009870 tx=0x7f9e5402a270 comp rx=0 tx=0).stop 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.717+0000 7f9e611e4640 1 -- 172.21.15.16:0/82471627 shutdown_connections 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.717+0000 7f9e611e4640 1 --2- 172.21.15.16:0/82471627 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0d4080 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.717+0000 7f9e611e4640 1 --2- 172.21.15.16:0/82471627 >> v2:172.21.15.174:3300/0 conn(0x7f9e5c0d0000 0x7f9e5c0d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.717+0000 7f9e611e4640 1 -- 172.21.15.16:0/82471627 >> 172.21.15.16:0/82471627 conn(0x7f9e5c074140 msgr2=0x7f9e5c0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.717+0000 7f9e611e4640 1 -- 172.21.15.16:0/82471627 shutdown_connections 2024-05-11T01:13:57.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.717+0000 7f9e611e4640 1 -- 172.21.15.16:0/82471627 wait complete. 2024-05-11T01:13:57.720 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.718+0000 7f9e611e4640 1 Processor -- start 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.718+0000 7f9e611e4640 1 -- start start 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e611e4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e5c0baed0 0x7f9e5c1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e611e4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e5c0d0000 0x7f9e5c1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e611e4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e611e4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c15f750 con 0x7f9e5c0baed0 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e611e4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c163de0 con 0x7f9e5c0d0000 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e611e4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5c15f8d0 con 0x7f9e5c0d3bf0 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e5c0baed0 0x7f9e5c1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e5c0baed0 0x7f9e5c1f4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38250/0 (socket says 172.21.15.16:38250) 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 -- 172.21.15.16:0/2200027504 learned_addr learned my addr 172.21.15.16:0/2200027504 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:57.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5b59e640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5a59c640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e5c0d0000 0x7f9e5c1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 -- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 msgr2=0x7f9e5c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 -- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e5c0d0000 msgr2=0x7f9e5c1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e5c0d0000 0x7f9e5c1518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 -- 172.21.15.16:0/2200027504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c0cde90 con 0x7f9e5c0baed0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.719+0000 7f9e5ad9d640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e5c0baed0 0x7f9e5c1f4d50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00efc0 tx=0x7f9e4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.720+0000 7f9e537fe640 1 -- 172.21.15.16:0/2200027504 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c018020 con 0x7f9e5c0baed0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.720+0000 7f9e537fe640 1 -- 172.21.15.16:0/2200027504 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e4c014480 con 0x7f9e5c0baed0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.720+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5c0ce170 con 0x7f9e5c0baed0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.720+0000 7f9e537fe640 1 -- 172.21.15.16:0/2200027504 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c014850 con 0x7f9e5c0baed0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.720+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5c0ce730 con 0x7f9e5c0baed0 2024-05-11T01:13:57.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.721+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5c0cfa50 con 0x7f9e5c0baed0 2024-05-11T01:13:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.721+0000 7f9e537fe640 1 -- 172.21.15.16:0/2200027504 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f9e4c005d10 con 0x7f9e5c0baed0 2024-05-11T01:13:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.722+0000 7f9e537fe640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f9e3c076300 0x7f9e3c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:57.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.722+0000 7f9e537fe640 1 -- 172.21.15.16:0/2200027504 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6073+0+0 (secure 0 0 0) 0x7f9e4c098050 con 0x7f9e5c0baed0 2024-05-11T01:13:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.722+0000 7f9e5a59c640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f9e3c076300 0x7f9e3c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:57.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.723+0000 7f9e5a59c640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f9e3c076300 0x7f9e3c0787c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c06e380 tx=0x7f9e44009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:57.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.726+0000 7f9e537fe640 1 -- 172.21.15.16:0/2200027504 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e5c0cfa50 con 0x7f9e5c0baed0 2024-05-11T01:13:57.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.917+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e5c0ceb00 con 0x7f9e5c0baed0 2024-05-11T01:13:57.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.918+0000 7f9e537fe640 1 -- 172.21.15.16:0/2200027504 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+17152 (secure 0 0 0) 0x7f9e4c022070 con 0x7f9e5c0baed0 2024-05-11T01:13:57.919 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:57.919 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":58,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:13:56.948682+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:13:54.615049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-11T01:13:55.893718+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":1},{"begin":28,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":49,"length":2},{"begin":55,"length":1},{"begin":60,"length":3},{"begin":66,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":81,"length":3},{"begin":87,"length":1},{"begin":93,"length":2},{"begin":98,"length":1},{"begin":103,"length":2},{"begin":108,"length":1},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f9e3c076300 msgr2=0x7f9e3c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f9e3c076300 0x7f9e3c0787c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c06e380 tx=0x7f9e44009040 comp rx=0 tx=0).stop 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e5c0baed0 msgr2=0x7f9e5c1f4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e5c0baed0 0x7f9e5c1f4d50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00efc0 tx=0x7f9e4c00c490 comp rx=0 tx=0).stop 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 shutdown_connections 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f9e5c0d3bf0 0x7f9e5c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f9e3c076300 0x7f9e3c0787c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9e5c0d0000 0x7f9e5c1518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 --2- 172.21.15.16:0/2200027504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e5c0baed0 0x7f9e5c1f4d50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:57.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.920+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 >> 172.21.15.16:0/2200027504 conn(0x7f9e5c074140 msgr2=0x7f9e5c0b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:57.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.921+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 shutdown_connections 2024-05-11T01:13:57.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:57.921+0000 7f9e611e4640 1 -- 172.21.15.16:0/2200027504 wait complete. 2024-05-11T01:13:57.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:13:58.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.036+0000 7f4d446e8640 1 Processor -- start 2024-05-11T01:13:58.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.036+0000 7f4d446e8640 1 -- start start 2024-05-11T01:13:58.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d446e8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c0b4cf0 0x7f4d3c0b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d446e8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d3c0d2a60 0x7f4d3c0d2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d446e8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3c0d2120 con 0x7f4d3c157a50 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d446e8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4d3c0b5690 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d446e8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4d3c0d1080 con 0x7f4d3c0b4cf0 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d42484640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4d3c157a50 0x7f4d3c0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53280/0 (socket says 172.21.15.16:53280) 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d42c85640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d3c0d2a60 0x7f4d3c0d2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d42484640 1 -- 172.21.15.16:0/2949745475 learned_addr learned my addr 172.21.15.16:0/2949745475 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d41c83640 1 --2- 172.21.15.16:0/2949745475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c0b4cf0 0x7f4d3c0b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d42c85640 1 -- 172.21.15.16:0/2949745475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c0b4cf0 msgr2=0x7f4d3c0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d42c85640 1 --2- 172.21.15.16:0/2949745475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c0b4cf0 0x7f4d3c0b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d42c85640 1 -- 172.21.15.16:0/2949745475 >> v1:172.21.15.16:6789/0 conn(0x7f4d3c157a50 legacy=0x7f4d3c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.037+0000 7f4d42c85640 1 -- 172.21.15.16:0/2949745475 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c0d1360 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.038+0000 7f4d42c85640 1 --2- 172.21.15.16:0/2949745475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0d2eb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009d90 tx=0x7f4d3402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1cf4a6a7919155 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:58.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.038+0000 7f4d41482640 1 -- 172.21.15.16:0/2949745475 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34007740 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.038+0000 7f4d41482640 1 -- 172.21.15.16:0/2949745475 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d340078e0 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.038+0000 7f4d41482640 1 -- 172.21.15.16:0/2949745475 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34007cb0 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.039+0000 7f4d446e8640 1 -- 172.21.15.16:0/2949745475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 msgr2=0x7f4d3c0d2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.039+0000 7f4d446e8640 1 --2- 172.21.15.16:0/2949745475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0d2eb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4d34009d90 tx=0x7f4d3402a530 comp rx=0 tx=0).stop 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.039+0000 7f4d446e8640 1 -- 172.21.15.16:0/2949745475 shutdown_connections 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.039+0000 7f4d446e8640 1 --2- 172.21.15.16:0/2949745475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0d2eb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.039+0000 7f4d446e8640 1 --2- 172.21.15.16:0/2949745475 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c0b4cf0 0x7f4d3c0b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.039+0000 7f4d446e8640 1 -- 172.21.15.16:0/2949745475 >> 172.21.15.16:0/2949745475 conn(0x7f4d3c0681c0 msgr2=0x7f4d3c0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.039+0000 7f4d446e8640 1 -- 172.21.15.16:0/2949745475 shutdown_connections 2024-05-11T01:13:58.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.039+0000 7f4d446e8640 1 -- 172.21.15.16:0/2949745475 wait complete. 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.040+0000 7f4d446e8640 1 Processor -- start 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.040+0000 7f4d446e8640 1 -- start start 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d446e8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c0b4cf0 0x7f4d3c0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d446e8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d446e8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c157a50 0x7f4d3c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d446e8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c0d1c00 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d446e8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d3c0d1920 con 0x7f4d3c0b4cf0 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d446e8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4d3c0ce0d0 con 0x7f4d3c157a50 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d41c83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d41c83640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0b66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38272/0 (socket says 172.21.15.16:38272) 2024-05-11T01:13:58.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d41c83640 1 -- 172.21.15.16:0/17813467 learned_addr learned my addr 172.21.15.16:0/17813467 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d42484640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c0b4cf0 0x7f4d3c0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d42c85640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c157a50 0x7f4d3c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d41c83640 1 -- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c157a50 msgr2=0x7f4d3c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d41c83640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c157a50 0x7f4d3c152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d41c83640 1 -- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c0b4cf0 msgr2=0x7f4d3c0b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d41c83640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c0b4cf0 0x7f4d3c0b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.041+0000 7f4d41c83640 1 -- 172.21.15.16:0/17813467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c0b6c10 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.042+0000 7f4d41c83640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0b66d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00d800 tx=0x7f4d2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.042+0000 7f4d32ffd640 1 -- 172.21.15.16:0/17813467 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00b6c0 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.042+0000 7f4d32ffd640 1 -- 172.21.15.16:0/17813467 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2c019070 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.042+0000 7f4d32ffd640 1 -- 172.21.15.16:0/17813467 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00ba80 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.042+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3c153490 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.042+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3c0b79e0 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.043+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d3c06a5b0 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.043+0000 7f4d32ffd640 1 -- 172.21.15.16:0/17813467 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f4d2c00bc20 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.044+0000 7f4d32ffd640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4d200762d0 0x7f4d20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.044+0000 7f4d32ffd640 1 -- 172.21.15.16:0/17813467 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6073+0+0 (secure 0 0 0) 0x7f4d2c097c40 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.044+0000 7f4d42484640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4d200762d0 0x7f4d20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.045+0000 7f4d42484640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4d200762d0 0x7f4d20078790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d38000f60 tx=0x7f4d38009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:58.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.048+0000 7f4d32ffd640 1 -- 172.21.15.16:0/17813467 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4d3c0b6c10 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.241+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d3c0b2ab0 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.243+0000 7f4d32ffd640 1 -- 172.21.15.16:0/17813467 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+17152 (secure 0 0 0) 0x7f4d2c061430 con 0x7f4d3c0d2a60 2024-05-11T01:13:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:13:58.243 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":58,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:13:56.948682+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:13:54.615049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-11T01:13:55.893718+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":1},{"begin":28,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":49,"length":2},{"begin":55,"length":1},{"begin":60,"length":3},{"begin":66,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":81,"length":3},{"begin":87,"length":1},{"begin":93,"length":2},{"begin":98,"length":1},{"begin":103,"length":2},{"begin":108,"length":1},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:13:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4d200762d0 msgr2=0x7f4d20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4d200762d0 0x7f4d20078790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d38000f60 tx=0x7f4d38009040 comp rx=0 tx=0).stop 2024-05-11T01:13:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 msgr2=0x7f4d3c0b66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0b66d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00d800 tx=0x7f4d2c00dcc0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 shutdown_connections 2024-05-11T01:13:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4d3c157a50 0x7f4d3c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d3c0d2a60 0x7f4d3c0b66d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4d200762d0 0x7f4d20078790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 --2- 172.21.15.16:0/17813467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d3c0b4cf0 0x7f4d3c0b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 >> 172.21.15.16:0/17813467 conn(0x7f4d3c0681c0 msgr2=0x7f4d3c0d3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 shutdown_connections 2024-05-11T01:13:58.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.245+0000 7f4d446e8640 1 -- 172.21.15.16:0/17813467 wait complete. 2024-05-11T01:13:58.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-11T01:13:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.363+0000 7f77541b7640 1 Processor -- start 2024-05-11T01:13:58.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.363+0000 7f77541b7640 1 -- start start 2024-05-11T01:13:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f77541b7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c0707a0 0x7f774c070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f77541b7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f774c0b66b0 0x7f774c0b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f77541b7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f774c0d2670 con 0x7f774c146d30 2024-05-11T01:13:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f77541b7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f774c147110 con 0x7f774c0b66b0 2024-05-11T01:13:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f77541b7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f774c0d2950 con 0x7f774c0707a0 2024-05-11T01:13:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f7751752640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c0707a0 0x7f774c070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f7751752640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c0707a0 0x7f774c070c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:49008/0 (socket says 172.21.15.16:49008) 2024-05-11T01:13:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f7751752640 1 -- 172.21.15.16:0/3207846124 learned_addr learned my addr 172.21.15.16:0/3207846124 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f7752754640 1 --2- 172.21.15.16:0/3207846124 >> v2:172.21.15.174:3300/0 conn(0x7f774c0b66b0 0x7f774c0b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f7751752640 1 -- 172.21.15.16:0/3207846124 >> v2:172.21.15.174:3300/0 conn(0x7f774c0b66b0 msgr2=0x7f774c0b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f7751752640 1 --2- 172.21.15.16:0/3207846124 >> v2:172.21.15.174:3300/0 conn(0x7f774c0b66b0 0x7f774c0b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f7751752640 1 -- 172.21.15.16:0/3207846124 >> v1:172.21.15.174:6789/0 conn(0x7f774c146d30 legacy=0x7f774c0d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.364+0000 7f7751752640 1 -- 172.21.15.16:0/3207846124 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774c0d2c30 con 0x7f774c0707a0 2024-05-11T01:13:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.365+0000 7f7751752640 1 --2- 172.21.15.16:0/3207846124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c0707a0 0x7f774c070c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f773c009870 tx=0x7f773c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8472c0440190b30f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.365+0000 7f7750f51640 1 -- 172.21.15.16:0/3207846124 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c037070 con 0x7f774c0707a0 2024-05-11T01:13:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.365+0000 7f7750f51640 1 -- 172.21.15.16:0/3207846124 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f773c032440 con 0x7f774c0707a0 2024-05-11T01:13:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.365+0000 7f7750f51640 1 -- 172.21.15.16:0/3207846124 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c032810 con 0x7f774c0707a0 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.366+0000 7f77541b7640 1 -- 172.21.15.16:0/3207846124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c0707a0 msgr2=0x7f774c070c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.366+0000 7f77541b7640 1 --2- 172.21.15.16:0/3207846124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c0707a0 0x7f774c070c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f773c009870 tx=0x7f773c02a270 comp rx=0 tx=0).stop 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.366+0000 7f77541b7640 1 -- 172.21.15.16:0/3207846124 shutdown_connections 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.366+0000 7f77541b7640 1 --2- 172.21.15.16:0/3207846124 >> v2:172.21.15.174:3300/0 conn(0x7f774c0b66b0 0x7f774c0b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.366+0000 7f77541b7640 1 --2- 172.21.15.16:0/3207846124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c0707a0 0x7f774c070c20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.366+0000 7f77541b7640 1 -- 172.21.15.16:0/3207846124 >> 172.21.15.16:0/3207846124 conn(0x7f774c0b8510 msgr2=0x7f774c0b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.366+0000 7f77541b7640 1 -- 172.21.15.16:0/3207846124 shutdown_connections 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.366+0000 7f77541b7640 1 -- 172.21.15.16:0/3207846124 wait complete. 2024-05-11T01:13:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.367+0000 7f77541b7640 1 Processor -- start 2024-05-11T01:13:58.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.367+0000 7f77541b7640 1 -- start start 2024-05-11T01:13:58.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f77541b7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f774c0707a0 0x7f774c1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f77541b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f774c0b66b0 0x7f774c142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f77541b7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c146d30 0x7f774c131520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f77541b7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f774c0d2420 con 0x7f774c0b66b0 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f77541b7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f774c0d22a0 con 0x7f774c0707a0 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f77541b7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f774c15da30 con 0x7f774c146d30 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f7751752640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f774c0b66b0 0x7f774c142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f7751752640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f774c0b66b0 0x7f774c142150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38286/0 (socket says 172.21.15.16:38286) 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f7751752640 1 -- 172.21.15.16:0/1691940641 learned_addr learned my addr 172.21.15.16:0/1691940641 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f7752754640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c146d30 0x7f774c131520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.368+0000 7f7751f53640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f774c0707a0 0x7f774c1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f7751752640 1 -- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c146d30 msgr2=0x7f774c131520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f7751752640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c146d30 0x7f774c131520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f7751752640 1 -- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f774c0707a0 msgr2=0x7f774c1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f7751752640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f774c0707a0 0x7f774c1568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f7751752640 1 -- 172.21.15.16:0/1691940641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774c142c10 con 0x7f774c0b66b0 2024-05-11T01:13:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f7751752640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f774c0b66b0 0x7f774c142150 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f773c02a2b0 tx=0x7f773c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f77427fc640 1 -- 172.21.15.16:0/1691940641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c037040 con 0x7f774c0b66b0 2024-05-11T01:13:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f77427fc640 1 -- 172.21.15.16:0/1691940641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f773c042070 con 0x7f774c0b66b0 2024-05-11T01:13:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774c142ef0 con 0x7f774c0b66b0 2024-05-11T01:13:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f77427fc640 1 -- 172.21.15.16:0/1691940641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c030880 con 0x7f774c0b66b0 2024-05-11T01:13:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.369+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f774c1434b0 con 0x7f774c0b66b0 2024-05-11T01:13:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.370+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774c0b88f0 con 0x7f774c0b66b0 2024-05-11T01:13:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.371+0000 7f77427fc640 1 -- 172.21.15.16:0/1691940641 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f773c030a20 con 0x7f774c0b66b0 2024-05-11T01:13:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.371+0000 7f77427fc640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f77300762d0 0x7f7730078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.371+0000 7f77427fc640 1 -- 172.21.15.16:0/1691940641 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6073+0+0 (secure 0 0 0) 0x7f773c0b7f80 con 0x7f774c0b66b0 2024-05-11T01:13:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.371+0000 7f7751f53640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f77300762d0 0x7f7730078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.372+0000 7f7751f53640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f77300762d0 0x7f7730078790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7748001720 tx=0x7f7748009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.376+0000 7f77427fc640 1 -- 172.21.15.16:0/1691940641 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f774c0b88f0 con 0x7f774c0b66b0 2024-05-11T01:13:58.547 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-05-11T01:13:58.547+0000 7fc6f0238640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-11T01:13:58.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:58.615+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f774c146090 con 0x7f774c0b66b0 2024-05-11T01:13:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.572+0000 7f77427fc640 1 -- 172.21.15.16:0/1691940641 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f773c081010 con 0x7f774c0b66b0 2024-05-11T01:13:59.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f77300762d0 msgr2=0x7f7730078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:59.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f77300762d0 0x7f7730078790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7748001720 tx=0x7f7748009040 comp rx=0 tx=0).stop 2024-05-11T01:13:59.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f774c0b66b0 msgr2=0x7f774c142150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:59.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f774c0b66b0 0x7f774c142150 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f773c02a2b0 tx=0x7f773c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 shutdown_connections 2024-05-11T01:13:59.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f774c146d30 0x7f774c131520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f774c0b66b0 0x7f774c142150 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f77300762d0 0x7f7730078790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.575+0000 7f77541b7640 1 --2- 172.21.15.16:0/1691940641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f774c0707a0 0x7f774c1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.576+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 >> 172.21.15.16:0/1691940641 conn(0x7f774c0b8510 msgr2=0x7f774c15f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:59.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.576+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 shutdown_connections 2024-05-11T01:13:59.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.576+0000 7f77541b7640 1 -- 172.21.15.16:0/1691940641 wait complete. 2024-05-11T01:13:59.589 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-11T01:13:59.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-11T01:13:59.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.704+0000 7fe8bed89640 1 Processor -- start 2024-05-11T01:13:59.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.704+0000 7fe8bed89640 1 -- start start 2024-05-11T01:13:59.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8bed89640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8b815f680 0x7fe8b80d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8bed89640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8b80d0e40 0x7fe8b80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8bed89640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8b806d600 con 0x7fe8b80b5230 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8bed89640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fe8b80b5680 con 0x7fe8b80d0e40 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8bed89640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b80ce7f0 con 0x7fe8b815f680 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8bd326640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe8b80b5230 0x7fe8b8163340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53282/0 (socket says 172.21.15.16:53282) 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8bd326640 1 -- 172.21.15.16:0/309236376 learned_addr learned my addr 172.21.15.16:0/309236376 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8bcb25640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8b815f680 0x7fe8b80d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b7fff640 1 --2- 172.21.15.16:0/309236376 >> v2:172.21.15.174:3300/0 conn(0x7fe8b80d0e40 0x7fe8b80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587539358 0 0) 0x7fe8b806d600 con 0x7fe8b80b5230 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8a4003520 con 0x7fe8b80b5230 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1633163674 0 0) 0x7fe8a4003520 con 0x7fe8b80b5230 2024-05-11T01:13:59.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8b815f680 msgr2=0x7fe8b80d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8b815f680 0x7fe8b80d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 >> v2:172.21.15.174:3300/0 conn(0x7fe8b80d0e40 msgr2=0x7fe8b80b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 --2- 172.21.15.16:0/309236376 >> v2:172.21.15.174:3300/0 conn(0x7fe8b80d0e40 0x7fe8b80b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b806d8e0 con 0x7fe8b80b5230 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fe8b0001a70 con 0x7fe8b80b5230 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 >> v1:172.21.15.16:6789/0 conn(0x7fe8b80b5230 legacy=0x7fe8b8163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a4003a00 0x7fe8a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.705+0000 7fe8b77fe640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8b815f680 0x7fe8a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8b77fe640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a4004d40 0x7fe8a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b80b5680 con 0x7fe8a4003a00 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b80ce7f0 con 0x7fe8a4004d40 2024-05-11T01:13:59.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a400b9c0 con 0x7fe8b815f680 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8bcb25640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a4003a00 0x7fe8a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8b7fff640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8b815f680 0x7fe8a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8bd326640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a4004d40 0x7fe8a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8bcb25640 1 -- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8b815f680 msgr2=0x7fe8a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8bcb25640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8b815f680 0x7fe8a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8bcb25640 1 -- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a4004d40 msgr2=0x7fe8a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8bcb25640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a4004d40 0x7fe8a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.706+0000 7fe8bcb25640 1 -- 172.21.15.16:0/309236376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a4003520 con 0x7fe8a4003a00 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8bcb25640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a4003a00 0x7fe8a4003e20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009ac0 tx=0x7fe8a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42146496895f6162 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8036070 con 0x7fe8a4003a00 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a8031400 con 0x7fe8a4003a00 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8b77fe640 1 -- 172.21.15.16:0/309236376 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8009690 con 0x7fe8a4003a00 2024-05-11T01:13:59.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8bed89640 1 -- 172.21.15.16:0/309236376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a4003a00 msgr2=0x7fe8a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:59.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8bed89640 1 --2- 172.21.15.16:0/309236376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a4003a00 0x7fe8a4003e20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009ac0 tx=0x7fe8a4005830 comp rx=0 tx=0).stop 2024-05-11T01:13:59.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8bd326640 1 -- 172.21.15.16:0/309236376 reap_dead start 2024-05-11T01:13:59.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8bed89640 1 -- 172.21.15.16:0/309236376 shutdown_connections 2024-05-11T01:13:59.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8bed89640 1 -- 172.21.15.16:0/309236376 >> 172.21.15.16:0/309236376 conn(0x7fe8b80681c0 msgr2=0x7fe8b80685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:13:59.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8bed89640 1 -- 172.21.15.16:0/309236376 shutdown_connections 2024-05-11T01:13:59.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.707+0000 7fe8bed89640 1 -- 172.21.15.16:0/309236376 wait complete. 2024-05-11T01:13:59.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.709+0000 7fe8bed89640 1 Processor -- start 2024-05-11T01:13:59.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.709+0000 7fe8bed89640 1 -- start start 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.709+0000 7fe8bed89640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a4003a00 0x7fe8b81541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.709+0000 7fe8bed89640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8b81576c0 0x7fe8b8155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bed89640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8b8157b40 0x7fe8b815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bed89640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b806e180 con 0x7fe8b8157b40 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bed89640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b806dea0 con 0x7fe8b81576c0 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bed89640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b815fa60 con 0x7fe8a4003a00 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8b8157b40 0x7fe8b815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8b8157b40 0x7fe8b815c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38310/0 (socket says 172.21.15.16:38310) 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 -- 172.21.15.16:0/1597465484 learned_addr learned my addr 172.21.15.16:0/1597465484 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:13:59.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8b7fff640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8b81576c0 0x7fe8b8155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bcb25640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a4003a00 0x7fe8b81541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 -- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a4003a00 msgr2=0x7fe8b81541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a4003a00 0x7fe8b81541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 -- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8b81576c0 msgr2=0x7fe8b8155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8b81576c0 0x7fe8b8155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 -- 172.21.15.16:0/1597465484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b8156900 con 0x7fe8b8157b40 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bd326640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8b8157b40 0x7fe8b815c4e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe8b806cee0 tx=0x7fe8b000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8b57fa640 1 -- 172.21.15.16:0/1597465484 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000eda0 con 0x7fe8b8157b40 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8b57fa640 1 -- 172.21.15.16:0/1597465484 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b0014430 con 0x7fe8b8157b40 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b8156be0 con 0x7fe8b8157b40 2024-05-11T01:13:59.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8b57fa640 1 -- 172.21.15.16:0/1597465484 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0014820 con 0x7fe8b8157b40 2024-05-11T01:13:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.710+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b81549b0 con 0x7fe8b8157b40 2024-05-11T01:13:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.711+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b806a5b0 con 0x7fe8b8157b40 2024-05-11T01:13:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.712+0000 7fe8b57fa640 1 -- 172.21.15.16:0/1597465484 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fe8b00149c0 con 0x7fe8b8157b40 2024-05-11T01:13:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.713+0000 7fe8b57fa640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe898076300 0x7fe8980787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:13:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.713+0000 7fe8b57fa640 1 -- 172.21.15.16:0/1597465484 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7fe8b0097590 con 0x7fe8b8157b40 2024-05-11T01:13:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.713+0000 7fe8bcb25640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe898076300 0x7fe8980787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:13:59.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.714+0000 7fe8bcb25640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe898076300 0x7fe8980787c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8033000 tx=0x7fe8a8008030 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:13:59.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.717+0000 7fe8b57fa640 1 -- 172.21.15.16:0/1597465484 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe8b0060e10 con 0x7fe8b8157b40 2024-05-11T01:13:59.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:13:59.947+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe8b80d0740 con 0x7fe8b8157b40 2024-05-11T01:14:00.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.574+0000 7fe8b57fa640 1 -- 172.21.15.16:0/1597465484 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7fe8b0060710 con 0x7fe8b8157b40 2024-05-11T01:14:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe898076300 msgr2=0x7fe8980787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe898076300 0x7fe8980787c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8033000 tx=0x7fe8a8008030 comp rx=0 tx=0).stop 2024-05-11T01:14:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8b8157b40 msgr2=0x7fe8b815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8b8157b40 0x7fe8b815c4e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe8b806cee0 tx=0x7fe8b000e530 comp rx=0 tx=0).stop 2024-05-11T01:14:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 shutdown_connections 2024-05-11T01:14:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8b8157b40 0x7fe8b815c4e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe898076300 0x7fe8980787c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8b81576c0 0x7fe8b8155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 --2- 172.21.15.16:0/1597465484 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a4003a00 0x7fe8b81541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 >> 172.21.15.16:0/1597465484 conn(0x7fe8b80681c0 msgr2=0x7fe8b80b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 shutdown_connections 2024-05-11T01:14:00.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.577+0000 7fe8bed89640 1 -- 172.21.15.16:0/1597465484 wait complete. 2024-05-11T01:14:00.591 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-11T01:14:00.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:14:00.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.701+0000 7fd0c427e640 1 Processor -- start 2024-05-11T01:14:00.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.701+0000 7fd0c427e640 1 -- start start 2024-05-11T01:14:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.702+0000 7fd0c427e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd0bc0bac10 0x7fd0bc0d3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.702+0000 7fd0c427e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0d3ec0 0x7fd0bc0d4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.702+0000 7fd0c427e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0bc163e90 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.702+0000 7fd0c427e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd0bc0cfad0 con 0x7fd0bc0bac10 2024-05-11T01:14:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.702+0000 7fd0c427e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd0bc163310 con 0x7fd0bc0d3ec0 2024-05-11T01:14:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.702+0000 7fd0c1819640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd0bc0bac10 0x7fd0bc0d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:00.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.703+0000 7fd0c1819640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd0bc0bac10 0x7fd0bc0d3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38324/0 (socket says 172.21.15.16:38324) 2024-05-11T01:14:00.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.703+0000 7fd0c1819640 1 -- 172.21.15.16:0/4088065288 learned_addr learned my addr 172.21.15.16:0/4088065288 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:00.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.703+0000 7fd0c281b640 1 --2- 172.21.15.16:0/4088065288 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0d3ec0 0x7fd0bc0d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:00.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.703+0000 7fd0c1819640 1 -- 172.21.15.16:0/4088065288 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0d3ec0 msgr2=0x7fd0bc0d4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:00.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.703+0000 7fd0c1819640 1 --2- 172.21.15.16:0/4088065288 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0d3ec0 0x7fd0bc0d4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.703+0000 7fd0c1819640 1 -- 172.21.15.16:0/4088065288 >> v1:172.21.15.174:6789/0 conn(0x7fd0bc0b6d70 legacy=0x7fd0bc0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:00.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.703+0000 7fd0c1819640 1 -- 172.21.15.16:0/4088065288 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc1635f0 con 0x7fd0bc0bac10 2024-05-11T01:14:00.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.704+0000 7fd0c1819640 1 --2- 172.21.15.16:0/4088065288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0bac10 0x7fd0bc0d3980 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00098a0 tx=0x7fd0b002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79dd09aa55d8d008 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:00.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.704+0000 7fd0c1018640 1 -- 172.21.15.16:0/4088065288 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0037070 con 0x7fd0bc0bac10 2024-05-11T01:14:00.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.704+0000 7fd0c1018640 1 -- 172.21.15.16:0/4088065288 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0b0032440 con 0x7fd0bc0bac10 2024-05-11T01:14:00.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.704+0000 7fd0c1018640 1 -- 172.21.15.16:0/4088065288 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0032810 con 0x7fd0bc0bac10 2024-05-11T01:14:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.704+0000 7fd0c427e640 1 -- 172.21.15.16:0/4088065288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0bac10 msgr2=0x7fd0bc0d3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.704+0000 7fd0c427e640 1 --2- 172.21.15.16:0/4088065288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0bac10 0x7fd0bc0d3980 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd0b00098a0 tx=0x7fd0b002a200 comp rx=0 tx=0).stop 2024-05-11T01:14:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.704+0000 7fd0c427e640 1 -- 172.21.15.16:0/4088065288 shutdown_connections 2024-05-11T01:14:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.704+0000 7fd0c427e640 1 --2- 172.21.15.16:0/4088065288 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0d3ec0 0x7fd0bc0d4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.705+0000 7fd0c427e640 1 --2- 172.21.15.16:0/4088065288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0bac10 0x7fd0bc0d3980 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.705+0000 7fd0c427e640 1 -- 172.21.15.16:0/4088065288 >> 172.21.15.16:0/4088065288 conn(0x7fd0bc074140 msgr2=0x7fd0bc0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.705+0000 7fd0c427e640 1 -- 172.21.15.16:0/4088065288 shutdown_connections 2024-05-11T01:14:00.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.705+0000 7fd0c427e640 1 -- 172.21.15.16:0/4088065288 wait complete. 2024-05-11T01:14:00.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.706+0000 7fd0c427e640 1 Processor -- start 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.706+0000 7fd0c427e640 1 -- start start 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c427e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0b6d70 0x7fd0bc157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c427e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0bac10 0x7fd0bc15f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c427e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc0d3ec0 0x7fd0bc15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c427e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc15f830 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c427e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc163bb0 con 0x7fd0bc0d3ec0 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c427e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fd0bc162fc0 con 0x7fd0bc0bac10 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0b6d70 0x7fd0bc157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0b6d70 0x7fd0bc157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38336/0 (socket says 172.21.15.16:38336) 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 -- 172.21.15.16:0/3124883118 learned_addr learned my addr 172.21.15.16:0/3124883118 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 -- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0bac10 msgr2=0x7fd0bc15f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0bac10 0x7fd0bc15f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 -- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc0d3ec0 msgr2=0x7fd0bc15fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c281b640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc0d3ec0 0x7fd0bc15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc0d3ec0 0x7fd0bc15fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 -- 172.21.15.16:0/3124883118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc0cd6b0 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c281b640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc0d3ec0 0x7fd0bc15fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0c201a640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0b6d70 0x7fd0bc157790 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c730 tx=0x7fd0ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0baffd640 1 -- 172.21.15.16:0/3124883118 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac003b70 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.707+0000 7fd0baffd640 1 -- 172.21.15.16:0/3124883118 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0ac003d30 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.708+0000 7fd0baffd640 1 -- 172.21.15.16:0/3124883118 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac00aa90 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.708+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0bc160520 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.708+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0bc160ae0 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.709+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0bc1581e0 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.709+0000 7fd0baffd640 1 -- 172.21.15.16:0/3124883118 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fd0ac00ac30 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.710+0000 7fd0baffd640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd0a80762d0 0x7fd0a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.710+0000 7fd0baffd640 1 -- 172.21.15.16:0/3124883118 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7fd0ac097620 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.710+0000 7fd0c1819640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd0a80762d0 0x7fd0a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:00.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.711+0000 7fd0c1819640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd0a80762d0 0x7fd0a8078790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0034000 tx=0x7fd0b002c000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:00.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.714+0000 7fd0baffd640 1 -- 172.21.15.16:0/3124883118 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd0ac060ea0 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.945+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0bc0b4a30 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.945+0000 7fd0baffd640 1 -- 172.21.15.16:0/3124883118 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5184 (secure 0 0 0) 0x7fd0ac0607a0 con 0x7fd0bc0b6d70 2024-05-11T01:14:00.946 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:00.946 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2061855514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2061855514},{"type":"v1","addr":"172.21.15.16:6835","nonce":2061855514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/1304273524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1304273524},{"type":"v1","addr":"172.21.15.174:6836","nonce":1304273524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/878993880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":878993880},{"type":"v1","addr":"172.21.15.174:6837","nonce":878993880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:13:56.948645+0000","modified":"2024-05-11T01:13:59.949604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/3060746236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3060746236},{"type":"v1","addr":"172.21.15.16:6834","nonce":3060746236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5610,"qdb_cluster":[5610]},"id":3}]} 2024-05-11T01:14:00.946 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-05-11T01:14:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd0a80762d0 msgr2=0x7fd0a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd0a80762d0 0x7fd0a8078790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0034000 tx=0x7fd0b002c000 comp rx=0 tx=0).stop 2024-05-11T01:14:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0b6d70 msgr2=0x7fd0bc157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0b6d70 0x7fd0bc157790 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c730 tx=0x7fd0ac00cbf0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 shutdown_connections 2024-05-11T01:14:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fd0a80762d0 0x7fd0a8078790 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc0d3ec0 0x7fd0bc15fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fd0bc0bac10 0x7fd0bc15f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 --2- 172.21.15.16:0/3124883118 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0bc0b6d70 0x7fd0bc157790 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:00.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 >> 172.21.15.16:0/3124883118 conn(0x7fd0bc074140 msgr2=0x7fd0bc0cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:00.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 shutdown_connections 2024-05-11T01:14:00.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:00.948+0000 7fd0c427e640 1 -- 172.21.15.16:0/3124883118 wait complete. 2024-05-11T01:14:00.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:14:01.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.062+0000 7f67b2380640 1 Processor -- start 2024-05-11T01:14:01.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.062+0000 7f67b2380640 1 -- start start 2024-05-11T01:14:01.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.063+0000 7f67b2380640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67ac0b6d70 0x7f67ac0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.063+0000 7f67b2380640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67ac163e90 con 0x7f67ac0bac10 2024-05-11T01:14:01.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.063+0000 7f67b2380640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67ac06e230 con 0x7f67ac0d4990 2024-05-11T01:14:01.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.063+0000 7f67b2380640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f67ac0cfad0 con 0x7f67ac0b6d70 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.063+0000 7f67ab7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f67ac0bac10 0x7f67ac06d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53288/0 (socket says 172.21.15.16:53288) 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.063+0000 7f67ab7fe640 1 -- 172.21.15.16:0/1115996669 learned_addr learned my addr 172.21.15.16:0/1115996669 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202586104 0 0) 0x7f67ac163e90 con 0x7f67ac0bac10 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67abfff640 1 --2- 172.21.15.16:0/1115996669 >> v2:172.21.15.174:3300/0 conn(0x7f67ac0b6d70 0x7f67ac0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6794003520 con 0x7f67ac0bac10 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1456127993 0 0) 0x7f6794003520 con 0x7f67ac0bac10 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 >> v2:172.21.15.174:3300/0 conn(0x7f67ac0b6d70 msgr2=0x7f67ac0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 --2- 172.21.15.16:0/1115996669 >> v2:172.21.15.174:3300/0 conn(0x7f67ac0b6d70 0x7f67ac0b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 >> v1:172.21.15.174:6789/0 conn(0x7f67ac0d4990 legacy=0x7f67ac06db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac0b7690 con 0x7f67ac0bac10 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f67a00016f0 con 0x7f67ac0bac10 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 >> v1:172.21.15.16:6789/0 conn(0x7f67ac0bac10 legacy=0x7f67ac06d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6794003a50 0x7f6794003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6794004800 0x7f6794004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67940052e0 0x7f679400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac0cfad0 con 0x7f67940052e0 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f679400c1b0 con 0x7f6794003a50 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f679400c3b0 con 0x7f6794004800 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67b091d640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67940052e0 0x7f679400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67abfff640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6794003a50 0x7f6794003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67ab7fe640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6794004800 0x7f6794004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67b091d640 1 -- 172.21.15.16:0/1115996669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6794004800 msgr2=0x7f6794004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67b091d640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6794004800 0x7f6794004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67b091d640 1 -- 172.21.15.16:0/1115996669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6794003a50 msgr2=0x7f6794003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67b091d640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6794003a50 0x7f6794003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.064+0000 7f67b091d640 1 -- 172.21.15.16:0/1115996669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6794003520 con 0x7f67940052e0 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.065+0000 7f67b091d640 1 -- 172.21.15.16:0/1115996669 reap_dead start 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.065+0000 7f67b091d640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67940052e0 0x7f679400b9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f67a4001e60 tx=0x7f6794005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb0bb5ffafc1f15 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.065+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4001ab0 con 0x7f67940052e0 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.065+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a402ae40 con 0x7f67940052e0 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.065+0000 7f67aaffd640 1 -- 172.21.15.16:0/1115996669 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4003b70 con 0x7f67940052e0 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.066+0000 7f67b2380640 1 -- 172.21.15.16:0/1115996669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67940052e0 msgr2=0x7f679400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.066+0000 7f67b2380640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67940052e0 0x7f679400b9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f67a4001e60 tx=0x7f6794005830 comp rx=0 tx=0).stop 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.066+0000 7f67b2380640 1 -- 172.21.15.16:0/1115996669 shutdown_connections 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.066+0000 7f67b2380640 1 --2- 172.21.15.16:0/1115996669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67940052e0 0x7f679400b9c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.066+0000 7f67b2380640 1 -- 172.21.15.16:0/1115996669 >> 172.21.15.16:0/1115996669 conn(0x7f67ac074140 msgr2=0x7f67ac0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.066+0000 7f67b2380640 1 -- 172.21.15.16:0/1115996669 shutdown_connections 2024-05-11T01:14:01.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.066+0000 7f67b2380640 1 -- 172.21.15.16:0/1115996669 wait complete. 2024-05-11T01:14:01.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.067+0000 7f67b2380640 1 Processor -- start 2024-05-11T01:14:01.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.067+0000 7f67b2380640 1 -- start start 2024-05-11T01:14:01.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b2380640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67940052e0 0x7f67ac0aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b2380640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67ac0cd250 0x7f67ac1f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b2380640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ac1f88e0 0x7f67ac15df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b2380640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1638d0 con 0x7f67ac1f88e0 2024-05-11T01:14:01.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b2380640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac1635f0 con 0x7f67940052e0 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b2380640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f67ac163bb0 con 0x7f67ac0cd250 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b091d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ac1f88e0 0x7f67ac15df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b091d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ac1f88e0 0x7f67ac15df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38354/0 (socket says 172.21.15.16:38354) 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b091d640 1 -- 172.21.15.16:0/246309756 learned_addr learned my addr 172.21.15.16:0/246309756 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67abfff640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67940052e0 0x7f67ac0aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67ab7fe640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67ac0cd250 0x7f67ac1f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b091d640 1 -- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67ac0cd250 msgr2=0x7f67ac1f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b091d640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67ac0cd250 0x7f67ac1f83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b091d640 1 -- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67940052e0 msgr2=0x7f67ac0aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b091d640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67940052e0 0x7f67ac0aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.068+0000 7f67b091d640 1 -- 172.21.15.16:0/246309756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac0cd9c0 con 0x7f67ac1f88e0 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.069+0000 7f67b091d640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ac1f88e0 0x7f67ac15df30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f67a4001f80 tx=0x7f67a40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.069+0000 7f67a8ff9640 1 -- 172.21.15.16:0/246309756 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4007df0 con 0x7f67ac1f88e0 2024-05-11T01:14:01.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.069+0000 7f67a8ff9640 1 -- 172.21.15.16:0/246309756 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67a402ac40 con 0x7f67ac1f88e0 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.069+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ac0cdca0 con 0x7f67ac1f88e0 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.069+0000 7f67a8ff9640 1 -- 172.21.15.16:0/246309756 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4005810 con 0x7f67ac1f88e0 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.069+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ac0abe20 con 0x7f67ac1f88e0 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.070+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ac06a5b0 con 0x7f67ac1f88e0 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.070+0000 7f67a8ff9640 1 -- 172.21.15.16:0/246309756 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f67a4044060 con 0x7f67ac1f88e0 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.071+0000 7f67a8ff9640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f67980762d0 0x7f6798078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.071+0000 7f67a8ff9640 1 -- 172.21.15.16:0/246309756 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7f67a40b6660 con 0x7f67ac1f88e0 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.071+0000 7f67abfff640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f67980762d0 0x7f6798078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.072+0000 7f67abfff640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f67980762d0 0x7f6798078790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f67ac1f8300 tx=0x7f679c009190 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.075+0000 7f67a8ff9640 1 -- 172.21.15.16:0/246309756 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f67a407ffa0 con 0x7f67ac1f88e0 2024-05-11T01:14:01.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.269+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67ac0b4a30 con 0x7f67ac1f88e0 2024-05-11T01:14:01.270 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.270+0000 7f67a8ff9640 1 -- 172.21.15.16:0/246309756 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+17139 (secure 0 0 0) 0x7f67a407f8a0 con 0x7f67ac1f88e0 2024-05-11T01:14:01.270 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:01.271 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":59,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:13:58.559233+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:13:54.615049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-11T01:13:55.893718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":1},{"begin":28,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":49,"length":2},{"begin":55,"length":1},{"begin":60,"length":3},{"begin":66,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":81,"length":3},{"begin":87,"length":1},{"begin":93,"length":2},{"begin":98,"length":1},{"begin":103,"length":2},{"begin":108,"length":1},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:14:01.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f67980762d0 msgr2=0x7f6798078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f67980762d0 0x7f6798078790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f67ac1f8300 tx=0x7f679c009190 comp rx=0 tx=0).stop 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ac1f88e0 msgr2=0x7f67ac15df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ac1f88e0 0x7f67ac15df30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f67a4001f80 tx=0x7f67a40014a0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 shutdown_connections 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67ac1f88e0 0x7f67ac15df30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f67ac0cd250 0x7f67ac1f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f67980762d0 0x7f6798078790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 --2- 172.21.15.16:0/246309756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67940052e0 0x7f67ac0aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 >> 172.21.15.16:0/246309756 conn(0x7f67ac074140 msgr2=0x7f67ac06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 shutdown_connections 2024-05-11T01:14:01.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.272+0000 7f67b2380640 1 -- 172.21.15.16:0/246309756 wait complete. 2024-05-11T01:14:01.284 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-11T01:14:01.284 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:14:01.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.388+0000 7fdc12124640 1 Processor -- start 2024-05-11T01:14:01.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.388+0000 7fdc12124640 1 -- start start 2024-05-11T01:14:01.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.388+0000 7fdc12124640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdc0c0d0000 0x7fdc0c0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.388+0000 7fdc12124640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c0baed0 0x7fdc0c162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.388+0000 7fdc12124640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc0c0d0920 con 0x7fdc0c06d3e0 2024-05-11T01:14:01.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.388+0000 7fdc12124640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0c163820 con 0x7fdc0c0d0000 2024-05-11T01:14:01.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.388+0000 7fdc12124640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0c163b00 con 0x7fdc0c0baed0 2024-05-11T01:14:01.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.389+0000 7fdc0b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdc0c0d0000 0x7fdc0c0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.389+0000 7fdc0b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdc0c0d0000 0x7fdc0c0d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38364/0 (socket says 172.21.15.16:38364) 2024-05-11T01:14:01.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.389+0000 7fdc0b7fe640 1 -- 172.21.15.16:0/4089639575 learned_addr learned my addr 172.21.15.16:0/4089639575 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:01.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.389+0000 7fdc0affd640 1 --2- 172.21.15.16:0/4089639575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c0baed0 0x7fdc0c162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.389+0000 7fdc0b7fe640 1 -- 172.21.15.16:0/4089639575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c0baed0 msgr2=0x7fdc0c162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:01.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.389+0000 7fdc0b7fe640 1 --2- 172.21.15.16:0/4089639575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c0baed0 0x7fdc0c162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.389+0000 7fdc0b7fe640 1 -- 172.21.15.16:0/4089639575 >> v1:172.21.15.174:6789/0 conn(0x7fdc0c06d3e0 legacy=0x7fdc0c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.389+0000 7fdc0b7fe640 1 -- 172.21.15.16:0/4089639575 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c0d33f0 con 0x7fdc0c0d0000 2024-05-11T01:14:01.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.390+0000 7fdc0b7fe640 1 --2- 172.21.15.16:0/4089639575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c0d03e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009870 tx=0x7fdbfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511bab441aa4a773 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.390+0000 7fdc0a7fc640 1 -- 172.21.15.16:0/4089639575 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc037070 con 0x7fdc0c0d0000 2024-05-11T01:14:01.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.390+0000 7fdc0a7fc640 1 -- 172.21.15.16:0/4089639575 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc032440 con 0x7fdc0c0d0000 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.390+0000 7fdc0a7fc640 1 -- 172.21.15.16:0/4089639575 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc032810 con 0x7fdc0c0d0000 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.391+0000 7fdc12124640 1 -- 172.21.15.16:0/4089639575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 msgr2=0x7fdc0c0d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.391+0000 7fdc12124640 1 --2- 172.21.15.16:0/4089639575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c0d03e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009870 tx=0x7fdbfc02a270 comp rx=0 tx=0).stop 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.391+0000 7fdc12124640 1 -- 172.21.15.16:0/4089639575 shutdown_connections 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.391+0000 7fdc12124640 1 --2- 172.21.15.16:0/4089639575 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c0baed0 0x7fdc0c162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.391+0000 7fdc12124640 1 --2- 172.21.15.16:0/4089639575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c0d03e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.391+0000 7fdc12124640 1 -- 172.21.15.16:0/4089639575 >> 172.21.15.16:0/4089639575 conn(0x7fdc0c074140 msgr2=0x7fdc0c0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.391+0000 7fdc12124640 1 -- 172.21.15.16:0/4089639575 shutdown_connections 2024-05-11T01:14:01.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.391+0000 7fdc12124640 1 -- 172.21.15.16:0/4089639575 wait complete. 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.392+0000 7fdc12124640 1 Processor -- start 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.392+0000 7fdc12124640 1 -- start start 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc12124640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c06d3e0 0x7fdc0c0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc12124640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0baed0 0x7fdc0c162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc12124640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc12124640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c163de0 con 0x7fdc0c0d0000 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc12124640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c163510 con 0x7fdc0c0baed0 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc12124640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0c15f750 con 0x7fdc0c06d3e0 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c15ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38376/0 (socket says 172.21.15.16:38376) 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0bfff640 1 -- 172.21.15.16:0/3272310286 learned_addr learned my addr 172.21.15.16:0/3272310286 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:01.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0affd640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0baed0 0x7fdc0c162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0b7fe640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c06d3e0 0x7fdc0c0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0bfff640 1 -- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c06d3e0 msgr2=0x7fdc0c0caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0bfff640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c06d3e0 0x7fdc0c0caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0bfff640 1 -- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0baed0 msgr2=0x7fdc0c162240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0bfff640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0baed0 0x7fdc0c162240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0bfff640 1 -- 172.21.15.16:0/3272310286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c161db0 con 0x7fdc0c0d0000 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.393+0000 7fdc0affd640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0baed0 0x7fdc0c162240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.394+0000 7fdc0bfff640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c15ced0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c730 tx=0x7fdc0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.394+0000 7fdbf3fff640 1 -- 172.21.15.16:0/3272310286 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04003b70 con 0x7fdc0c0d0000 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.394+0000 7fdbf3fff640 1 -- 172.21.15.16:0/3272310286 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc04003d10 con 0x7fdc0c0d0000 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.394+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c15c4d0 con 0x7fdc0c0d0000 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.394+0000 7fdbf3fff640 1 -- 172.21.15.16:0/3272310286 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400aa70 con 0x7fdc0c0d0000 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.394+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c162780 con 0x7fdc0c0d0000 2024-05-11T01:14:01.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.395+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0c06a5b0 con 0x7fdc0c0d0000 2024-05-11T01:14:01.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.395+0000 7fdbf3fff640 1 -- 172.21.15.16:0/3272310286 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fdc0400ac10 con 0x7fdc0c0d0000 2024-05-11T01:14:01.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.396+0000 7fdbf3fff640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdbf80762d0 0x7fdbf8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.396+0000 7fdbf3fff640 1 -- 172.21.15.16:0/3272310286 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7fdc04097590 con 0x7fdc0c0d0000 2024-05-11T01:14:01.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.396+0000 7fdc0b7fe640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdbf80762d0 0x7fdbf8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.397+0000 7fdc0b7fe640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdbf80762d0 0x7fdbf8078790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc034000 tx=0x7fdbfc02e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.400+0000 7fdbf3fff640 1 -- 172.21.15.16:0/3272310286 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc04060e10 con 0x7fdc0c0d0000 2024-05-11T01:14:01.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.587+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc0c15cb20 con 0x7fdbf80762d0 2024-05-11T01:14:01.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.594+0000 7fdbf3fff640 1 -- 172.21.15.16:0/3272310286 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245035 (secure 0 0 0) 0x7fdc0c15cb20 con 0x7fdbf80762d0 2024-05-11T01:14:01.597 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdbf80762d0 msgr2=0x7fdbf8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdbf80762d0 0x7fdbf8078790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc034000 tx=0x7fdbfc02e000 comp rx=0 tx=0).stop 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 msgr2=0x7fdc0c15ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c15ced0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c730 tx=0x7fdc0400cbf0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 shutdown_connections 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc0c0d0000 0x7fdc0c15ced0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fdbf80762d0 0x7fdbf8078790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc0c0baed0 0x7fdc0c162240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 --2- 172.21.15.16:0/3272310286 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fdc0c06d3e0 0x7fdc0c0caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 >> 172.21.15.16:0/3272310286 conn(0x7fdc0c074140 msgr2=0x7fdc0c0ba4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:01.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 shutdown_connections 2024-05-11T01:14:01.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.597+0000 7fdc12124640 1 -- 172.21.15.16:0/3272310286 wait complete. 2024-05-11T01:14:01.608 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-11T01:14:01.158571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":151,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":329504,"kb_used_data":6512,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754645216,"statfs":{"total":773094113280,"available":772756701184,"internally_reserved":0,"allocated":6668288,"data_stored":3728579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.606399"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564611+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:13:58.564611+0000","last_peered":"2024-05-11T01:13:58.564611+0000","last_clean":"2024-05-11T01:13:58.564611+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:13:58.564611+0000","last_undegraded":"2024-05-11T01:13:58.564611+0000","last_fullsized":"2024-05-11T01:13:58.564611+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577251+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:13:58.577251+0000","last_peered":"2024-05-11T01:13:58.577251+0000","last_clean":"2024-05-11T01:13:58.577251+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:13:58.577251+0000","last_undegraded":"2024-05-11T01:13:58.577251+0000","last_fullsized":"2024-05-11T01:13:58.577251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564736+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:13:58.564736+0000","last_peered":"2024-05-11T01:13:58.564736+0000","last_clean":"2024-05-11T01:13:58.564736+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:13:58.564736+0000","last_undegraded":"2024-05-11T01:13:58.564736+0000","last_fullsized":"2024-05-11T01:13:58.564736+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770697+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:13:58.770697+0000","last_peered":"2024-05-11T01:13:58.770697+0000","last_clean":"2024-05-11T01:13:58.770697+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:13:58.770697+0000","last_undegraded":"2024-05-11T01:13:58.770697+0000","last_fullsized":"2024-05-11T01:13:58.770697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577112+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:13:58.577112+0000","last_peered":"2024-05-11T01:13:58.577112+0000","last_clean":"2024-05-11T01:13:58.577112+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:13:58.577112+0000","last_undegraded":"2024-05-11T01:13:58.577112+0000","last_fullsized":"2024-05-11T01:13:58.577112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770687+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:13:58.770687+0000","last_peered":"2024-05-11T01:13:58.770687+0000","last_clean":"2024-05-11T01:13:58.770687+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:13:58.770687+0000","last_undegraded":"2024-05-11T01:13:58.770687+0000","last_fullsized":"2024-05-11T01:13:58.770687+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577524+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:13:58.577524+0000","last_peered":"2024-05-11T01:13:58.577524+0000","last_clean":"2024-05-11T01:13:58.577524+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:13:58.577524+0000","last_undegraded":"2024-05-11T01:13:58.577524+0000","last_fullsized":"2024-05-11T01:13:58.577524+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770272+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:13:58.770272+0000","last_peered":"2024-05-11T01:13:58.770272+0000","last_clean":"2024-05-11T01:13:58.770272+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:13:58.770272+0000","last_undegraded":"2024-05-11T01:13:58.770272+0000","last_fullsized":"2024-05-11T01:13:58.770272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577125+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:13:58.577125+0000","last_peered":"2024-05-11T01:13:58.577125+0000","last_clean":"2024-05-11T01:13:58.577125+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:13:58.577125+0000","last_undegraded":"2024-05-11T01:13:58.577125+0000","last_fullsized":"2024-05-11T01:13:58.577125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770214+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:13:58.770214+0000","last_peered":"2024-05-11T01:13:58.770214+0000","last_clean":"2024-05-11T01:13:58.770214+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:13:58.770214+0000","last_undegraded":"2024-05-11T01:13:58.770214+0000","last_fullsized":"2024-05-11T01:13:58.770214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770663+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:13:58.770663+0000","last_peered":"2024-05-11T01:13:58.770663+0000","last_clean":"2024-05-11T01:13:58.770663+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:13:58.770663+0000","last_undegraded":"2024-05-11T01:13:58.770663+0000","last_fullsized":"2024-05-11T01:13:58.770663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577582+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:13:58.577582+0000","last_peered":"2024-05-11T01:13:58.577582+0000","last_clean":"2024-05-11T01:13:58.577582+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:13:58.577582+0000","last_undegraded":"2024-05-11T01:13:58.577582+0000","last_fullsized":"2024-05-11T01:13:58.577582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559224+0000","last_change":"2024-05-11T01:13:55.559224+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559224+0000","last_undegraded":"2024-05-11T01:13:55.559224+0000","last_fullsized":"2024-05-11T01:13:55.559224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770480+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:13:58.770480+0000","last_peered":"2024-05-11T01:13:58.770480+0000","last_clean":"2024-05-11T01:13:58.770480+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:13:58.770480+0000","last_undegraded":"2024-05-11T01:13:58.770480+0000","last_fullsized":"2024-05-11T01:13:58.770480+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770562+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:13:58.770562+0000","last_peered":"2024-05-11T01:13:58.770562+0000","last_clean":"2024-05-11T01:13:58.770562+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:13:58.770562+0000","last_undegraded":"2024-05-11T01:13:58.770562+0000","last_fullsized":"2024-05-11T01:13:58.770562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564250+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:13:58.564250+0000","last_peered":"2024-05-11T01:13:58.564250+0000","last_clean":"2024-05-11T01:13:58.564250+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:13:58.564250+0000","last_undegraded":"2024-05-11T01:13:58.564250+0000","last_fullsized":"2024-05-11T01:13:58.564250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577406+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:13:58.577406+0000","last_peered":"2024-05-11T01:13:58.577406+0000","last_clean":"2024-05-11T01:13:58.577406+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:13:58.577406+0000","last_undegraded":"2024-05-11T01:13:58.577406+0000","last_fullsized":"2024-05-11T01:13:58.577406+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559766+0000","last_change":"2024-05-11T01:13:55.559766+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559766+0000","last_undegraded":"2024-05-11T01:13:55.559766+0000","last_fullsized":"2024-05-11T01:13:55.559766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556041+0000","last_change":"2024-05-11T01:13:55.556041+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556041+0000","last_undegraded":"2024-05-11T01:13:55.556041+0000","last_fullsized":"2024-05-11T01:13:55.556041+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.554542+0000","last_change":"2024-05-11T01:13:55.554542+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.554542+0000","last_undegraded":"2024-05-11T01:13:55.554542+0000","last_fullsized":"2024-05-11T01:13:55.554542+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559750+0000","last_change":"2024-05-11T01:13:55.559750+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559750+0000","last_undegraded":"2024-05-11T01:13:55.559750+0000","last_fullsized":"2024-05-11T01:13:55.559750+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564783+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:13:58.564783+0000","last_peered":"2024-05-11T01:13:58.564783+0000","last_clean":"2024-05-11T01:13:58.564783+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:13:58.564783+0000","last_undegraded":"2024-05-11T01:13:58.564783+0000","last_fullsized":"2024-05-11T01:13:58.564783+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553899+0000","last_change":"2024-05-11T01:13:55.553899+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553899+0000","last_undegraded":"2024-05-11T01:13:55.553899+0000","last_fullsized":"2024-05-11T01:13:55.553899+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577509+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:13:58.577509+0000","last_peered":"2024-05-11T01:13:58.577509+0000","last_clean":"2024-05-11T01:13:58.577509+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:13:58.577509+0000","last_undegraded":"2024-05-11T01:13:58.577509+0000","last_fullsized":"2024-05-11T01:13:58.577509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564669+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:13:58.564669+0000","last_peered":"2024-05-11T01:13:58.564669+0000","last_clean":"2024-05-11T01:13:58.564669+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:13:58.564669+0000","last_undegraded":"2024-05-11T01:13:58.564669+0000","last_fullsized":"2024-05-11T01:13:58.564669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564550+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:13:58.564550+0000","last_peered":"2024-05-11T01:13:58.564550+0000","last_clean":"2024-05-11T01:13:58.564550+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:13:58.564550+0000","last_undegraded":"2024-05-11T01:13:58.564550+0000","last_fullsized":"2024-05-11T01:13:58.564550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770658+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:13:58.770658+0000","last_peered":"2024-05-11T01:13:58.770658+0000","last_clean":"2024-05-11T01:13:58.770658+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:13:58.770658+0000","last_undegraded":"2024-05-11T01:13:58.770658+0000","last_fullsized":"2024-05-11T01:13:58.770658+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577530+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:13:58.577530+0000","last_peered":"2024-05-11T01:13:58.577530+0000","last_clean":"2024-05-11T01:13:58.577530+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:13:58.577530+0000","last_undegraded":"2024-05-11T01:13:58.577530+0000","last_fullsized":"2024-05-11T01:13:58.577530+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564439+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:13:58.564439+0000","last_peered":"2024-05-11T01:13:58.564439+0000","last_clean":"2024-05-11T01:13:58.564439+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:13:58.564439+0000","last_undegraded":"2024-05-11T01:13:58.564439+0000","last_fullsized":"2024-05-11T01:13:58.564439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577095+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:13:58.577095+0000","last_peered":"2024-05-11T01:13:58.577095+0000","last_clean":"2024-05-11T01:13:58.577095+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:13:58.577095+0000","last_undegraded":"2024-05-11T01:13:58.577095+0000","last_fullsized":"2024-05-11T01:13:58.577095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577171+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:13:58.577171+0000","last_peered":"2024-05-11T01:13:58.577171+0000","last_clean":"2024-05-11T01:13:58.577171+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:13:58.577171+0000","last_undegraded":"2024-05-11T01:13:58.577171+0000","last_fullsized":"2024-05-11T01:13:58.577171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564660+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:13:58.564660+0000","last_peered":"2024-05-11T01:13:58.564660+0000","last_clean":"2024-05-11T01:13:58.564660+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:13:58.564660+0000","last_undegraded":"2024-05-11T01:13:58.564660+0000","last_fullsized":"2024-05-11T01:13:58.564660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553944+0000","last_change":"2024-05-11T01:13:55.553944+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553944+0000","last_undegraded":"2024-05-11T01:13:55.553944+0000","last_fullsized":"2024-05-11T01:13:55.553944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770434+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:13:58.770434+0000","last_peered":"2024-05-11T01:13:58.770434+0000","last_clean":"2024-05-11T01:13:58.770434+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:13:58.770434+0000","last_undegraded":"2024-05-11T01:13:58.770434+0000","last_fullsized":"2024-05-11T01:13:58.770434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770133+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:13:58.770133+0000","last_peered":"2024-05-11T01:13:58.770133+0000","last_clean":"2024-05-11T01:13:58.770133+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:13:58.770133+0000","last_undegraded":"2024-05-11T01:13:58.770133+0000","last_fullsized":"2024-05-11T01:13:58.770133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.558676+0000","last_change":"2024-05-11T01:13:55.558676+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.558676+0000","last_undegraded":"2024-05-11T01:13:55.558676+0000","last_fullsized":"2024-05-11T01:13:55.558676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556087+0000","last_change":"2024-05-11T01:13:55.556087+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556087+0000","last_undegraded":"2024-05-11T01:13:55.556087+0000","last_fullsized":"2024-05-11T01:13:55.556087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577418+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:13:58.577418+0000","last_peered":"2024-05-11T01:13:58.577418+0000","last_clean":"2024-05-11T01:13:58.577418+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:13:58.577418+0000","last_undegraded":"2024-05-11T01:13:58.577418+0000","last_fullsized":"2024-05-11T01:13:58.577418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577260+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:13:58.577260+0000","last_peered":"2024-05-11T01:13:58.577260+0000","last_clean":"2024-05-11T01:13:58.577260+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:13:58.577260+0000","last_undegraded":"2024-05-11T01:13:58.577260+0000","last_fullsized":"2024-05-11T01:13:58.577260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577637+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:13:58.577637+0000","last_peered":"2024-05-11T01:13:58.577637+0000","last_clean":"2024-05-11T01:13:58.577637+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:13:58.577637+0000","last_undegraded":"2024-05-11T01:13:58.577637+0000","last_fullsized":"2024-05-11T01:13:58.577637+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770279+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:13:58.770279+0000","last_peered":"2024-05-11T01:13:58.770279+0000","last_clean":"2024-05-11T01:13:58.770279+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:13:58.770279+0000","last_undegraded":"2024-05-11T01:13:58.770279+0000","last_fullsized":"2024-05-11T01:13:58.770279+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556119+0000","last_change":"2024-05-11T01:13:55.556119+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556119+0000","last_undegraded":"2024-05-11T01:13:55.556119+0000","last_fullsized":"2024-05-11T01:13:55.556119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770387+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:13:58.770387+0000","last_peered":"2024-05-11T01:13:58.770387+0000","last_clean":"2024-05-11T01:13:58.770387+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:13:58.770387+0000","last_undegraded":"2024-05-11T01:13:58.770387+0000","last_fullsized":"2024-05-11T01:13:58.770387+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553361+0000","last_change":"2024-05-11T01:13:55.553361+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553361+0000","last_undegraded":"2024-05-11T01:13:55.553361+0000","last_fullsized":"2024-05-11T01:13:55.553361+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563506+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:13:58.563506+0000","last_peered":"2024-05-11T01:13:58.563506+0000","last_clean":"2024-05-11T01:13:58.563506+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:13:58.563506+0000","last_undegraded":"2024-05-11T01:13:58.563506+0000","last_fullsized":"2024-05-11T01:13:58.563506+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577560+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:13:58.577560+0000","last_peered":"2024-05-11T01:13:58.577560+0000","last_clean":"2024-05-11T01:13:58.577560+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:13:58.577560+0000","last_undegraded":"2024-05-11T01:13:58.577560+0000","last_fullsized":"2024-05-11T01:13:58.577560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564780+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:13:58.564780+0000","last_peered":"2024-05-11T01:13:58.564780+0000","last_clean":"2024-05-11T01:13:58.564780+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:13:58.564780+0000","last_undegraded":"2024-05-11T01:13:58.564780+0000","last_fullsized":"2024-05-11T01:13:58.564780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564800+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:13:58.564800+0000","last_peered":"2024-05-11T01:13:58.564800+0000","last_clean":"2024-05-11T01:13:58.564800+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:13:58.564800+0000","last_undegraded":"2024-05-11T01:13:58.564800+0000","last_fullsized":"2024-05-11T01:13:58.564800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770337+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:13:58.770337+0000","last_peered":"2024-05-11T01:13:58.770337+0000","last_clean":"2024-05-11T01:13:58.770337+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:13:58.770337+0000","last_undegraded":"2024-05-11T01:13:58.770337+0000","last_fullsized":"2024-05-11T01:13:58.770337+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577410+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:13:58.577410+0000","last_peered":"2024-05-11T01:13:58.577410+0000","last_clean":"2024-05-11T01:13:58.577410+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:13:58.577410+0000","last_undegraded":"2024-05-11T01:13:58.577410+0000","last_fullsized":"2024-05-11T01:13:58.577410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564554+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:13:58.564554+0000","last_peered":"2024-05-11T01:13:58.564554+0000","last_clean":"2024-05-11T01:13:58.564554+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:13:58.564554+0000","last_undegraded":"2024-05-11T01:13:58.564554+0000","last_fullsized":"2024-05-11T01:13:58.564554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577348+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:13:58.577348+0000","last_peered":"2024-05-11T01:13:58.577348+0000","last_clean":"2024-05-11T01:13:58.577348+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:13:58.577348+0000","last_undegraded":"2024-05-11T01:13:58.577348+0000","last_fullsized":"2024-05-11T01:13:58.577348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559063+0000","last_change":"2024-05-11T01:13:55.559063+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559063+0000","last_undegraded":"2024-05-11T01:13:55.559063+0000","last_fullsized":"2024-05-11T01:13:55.559063+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770171+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:13:58.770171+0000","last_peered":"2024-05-11T01:13:58.770171+0000","last_clean":"2024-05-11T01:13:58.770171+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:13:58.770171+0000","last_undegraded":"2024-05-11T01:13:58.770171+0000","last_fullsized":"2024-05-11T01:13:58.770171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553374+0000","last_change":"2024-05-11T01:13:55.553374+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553374+0000","last_undegraded":"2024-05-11T01:13:55.553374+0000","last_fullsized":"2024-05-11T01:13:55.553374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556048+0000","last_change":"2024-05-11T01:13:55.556048+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556048+0000","last_undegraded":"2024-05-11T01:13:55.556048+0000","last_fullsized":"2024-05-11T01:13:55.556048+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":244,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564343+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:13:58.564343+0000","last_peered":"2024-05-11T01:13:58.564343+0000","last_clean":"2024-05-11T01:13:58.564343+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:13:58.564343+0000","last_undegraded":"2024-05-11T01:13:58.564343+0000","last_fullsized":"2024-05-11T01:13:58.564343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":919624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54036,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317804,"statfs":{"total":96636764160,"available":96581431296,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40204,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331636,"statfs":{"total":96636764160,"available":96595595264,"internally_reserved":0,"allocated":712704,"data_stored":329804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44360,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327480,"statfs":{"total":96636764160,"available":96591339520,"internally_reserved":0,"allocated":716800,"data_stored":330800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58240,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313600,"statfs":{"total":96636764160,"available":96577126400,"internally_reserved":0,"allocated":704512,"data_stored":329236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1245184,"data_stored":892919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:14:01.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:14:01.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.753+0000 7ffa6f2c8640 1 Processor -- start 2024-05-11T01:14:01.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.753+0000 7ffa6f2c8640 1 -- start start 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6f2c8640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7ffa680b2f40 0x7ffa68142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6f2c8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa6813f850 0x7ffa6813fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6f2c8640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa68160470 con 0x7ffa680b3320 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6f2c8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffa68160750 con 0x7ffa6813f850 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6f2c8640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7ffa68160a30 con 0x7ffa680b2f40 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6d865640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa6813f850 0x7ffa6813fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6d865640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa6813f850 0x7ffa6813fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38392/0 (socket says 172.21.15.16:38392) 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6d865640 1 -- 172.21.15.16:0/2741171732 learned_addr learned my addr 172.21.15.16:0/2741171732 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:01.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6d064640 1 --2- 172.21.15.16:0/2741171732 >> v2:172.21.15.174:3300/0 conn(0x7ffa680b2f40 0x7ffa68142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.754+0000 7ffa6d865640 1 -- 172.21.15.16:0/2741171732 >> v2:172.21.15.174:3300/0 conn(0x7ffa680b2f40 msgr2=0x7ffa68142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:01.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.755+0000 7ffa6d865640 1 --2- 172.21.15.16:0/2741171732 >> v2:172.21.15.174:3300/0 conn(0x7ffa680b2f40 0x7ffa68142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.755+0000 7ffa6d865640 1 -- 172.21.15.16:0/2741171732 >> v1:172.21.15.174:6789/0 conn(0x7ffa680b3320 legacy=0x7ffa6815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:01.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.755+0000 7ffa6d865640 1 -- 172.21.15.16:0/2741171732 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa680738b0 con 0x7ffa6813f850 2024-05-11T01:14:01.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.755+0000 7ffa6d865640 1 --2- 172.21.15.16:0/2741171732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6813fc90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffa6806f4a0 tx=0x7ffa6002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924e8ef87de2ec3 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.755+0000 7ffa67fff640 1 -- 172.21.15.16:0/2741171732 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60032790 con 0x7ffa6813f850 2024-05-11T01:14:01.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa67fff640 1 -- 172.21.15.16:0/2741171732 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa60038070 con 0x7ffa6813f850 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa67fff640 1 -- 172.21.15.16:0/2741171732 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60032b50 con 0x7ffa6813f850 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2741171732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 msgr2=0x7ffa6813fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2741171732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6813fc90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ffa6806f4a0 tx=0x7ffa6002c890 comp rx=0 tx=0).stop 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2741171732 shutdown_connections 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2741171732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6813fc90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2741171732 >> v2:172.21.15.174:3300/0 conn(0x7ffa680b2f40 0x7ffa68142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2741171732 >> 172.21.15.16:0/2741171732 conn(0x7ffa6806fd90 msgr2=0x7ffa6806c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2741171732 shutdown_connections 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.756+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2741171732 wait complete. 2024-05-11T01:14:01.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.757+0000 7ffa6f2c8640 1 Processor -- start 2024-05-11T01:14:01.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.757+0000 7ffa6f2c8640 1 -- start start 2024-05-11T01:14:01.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6f2c8640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa680b2f40 0x7ffa6812d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6f2c8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa680b3320 0x7ffa680b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6f2c8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6f2c8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68074160 con 0x7ffa6813f850 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6f2c8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa68073fe0 con 0x7ffa680b3320 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6f2c8640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ffa680742e0 con 0x7ffa680b2f40 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6d865640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6d865640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6815bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38408/0 (socket says 172.21.15.16:38408) 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6d865640 1 -- 172.21.15.16:0/2515353535 learned_addr learned my addr 172.21.15.16:0/2515353535 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6c863640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa680b3320 0x7ffa680b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.758+0000 7ffa6d064640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa680b2f40 0x7ffa6812d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6d865640 1 -- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa680b2f40 msgr2=0x7ffa6812d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6d865640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa680b2f40 0x7ffa6812d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6d865640 1 -- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa680b3320 msgr2=0x7ffa680b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6d865640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa680b3320 0x7ffa680b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6d865640 1 -- 172.21.15.16:0/2515353535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa681f4090 con 0x7ffa6813f850 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6c863640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa680b3320 0x7ffa680b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6d865640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6815bf90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000b2c0 tx=0x7ffa600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa65ffb640 1 -- 172.21.15.16:0/2515353535 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60033620 con 0x7ffa6813f850 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa65ffb640 1 -- 172.21.15.16:0/2515353535 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa600337c0 con 0x7ffa6813f850 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa681f4370 con 0x7ffa6813f850 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa65ffb640 1 -- 172.21.15.16:0/2515353535 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60033bb0 con 0x7ffa6813f850 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.759+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa681f4930 con 0x7ffa6813f850 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.760+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa681f4d10 con 0x7ffa6813f850 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.761+0000 7ffa65ffb640 1 -- 172.21.15.16:0/2515353535 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7ffa6004d060 con 0x7ffa6813f850 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.761+0000 7ffa65ffb640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ffa540762d0 0x7ffa54078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:01.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.762+0000 7ffa65ffb640 1 -- 172.21.15.16:0/2515353535 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7ffa600ba440 con 0x7ffa6813f850 2024-05-11T01:14:01.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.762+0000 7ffa6d064640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ffa540762d0 0x7ffa54078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:01.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.762+0000 7ffa6d064640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ffa540762d0 0x7ffa54078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa681414b0 tx=0x7ffa580079a0 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:01.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.766+0000 7ffa65ffb640 1 -- 172.21.15.16:0/2515353535 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffa681f4d10 con 0x7ffa6813f850 2024-05-11T01:14:01.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.954+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa68073480 con 0x7ffa540762d0 2024-05-11T01:14:01.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.960+0000 7ffa65ffb640 1 -- 172.21.15.16:0/2515353535 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245035 (secure 0 0 0) 0x7ffa68073480 con 0x7ffa540762d0 2024-05-11T01:14:01.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:01.964 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ffa540762d0 msgr2=0x7ffa54078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ffa540762d0 0x7ffa54078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa681414b0 tx=0x7ffa580079a0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 msgr2=0x7ffa6815bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6815bf90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000b2c0 tx=0x7ffa600046c0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 shutdown_connections 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa6813f850 0x7ffa6815bf90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ffa540762d0 0x7ffa54078790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa680b3320 0x7ffa680b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 --2- 172.21.15.16:0/2515353535 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ffa680b2f40 0x7ffa6812d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:01.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.963+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 >> 172.21.15.16:0/2515353535 conn(0x7ffa6806fd90 msgr2=0x7ffa6815a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:01.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.964+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 shutdown_connections 2024-05-11T01:14:01.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:01.964+0000 7ffa6f2c8640 1 -- 172.21.15.16:0/2515353535 wait complete. 2024-05-11T01:14:01.975 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-11T01:14:01.158571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":151,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":329504,"kb_used_data":6512,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754645216,"statfs":{"total":773094113280,"available":772756701184,"internally_reserved":0,"allocated":6668288,"data_stored":3728579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.606399"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564611+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:13:58.564611+0000","last_peered":"2024-05-11T01:13:58.564611+0000","last_clean":"2024-05-11T01:13:58.564611+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:13:58.564611+0000","last_undegraded":"2024-05-11T01:13:58.564611+0000","last_fullsized":"2024-05-11T01:13:58.564611+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577251+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:13:58.577251+0000","last_peered":"2024-05-11T01:13:58.577251+0000","last_clean":"2024-05-11T01:13:58.577251+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:13:58.577251+0000","last_undegraded":"2024-05-11T01:13:58.577251+0000","last_fullsized":"2024-05-11T01:13:58.577251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564736+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:13:58.564736+0000","last_peered":"2024-05-11T01:13:58.564736+0000","last_clean":"2024-05-11T01:13:58.564736+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:13:58.564736+0000","last_undegraded":"2024-05-11T01:13:58.564736+0000","last_fullsized":"2024-05-11T01:13:58.564736+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770697+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:13:58.770697+0000","last_peered":"2024-05-11T01:13:58.770697+0000","last_clean":"2024-05-11T01:13:58.770697+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:13:58.770697+0000","last_undegraded":"2024-05-11T01:13:58.770697+0000","last_fullsized":"2024-05-11T01:13:58.770697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577112+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:13:58.577112+0000","last_peered":"2024-05-11T01:13:58.577112+0000","last_clean":"2024-05-11T01:13:58.577112+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:13:58.577112+0000","last_undegraded":"2024-05-11T01:13:58.577112+0000","last_fullsized":"2024-05-11T01:13:58.577112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770687+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:13:58.770687+0000","last_peered":"2024-05-11T01:13:58.770687+0000","last_clean":"2024-05-11T01:13:58.770687+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:13:58.770687+0000","last_undegraded":"2024-05-11T01:13:58.770687+0000","last_fullsized":"2024-05-11T01:13:58.770687+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577524+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:13:58.577524+0000","last_peered":"2024-05-11T01:13:58.577524+0000","last_clean":"2024-05-11T01:13:58.577524+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:13:58.577524+0000","last_undegraded":"2024-05-11T01:13:58.577524+0000","last_fullsized":"2024-05-11T01:13:58.577524+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770272+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:13:58.770272+0000","last_peered":"2024-05-11T01:13:58.770272+0000","last_clean":"2024-05-11T01:13:58.770272+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:13:58.770272+0000","last_undegraded":"2024-05-11T01:13:58.770272+0000","last_fullsized":"2024-05-11T01:13:58.770272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577125+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:13:58.577125+0000","last_peered":"2024-05-11T01:13:58.577125+0000","last_clean":"2024-05-11T01:13:58.577125+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:13:58.577125+0000","last_undegraded":"2024-05-11T01:13:58.577125+0000","last_fullsized":"2024-05-11T01:13:58.577125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770214+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:13:58.770214+0000","last_peered":"2024-05-11T01:13:58.770214+0000","last_clean":"2024-05-11T01:13:58.770214+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:13:58.770214+0000","last_undegraded":"2024-05-11T01:13:58.770214+0000","last_fullsized":"2024-05-11T01:13:58.770214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770663+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:13:58.770663+0000","last_peered":"2024-05-11T01:13:58.770663+0000","last_clean":"2024-05-11T01:13:58.770663+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:13:58.770663+0000","last_undegraded":"2024-05-11T01:13:58.770663+0000","last_fullsized":"2024-05-11T01:13:58.770663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577582+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:13:58.577582+0000","last_peered":"2024-05-11T01:13:58.577582+0000","last_clean":"2024-05-11T01:13:58.577582+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:13:58.577582+0000","last_undegraded":"2024-05-11T01:13:58.577582+0000","last_fullsized":"2024-05-11T01:13:58.577582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559224+0000","last_change":"2024-05-11T01:13:55.559224+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559224+0000","last_undegraded":"2024-05-11T01:13:55.559224+0000","last_fullsized":"2024-05-11T01:13:55.559224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770480+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:13:58.770480+0000","last_peered":"2024-05-11T01:13:58.770480+0000","last_clean":"2024-05-11T01:13:58.770480+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:13:58.770480+0000","last_undegraded":"2024-05-11T01:13:58.770480+0000","last_fullsized":"2024-05-11T01:13:58.770480+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770562+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:13:58.770562+0000","last_peered":"2024-05-11T01:13:58.770562+0000","last_clean":"2024-05-11T01:13:58.770562+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:13:58.770562+0000","last_undegraded":"2024-05-11T01:13:58.770562+0000","last_fullsized":"2024-05-11T01:13:58.770562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564250+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:13:58.564250+0000","last_peered":"2024-05-11T01:13:58.564250+0000","last_clean":"2024-05-11T01:13:58.564250+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:13:58.564250+0000","last_undegraded":"2024-05-11T01:13:58.564250+0000","last_fullsized":"2024-05-11T01:13:58.564250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577406+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:13:58.577406+0000","last_peered":"2024-05-11T01:13:58.577406+0000","last_clean":"2024-05-11T01:13:58.577406+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:13:58.577406+0000","last_undegraded":"2024-05-11T01:13:58.577406+0000","last_fullsized":"2024-05-11T01:13:58.577406+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559766+0000","last_change":"2024-05-11T01:13:55.559766+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559766+0000","last_undegraded":"2024-05-11T01:13:55.559766+0000","last_fullsized":"2024-05-11T01:13:55.559766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556041+0000","last_change":"2024-05-11T01:13:55.556041+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556041+0000","last_undegraded":"2024-05-11T01:13:55.556041+0000","last_fullsized":"2024-05-11T01:13:55.556041+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.554542+0000","last_change":"2024-05-11T01:13:55.554542+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.554542+0000","last_undegraded":"2024-05-11T01:13:55.554542+0000","last_fullsized":"2024-05-11T01:13:55.554542+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559750+0000","last_change":"2024-05-11T01:13:55.559750+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559750+0000","last_undegraded":"2024-05-11T01:13:55.559750+0000","last_fullsized":"2024-05-11T01:13:55.559750+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564783+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:13:58.564783+0000","last_peered":"2024-05-11T01:13:58.564783+0000","last_clean":"2024-05-11T01:13:58.564783+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:13:58.564783+0000","last_undegraded":"2024-05-11T01:13:58.564783+0000","last_fullsized":"2024-05-11T01:13:58.564783+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553899+0000","last_change":"2024-05-11T01:13:55.553899+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553899+0000","last_undegraded":"2024-05-11T01:13:55.553899+0000","last_fullsized":"2024-05-11T01:13:55.553899+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577509+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:13:58.577509+0000","last_peered":"2024-05-11T01:13:58.577509+0000","last_clean":"2024-05-11T01:13:58.577509+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:13:58.577509+0000","last_undegraded":"2024-05-11T01:13:58.577509+0000","last_fullsized":"2024-05-11T01:13:58.577509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564669+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:13:58.564669+0000","last_peered":"2024-05-11T01:13:58.564669+0000","last_clean":"2024-05-11T01:13:58.564669+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:13:58.564669+0000","last_undegraded":"2024-05-11T01:13:58.564669+0000","last_fullsized":"2024-05-11T01:13:58.564669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564550+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:13:58.564550+0000","last_peered":"2024-05-11T01:13:58.564550+0000","last_clean":"2024-05-11T01:13:58.564550+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:13:58.564550+0000","last_undegraded":"2024-05-11T01:13:58.564550+0000","last_fullsized":"2024-05-11T01:13:58.564550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770658+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:13:58.770658+0000","last_peered":"2024-05-11T01:13:58.770658+0000","last_clean":"2024-05-11T01:13:58.770658+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:13:58.770658+0000","last_undegraded":"2024-05-11T01:13:58.770658+0000","last_fullsized":"2024-05-11T01:13:58.770658+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577530+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:13:58.577530+0000","last_peered":"2024-05-11T01:13:58.577530+0000","last_clean":"2024-05-11T01:13:58.577530+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:13:58.577530+0000","last_undegraded":"2024-05-11T01:13:58.577530+0000","last_fullsized":"2024-05-11T01:13:58.577530+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564439+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:13:58.564439+0000","last_peered":"2024-05-11T01:13:58.564439+0000","last_clean":"2024-05-11T01:13:58.564439+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:13:58.564439+0000","last_undegraded":"2024-05-11T01:13:58.564439+0000","last_fullsized":"2024-05-11T01:13:58.564439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577095+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:13:58.577095+0000","last_peered":"2024-05-11T01:13:58.577095+0000","last_clean":"2024-05-11T01:13:58.577095+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:13:58.577095+0000","last_undegraded":"2024-05-11T01:13:58.577095+0000","last_fullsized":"2024-05-11T01:13:58.577095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577171+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:13:58.577171+0000","last_peered":"2024-05-11T01:13:58.577171+0000","last_clean":"2024-05-11T01:13:58.577171+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:13:58.577171+0000","last_undegraded":"2024-05-11T01:13:58.577171+0000","last_fullsized":"2024-05-11T01:13:58.577171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564660+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:13:58.564660+0000","last_peered":"2024-05-11T01:13:58.564660+0000","last_clean":"2024-05-11T01:13:58.564660+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:13:58.564660+0000","last_undegraded":"2024-05-11T01:13:58.564660+0000","last_fullsized":"2024-05-11T01:13:58.564660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553944+0000","last_change":"2024-05-11T01:13:55.553944+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553944+0000","last_undegraded":"2024-05-11T01:13:55.553944+0000","last_fullsized":"2024-05-11T01:13:55.553944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770434+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:13:58.770434+0000","last_peered":"2024-05-11T01:13:58.770434+0000","last_clean":"2024-05-11T01:13:58.770434+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:13:58.770434+0000","last_undegraded":"2024-05-11T01:13:58.770434+0000","last_fullsized":"2024-05-11T01:13:58.770434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770133+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:13:58.770133+0000","last_peered":"2024-05-11T01:13:58.770133+0000","last_clean":"2024-05-11T01:13:58.770133+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:13:58.770133+0000","last_undegraded":"2024-05-11T01:13:58.770133+0000","last_fullsized":"2024-05-11T01:13:58.770133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.558676+0000","last_change":"2024-05-11T01:13:55.558676+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.558676+0000","last_undegraded":"2024-05-11T01:13:55.558676+0000","last_fullsized":"2024-05-11T01:13:55.558676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556087+0000","last_change":"2024-05-11T01:13:55.556087+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556087+0000","last_undegraded":"2024-05-11T01:13:55.556087+0000","last_fullsized":"2024-05-11T01:13:55.556087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577418+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:13:58.577418+0000","last_peered":"2024-05-11T01:13:58.577418+0000","last_clean":"2024-05-11T01:13:58.577418+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:13:58.577418+0000","last_undegraded":"2024-05-11T01:13:58.577418+0000","last_fullsized":"2024-05-11T01:13:58.577418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577260+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:13:58.577260+0000","last_peered":"2024-05-11T01:13:58.577260+0000","last_clean":"2024-05-11T01:13:58.577260+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:13:58.577260+0000","last_undegraded":"2024-05-11T01:13:58.577260+0000","last_fullsized":"2024-05-11T01:13:58.577260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577637+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:13:58.577637+0000","last_peered":"2024-05-11T01:13:58.577637+0000","last_clean":"2024-05-11T01:13:58.577637+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:13:58.577637+0000","last_undegraded":"2024-05-11T01:13:58.577637+0000","last_fullsized":"2024-05-11T01:13:58.577637+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770279+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:13:58.770279+0000","last_peered":"2024-05-11T01:13:58.770279+0000","last_clean":"2024-05-11T01:13:58.770279+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:13:58.770279+0000","last_undegraded":"2024-05-11T01:13:58.770279+0000","last_fullsized":"2024-05-11T01:13:58.770279+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556119+0000","last_change":"2024-05-11T01:13:55.556119+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556119+0000","last_undegraded":"2024-05-11T01:13:55.556119+0000","last_fullsized":"2024-05-11T01:13:55.556119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770387+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:13:58.770387+0000","last_peered":"2024-05-11T01:13:58.770387+0000","last_clean":"2024-05-11T01:13:58.770387+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:13:58.770387+0000","last_undegraded":"2024-05-11T01:13:58.770387+0000","last_fullsized":"2024-05-11T01:13:58.770387+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553361+0000","last_change":"2024-05-11T01:13:55.553361+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553361+0000","last_undegraded":"2024-05-11T01:13:55.553361+0000","last_fullsized":"2024-05-11T01:13:55.553361+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563506+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:13:58.563506+0000","last_peered":"2024-05-11T01:13:58.563506+0000","last_clean":"2024-05-11T01:13:58.563506+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:13:58.563506+0000","last_undegraded":"2024-05-11T01:13:58.563506+0000","last_fullsized":"2024-05-11T01:13:58.563506+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577560+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:13:58.577560+0000","last_peered":"2024-05-11T01:13:58.577560+0000","last_clean":"2024-05-11T01:13:58.577560+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:13:58.577560+0000","last_undegraded":"2024-05-11T01:13:58.577560+0000","last_fullsized":"2024-05-11T01:13:58.577560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564780+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:13:58.564780+0000","last_peered":"2024-05-11T01:13:58.564780+0000","last_clean":"2024-05-11T01:13:58.564780+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:13:58.564780+0000","last_undegraded":"2024-05-11T01:13:58.564780+0000","last_fullsized":"2024-05-11T01:13:58.564780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564800+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:13:58.564800+0000","last_peered":"2024-05-11T01:13:58.564800+0000","last_clean":"2024-05-11T01:13:58.564800+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:13:58.564800+0000","last_undegraded":"2024-05-11T01:13:58.564800+0000","last_fullsized":"2024-05-11T01:13:58.564800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770337+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:13:58.770337+0000","last_peered":"2024-05-11T01:13:58.770337+0000","last_clean":"2024-05-11T01:13:58.770337+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:13:58.770337+0000","last_undegraded":"2024-05-11T01:13:58.770337+0000","last_fullsized":"2024-05-11T01:13:58.770337+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577410+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:13:58.577410+0000","last_peered":"2024-05-11T01:13:58.577410+0000","last_clean":"2024-05-11T01:13:58.577410+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:13:58.577410+0000","last_undegraded":"2024-05-11T01:13:58.577410+0000","last_fullsized":"2024-05-11T01:13:58.577410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564554+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:13:58.564554+0000","last_peered":"2024-05-11T01:13:58.564554+0000","last_clean":"2024-05-11T01:13:58.564554+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:13:58.564554+0000","last_undegraded":"2024-05-11T01:13:58.564554+0000","last_fullsized":"2024-05-11T01:13:58.564554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577348+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:13:58.577348+0000","last_peered":"2024-05-11T01:13:58.577348+0000","last_clean":"2024-05-11T01:13:58.577348+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:13:58.577348+0000","last_undegraded":"2024-05-11T01:13:58.577348+0000","last_fullsized":"2024-05-11T01:13:58.577348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559063+0000","last_change":"2024-05-11T01:13:55.559063+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559063+0000","last_undegraded":"2024-05-11T01:13:55.559063+0000","last_fullsized":"2024-05-11T01:13:55.559063+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770171+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:13:58.770171+0000","last_peered":"2024-05-11T01:13:58.770171+0000","last_clean":"2024-05-11T01:13:58.770171+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:13:58.770171+0000","last_undegraded":"2024-05-11T01:13:58.770171+0000","last_fullsized":"2024-05-11T01:13:58.770171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553374+0000","last_change":"2024-05-11T01:13:55.553374+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553374+0000","last_undegraded":"2024-05-11T01:13:55.553374+0000","last_fullsized":"2024-05-11T01:13:55.553374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556048+0000","last_change":"2024-05-11T01:13:55.556048+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556048+0000","last_undegraded":"2024-05-11T01:13:55.556048+0000","last_fullsized":"2024-05-11T01:13:55.556048+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":244,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564343+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:13:58.564343+0000","last_peered":"2024-05-11T01:13:58.564343+0000","last_clean":"2024-05-11T01:13:58.564343+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:13:58.564343+0000","last_undegraded":"2024-05-11T01:13:58.564343+0000","last_fullsized":"2024-05-11T01:13:58.564343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":919624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54036,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317804,"statfs":{"total":96636764160,"available":96581431296,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40204,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331636,"statfs":{"total":96636764160,"available":96595595264,"internally_reserved":0,"allocated":712704,"data_stored":329804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44360,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327480,"statfs":{"total":96636764160,"available":96591339520,"internally_reserved":0,"allocated":716800,"data_stored":330800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58240,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313600,"statfs":{"total":96636764160,"available":96577126400,"internally_reserved":0,"allocated":704512,"data_stored":329236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1245184,"data_stored":892919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:14:01.979 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:14:02.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.118+0000 7fa787e9c640 1 Processor -- start 2024-05-11T01:14:02.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.118+0000 7fa787e9c640 1 -- start start 2024-05-11T01:14:02.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa787e9c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa78015d1f0 0x7fa7800b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa787e9c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b1490 0x7fa7800b5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa787e9c640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78015fc20 con 0x7fa7800b58c0 2024-05-11T01:14:02.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa787e9c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fa780160510 con 0x7fa78015d1f0 2024-05-11T01:14:02.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa787e9c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa7800b19d0 con 0x7fa7800b1490 2024-05-11T01:14:02.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa785437640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b1490 0x7fa7800b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa785c38640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa78015d1f0 0x7fa7800b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa785437640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b1490 0x7fa7800b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:49098/0 (socket says 172.21.15.16:49098) 2024-05-11T01:14:02.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.119+0000 7fa785437640 1 -- 172.21.15.16:0/2490811718 learned_addr learned my addr 172.21.15.16:0/2490811718 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:02.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.120+0000 7fa785c38640 1 -- 172.21.15.16:0/2490811718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b1490 msgr2=0x7fa7800b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:02.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.120+0000 7fa785c38640 1 --2- 172.21.15.16:0/2490811718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b1490 0x7fa7800b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.120+0000 7fa785c38640 1 -- 172.21.15.16:0/2490811718 >> v1:172.21.15.174:6789/0 conn(0x7fa7800b58c0 legacy=0x7fa780073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.120+0000 7fa784c36640 1 -- 172.21.15.16:0/2490811718 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31367786 0 0) 0x7fa78015fc20 con 0x7fa7800b58c0 2024-05-11T01:14:02.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.120+0000 7fa785c38640 1 -- 172.21.15.16:0/2490811718 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78015fec0 con 0x7fa78015d1f0 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa785c38640 1 --2- 172.21.15.16:0/2490811718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa78015d1f0 0x7fa7800b0f50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0097a0 tx=0x7fa77c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a062479ea7118105 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa784c36640 1 -- 172.21.15.16:0/2490811718 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c037070 con 0x7fa78015d1f0 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa784c36640 1 -- 172.21.15.16:0/2490811718 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c032440 con 0x7fa78015d1f0 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa784c36640 1 -- 172.21.15.16:0/2490811718 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c032810 con 0x7fa78015d1f0 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa787e9c640 1 -- 172.21.15.16:0/2490811718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa78015d1f0 msgr2=0x7fa7800b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2490811718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa78015d1f0 0x7fa7800b0f50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0097a0 tx=0x7fa77c02a180 comp rx=0 tx=0).stop 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa787e9c640 1 -- 172.21.15.16:0/2490811718 shutdown_connections 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2490811718 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b1490 0x7fa7800b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2490811718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa78015d1f0 0x7fa7800b0f50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa787e9c640 1 -- 172.21.15.16:0/2490811718 >> 172.21.15.16:0/2490811718 conn(0x7fa7800d2060 msgr2=0x7fa7800d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:02.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa787e9c640 1 -- 172.21.15.16:0/2490811718 shutdown_connections 2024-05-11T01:14:02.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.121+0000 7fa787e9c640 1 -- 172.21.15.16:0/2490811718 wait complete. 2024-05-11T01:14:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.123+0000 7fa787e9c640 1 Processor -- start 2024-05-11T01:14:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.123+0000 7fa787e9c640 1 -- start start 2024-05-11T01:14:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.123+0000 7fa787e9c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7800b1490 0x7fa780158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.123+0000 7fa787e9c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b58c0 0x7fa78015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.123+0000 7fa787e9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa78015d1f0 0x7fa7800cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.123+0000 7fa787e9c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800718a0 con 0x7fa78015d1f0 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.123+0000 7fa787e9c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801609a0 con 0x7fa7800b1490 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.123+0000 7fa787e9c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fa78006d230 con 0x7fa7800b58c0 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa78015d1f0 0x7fa7800cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa78015d1f0 0x7fa7800cf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38420/0 (socket says 172.21.15.16:38420) 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 -- 172.21.15.16:0/2518831488 learned_addr learned my addr 172.21.15.16:0/2518831488 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa785c38640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7800b1490 0x7fa780158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa785437640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b58c0 0x7fa78015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 -- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b58c0 msgr2=0x7fa78015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b58c0 0x7fa78015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 -- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7800b1490 msgr2=0x7fa780158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7800b1490 0x7fa780158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 -- 172.21.15.16:0/2518831488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780159230 con 0x7fa78015d1f0 2024-05-11T01:14:02.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa786439640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa78015d1f0 0x7fa7800cf380 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa77800c770 tx=0x7fa77800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa7767fc640 1 -- 172.21.15.16:0/2518831488 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778003da0 con 0x7fa78015d1f0 2024-05-11T01:14:02.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa7767fc640 1 -- 172.21.15.16:0/2518831488 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa778005070 con 0x7fa78015d1f0 2024-05-11T01:14:02.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78015af60 con 0x7fa78015d1f0 2024-05-11T01:14:02.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa7767fc640 1 -- 172.21.15.16:0/2518831488 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7780054a0 con 0x7fa78015d1f0 2024-05-11T01:14:02.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.124+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78015b200 con 0x7fa78015d1f0 2024-05-11T01:14:02.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.125+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78015b9b0 con 0x7fa78015d1f0 2024-05-11T01:14:02.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.126+0000 7fa7767fc640 1 -- 172.21.15.16:0/2518831488 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fa778005640 con 0x7fa78015d1f0 2024-05-11T01:14:02.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.127+0000 7fa7767fc640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fa7640762d0 0x7fa764078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.127+0000 7fa7767fc640 1 -- 172.21.15.16:0/2518831488 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7fa7780974f0 con 0x7fa78015d1f0 2024-05-11T01:14:02.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.127+0000 7fa785c38640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fa7640762d0 0x7fa764078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.127+0000 7fa785c38640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fa7640762d0 0x7fa764078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa77c034000 tx=0x7fa77c02e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.131+0000 7fa7767fc640 1 -- 172.21.15.16:0/2518831488 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa780159230 con 0x7fa78015d1f0 2024-05-11T01:14:02.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.318+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa78015b5a0 con 0x7fa7640762d0 2024-05-11T01:14:02.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.324+0000 7fa7767fc640 1 -- 172.21.15.16:0/2518831488 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245035 (secure 0 0 0) 0x7fa78015b5a0 con 0x7fa7640762d0 2024-05-11T01:14:02.327 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:02.328 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fa7640762d0 msgr2=0x7fa764078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fa7640762d0 0x7fa764078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa77c034000 tx=0x7fa77c02e000 comp rx=0 tx=0).stop 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa78015d1f0 msgr2=0x7fa7800cf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa78015d1f0 0x7fa7800cf380 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa77800c770 tx=0x7fa77800cc30 comp rx=0 tx=0).stop 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 shutdown_connections 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa78015d1f0 0x7fa7800cf380 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fa7800b58c0 0x7fa78015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fa7640762d0 0x7fa764078790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 --2- 172.21.15.16:0/2518831488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7800b1490 0x7fa780158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 >> 172.21.15.16:0/2518831488 conn(0x7fa7800d2060 msgr2=0x7fa78006c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:02.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 shutdown_connections 2024-05-11T01:14:02.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.327+0000 7fa787e9c640 1 -- 172.21.15.16:0/2518831488 wait complete. 2024-05-11T01:14:02.338 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-11T01:14:01.158571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":151,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":329504,"kb_used_data":6512,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754645216,"statfs":{"total":773094113280,"available":772756701184,"internally_reserved":0,"allocated":6668288,"data_stored":3728579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.606399"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564611+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:13:58.564611+0000","last_peered":"2024-05-11T01:13:58.564611+0000","last_clean":"2024-05-11T01:13:58.564611+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:13:58.564611+0000","last_undegraded":"2024-05-11T01:13:58.564611+0000","last_fullsized":"2024-05-11T01:13:58.564611+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577251+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:13:58.577251+0000","last_peered":"2024-05-11T01:13:58.577251+0000","last_clean":"2024-05-11T01:13:58.577251+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:13:58.577251+0000","last_undegraded":"2024-05-11T01:13:58.577251+0000","last_fullsized":"2024-05-11T01:13:58.577251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564736+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:13:58.564736+0000","last_peered":"2024-05-11T01:13:58.564736+0000","last_clean":"2024-05-11T01:13:58.564736+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:13:58.564736+0000","last_undegraded":"2024-05-11T01:13:58.564736+0000","last_fullsized":"2024-05-11T01:13:58.564736+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770697+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:13:58.770697+0000","last_peered":"2024-05-11T01:13:58.770697+0000","last_clean":"2024-05-11T01:13:58.770697+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:13:58.770697+0000","last_undegraded":"2024-05-11T01:13:58.770697+0000","last_fullsized":"2024-05-11T01:13:58.770697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577112+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:13:58.577112+0000","last_peered":"2024-05-11T01:13:58.577112+0000","last_clean":"2024-05-11T01:13:58.577112+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:13:58.577112+0000","last_undegraded":"2024-05-11T01:13:58.577112+0000","last_fullsized":"2024-05-11T01:13:58.577112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770687+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:13:58.770687+0000","last_peered":"2024-05-11T01:13:58.770687+0000","last_clean":"2024-05-11T01:13:58.770687+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:13:58.770687+0000","last_undegraded":"2024-05-11T01:13:58.770687+0000","last_fullsized":"2024-05-11T01:13:58.770687+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577524+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:13:58.577524+0000","last_peered":"2024-05-11T01:13:58.577524+0000","last_clean":"2024-05-11T01:13:58.577524+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:13:58.577524+0000","last_undegraded":"2024-05-11T01:13:58.577524+0000","last_fullsized":"2024-05-11T01:13:58.577524+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770272+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:13:58.770272+0000","last_peered":"2024-05-11T01:13:58.770272+0000","last_clean":"2024-05-11T01:13:58.770272+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:13:58.770272+0000","last_undegraded":"2024-05-11T01:13:58.770272+0000","last_fullsized":"2024-05-11T01:13:58.770272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577125+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:13:58.577125+0000","last_peered":"2024-05-11T01:13:58.577125+0000","last_clean":"2024-05-11T01:13:58.577125+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:13:58.577125+0000","last_undegraded":"2024-05-11T01:13:58.577125+0000","last_fullsized":"2024-05-11T01:13:58.577125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770214+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:13:58.770214+0000","last_peered":"2024-05-11T01:13:58.770214+0000","last_clean":"2024-05-11T01:13:58.770214+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:13:58.770214+0000","last_undegraded":"2024-05-11T01:13:58.770214+0000","last_fullsized":"2024-05-11T01:13:58.770214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770663+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:13:58.770663+0000","last_peered":"2024-05-11T01:13:58.770663+0000","last_clean":"2024-05-11T01:13:58.770663+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:13:58.770663+0000","last_undegraded":"2024-05-11T01:13:58.770663+0000","last_fullsized":"2024-05-11T01:13:58.770663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577582+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:13:58.577582+0000","last_peered":"2024-05-11T01:13:58.577582+0000","last_clean":"2024-05-11T01:13:58.577582+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:13:58.577582+0000","last_undegraded":"2024-05-11T01:13:58.577582+0000","last_fullsized":"2024-05-11T01:13:58.577582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559224+0000","last_change":"2024-05-11T01:13:55.559224+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559224+0000","last_undegraded":"2024-05-11T01:13:55.559224+0000","last_fullsized":"2024-05-11T01:13:55.559224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770480+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:13:58.770480+0000","last_peered":"2024-05-11T01:13:58.770480+0000","last_clean":"2024-05-11T01:13:58.770480+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:13:58.770480+0000","last_undegraded":"2024-05-11T01:13:58.770480+0000","last_fullsized":"2024-05-11T01:13:58.770480+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770562+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:13:58.770562+0000","last_peered":"2024-05-11T01:13:58.770562+0000","last_clean":"2024-05-11T01:13:58.770562+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:13:58.770562+0000","last_undegraded":"2024-05-11T01:13:58.770562+0000","last_fullsized":"2024-05-11T01:13:58.770562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564250+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:13:58.564250+0000","last_peered":"2024-05-11T01:13:58.564250+0000","last_clean":"2024-05-11T01:13:58.564250+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:13:58.564250+0000","last_undegraded":"2024-05-11T01:13:58.564250+0000","last_fullsized":"2024-05-11T01:13:58.564250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577406+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:13:58.577406+0000","last_peered":"2024-05-11T01:13:58.577406+0000","last_clean":"2024-05-11T01:13:58.577406+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:13:58.577406+0000","last_undegraded":"2024-05-11T01:13:58.577406+0000","last_fullsized":"2024-05-11T01:13:58.577406+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559766+0000","last_change":"2024-05-11T01:13:55.559766+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559766+0000","last_undegraded":"2024-05-11T01:13:55.559766+0000","last_fullsized":"2024-05-11T01:13:55.559766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556041+0000","last_change":"2024-05-11T01:13:55.556041+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556041+0000","last_undegraded":"2024-05-11T01:13:55.556041+0000","last_fullsized":"2024-05-11T01:13:55.556041+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.554542+0000","last_change":"2024-05-11T01:13:55.554542+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.554542+0000","last_undegraded":"2024-05-11T01:13:55.554542+0000","last_fullsized":"2024-05-11T01:13:55.554542+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559750+0000","last_change":"2024-05-11T01:13:55.559750+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559750+0000","last_undegraded":"2024-05-11T01:13:55.559750+0000","last_fullsized":"2024-05-11T01:13:55.559750+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564783+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:13:58.564783+0000","last_peered":"2024-05-11T01:13:58.564783+0000","last_clean":"2024-05-11T01:13:58.564783+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:13:58.564783+0000","last_undegraded":"2024-05-11T01:13:58.564783+0000","last_fullsized":"2024-05-11T01:13:58.564783+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553899+0000","last_change":"2024-05-11T01:13:55.553899+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553899+0000","last_undegraded":"2024-05-11T01:13:55.553899+0000","last_fullsized":"2024-05-11T01:13:55.553899+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577509+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:13:58.577509+0000","last_peered":"2024-05-11T01:13:58.577509+0000","last_clean":"2024-05-11T01:13:58.577509+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:13:58.577509+0000","last_undegraded":"2024-05-11T01:13:58.577509+0000","last_fullsized":"2024-05-11T01:13:58.577509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564669+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:13:58.564669+0000","last_peered":"2024-05-11T01:13:58.564669+0000","last_clean":"2024-05-11T01:13:58.564669+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:13:58.564669+0000","last_undegraded":"2024-05-11T01:13:58.564669+0000","last_fullsized":"2024-05-11T01:13:58.564669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564550+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:13:58.564550+0000","last_peered":"2024-05-11T01:13:58.564550+0000","last_clean":"2024-05-11T01:13:58.564550+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:13:58.564550+0000","last_undegraded":"2024-05-11T01:13:58.564550+0000","last_fullsized":"2024-05-11T01:13:58.564550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770658+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:13:58.770658+0000","last_peered":"2024-05-11T01:13:58.770658+0000","last_clean":"2024-05-11T01:13:58.770658+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:13:58.770658+0000","last_undegraded":"2024-05-11T01:13:58.770658+0000","last_fullsized":"2024-05-11T01:13:58.770658+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577530+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:13:58.577530+0000","last_peered":"2024-05-11T01:13:58.577530+0000","last_clean":"2024-05-11T01:13:58.577530+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:13:58.577530+0000","last_undegraded":"2024-05-11T01:13:58.577530+0000","last_fullsized":"2024-05-11T01:13:58.577530+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564439+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:13:58.564439+0000","last_peered":"2024-05-11T01:13:58.564439+0000","last_clean":"2024-05-11T01:13:58.564439+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:13:58.564439+0000","last_undegraded":"2024-05-11T01:13:58.564439+0000","last_fullsized":"2024-05-11T01:13:58.564439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577095+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:13:58.577095+0000","last_peered":"2024-05-11T01:13:58.577095+0000","last_clean":"2024-05-11T01:13:58.577095+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:13:58.577095+0000","last_undegraded":"2024-05-11T01:13:58.577095+0000","last_fullsized":"2024-05-11T01:13:58.577095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577171+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:13:58.577171+0000","last_peered":"2024-05-11T01:13:58.577171+0000","last_clean":"2024-05-11T01:13:58.577171+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:13:58.577171+0000","last_undegraded":"2024-05-11T01:13:58.577171+0000","last_fullsized":"2024-05-11T01:13:58.577171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564660+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:13:58.564660+0000","last_peered":"2024-05-11T01:13:58.564660+0000","last_clean":"2024-05-11T01:13:58.564660+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:13:58.564660+0000","last_undegraded":"2024-05-11T01:13:58.564660+0000","last_fullsized":"2024-05-11T01:13:58.564660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553944+0000","last_change":"2024-05-11T01:13:55.553944+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553944+0000","last_undegraded":"2024-05-11T01:13:55.553944+0000","last_fullsized":"2024-05-11T01:13:55.553944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770434+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:13:58.770434+0000","last_peered":"2024-05-11T01:13:58.770434+0000","last_clean":"2024-05-11T01:13:58.770434+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:13:58.770434+0000","last_undegraded":"2024-05-11T01:13:58.770434+0000","last_fullsized":"2024-05-11T01:13:58.770434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770133+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:13:58.770133+0000","last_peered":"2024-05-11T01:13:58.770133+0000","last_clean":"2024-05-11T01:13:58.770133+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:13:58.770133+0000","last_undegraded":"2024-05-11T01:13:58.770133+0000","last_fullsized":"2024-05-11T01:13:58.770133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.558676+0000","last_change":"2024-05-11T01:13:55.558676+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.558676+0000","last_undegraded":"2024-05-11T01:13:55.558676+0000","last_fullsized":"2024-05-11T01:13:55.558676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556087+0000","last_change":"2024-05-11T01:13:55.556087+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556087+0000","last_undegraded":"2024-05-11T01:13:55.556087+0000","last_fullsized":"2024-05-11T01:13:55.556087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577418+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:13:58.577418+0000","last_peered":"2024-05-11T01:13:58.577418+0000","last_clean":"2024-05-11T01:13:58.577418+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:13:58.577418+0000","last_undegraded":"2024-05-11T01:13:58.577418+0000","last_fullsized":"2024-05-11T01:13:58.577418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577260+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:13:58.577260+0000","last_peered":"2024-05-11T01:13:58.577260+0000","last_clean":"2024-05-11T01:13:58.577260+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:13:58.577260+0000","last_undegraded":"2024-05-11T01:13:58.577260+0000","last_fullsized":"2024-05-11T01:13:58.577260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577637+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:13:58.577637+0000","last_peered":"2024-05-11T01:13:58.577637+0000","last_clean":"2024-05-11T01:13:58.577637+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:13:58.577637+0000","last_undegraded":"2024-05-11T01:13:58.577637+0000","last_fullsized":"2024-05-11T01:13:58.577637+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770279+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:13:58.770279+0000","last_peered":"2024-05-11T01:13:58.770279+0000","last_clean":"2024-05-11T01:13:58.770279+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:13:58.770279+0000","last_undegraded":"2024-05-11T01:13:58.770279+0000","last_fullsized":"2024-05-11T01:13:58.770279+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556119+0000","last_change":"2024-05-11T01:13:55.556119+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556119+0000","last_undegraded":"2024-05-11T01:13:55.556119+0000","last_fullsized":"2024-05-11T01:13:55.556119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770387+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:13:58.770387+0000","last_peered":"2024-05-11T01:13:58.770387+0000","last_clean":"2024-05-11T01:13:58.770387+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:13:58.770387+0000","last_undegraded":"2024-05-11T01:13:58.770387+0000","last_fullsized":"2024-05-11T01:13:58.770387+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553361+0000","last_change":"2024-05-11T01:13:55.553361+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553361+0000","last_undegraded":"2024-05-11T01:13:55.553361+0000","last_fullsized":"2024-05-11T01:13:55.553361+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563506+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:13:58.563506+0000","last_peered":"2024-05-11T01:13:58.563506+0000","last_clean":"2024-05-11T01:13:58.563506+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:13:58.563506+0000","last_undegraded":"2024-05-11T01:13:58.563506+0000","last_fullsized":"2024-05-11T01:13:58.563506+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577560+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:13:58.577560+0000","last_peered":"2024-05-11T01:13:58.577560+0000","last_clean":"2024-05-11T01:13:58.577560+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:13:58.577560+0000","last_undegraded":"2024-05-11T01:13:58.577560+0000","last_fullsized":"2024-05-11T01:13:58.577560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564780+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:13:58.564780+0000","last_peered":"2024-05-11T01:13:58.564780+0000","last_clean":"2024-05-11T01:13:58.564780+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:13:58.564780+0000","last_undegraded":"2024-05-11T01:13:58.564780+0000","last_fullsized":"2024-05-11T01:13:58.564780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564800+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:13:58.564800+0000","last_peered":"2024-05-11T01:13:58.564800+0000","last_clean":"2024-05-11T01:13:58.564800+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:13:58.564800+0000","last_undegraded":"2024-05-11T01:13:58.564800+0000","last_fullsized":"2024-05-11T01:13:58.564800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770337+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:13:58.770337+0000","last_peered":"2024-05-11T01:13:58.770337+0000","last_clean":"2024-05-11T01:13:58.770337+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:13:58.770337+0000","last_undegraded":"2024-05-11T01:13:58.770337+0000","last_fullsized":"2024-05-11T01:13:58.770337+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577410+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:13:58.577410+0000","last_peered":"2024-05-11T01:13:58.577410+0000","last_clean":"2024-05-11T01:13:58.577410+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:13:58.577410+0000","last_undegraded":"2024-05-11T01:13:58.577410+0000","last_fullsized":"2024-05-11T01:13:58.577410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564554+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:13:58.564554+0000","last_peered":"2024-05-11T01:13:58.564554+0000","last_clean":"2024-05-11T01:13:58.564554+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:13:58.564554+0000","last_undegraded":"2024-05-11T01:13:58.564554+0000","last_fullsized":"2024-05-11T01:13:58.564554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577348+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:13:58.577348+0000","last_peered":"2024-05-11T01:13:58.577348+0000","last_clean":"2024-05-11T01:13:58.577348+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:13:58.577348+0000","last_undegraded":"2024-05-11T01:13:58.577348+0000","last_fullsized":"2024-05-11T01:13:58.577348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559063+0000","last_change":"2024-05-11T01:13:55.559063+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559063+0000","last_undegraded":"2024-05-11T01:13:55.559063+0000","last_fullsized":"2024-05-11T01:13:55.559063+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770171+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:13:58.770171+0000","last_peered":"2024-05-11T01:13:58.770171+0000","last_clean":"2024-05-11T01:13:58.770171+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:13:58.770171+0000","last_undegraded":"2024-05-11T01:13:58.770171+0000","last_fullsized":"2024-05-11T01:13:58.770171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553374+0000","last_change":"2024-05-11T01:13:55.553374+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553374+0000","last_undegraded":"2024-05-11T01:13:55.553374+0000","last_fullsized":"2024-05-11T01:13:55.553374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556048+0000","last_change":"2024-05-11T01:13:55.556048+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556048+0000","last_undegraded":"2024-05-11T01:13:55.556048+0000","last_fullsized":"2024-05-11T01:13:55.556048+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":244,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564343+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:13:58.564343+0000","last_peered":"2024-05-11T01:13:58.564343+0000","last_clean":"2024-05-11T01:13:58.564343+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:13:58.564343+0000","last_undegraded":"2024-05-11T01:13:58.564343+0000","last_fullsized":"2024-05-11T01:13:58.564343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":919624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54036,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317804,"statfs":{"total":96636764160,"available":96581431296,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40204,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331636,"statfs":{"total":96636764160,"available":96595595264,"internally_reserved":0,"allocated":712704,"data_stored":329804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44360,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327480,"statfs":{"total":96636764160,"available":96591339520,"internally_reserved":0,"allocated":716800,"data_stored":330800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58240,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313600,"statfs":{"total":96636764160,"available":96577126400,"internally_reserved":0,"allocated":704512,"data_stored":329236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1245184,"data_stored":892919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:14:02.343 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-05-11T01:14:02.343 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.344 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.345 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.346 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.347 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.559224+0000', 'last_change': '2024-05-11T01:13:55.559224+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.559224+0000', 'last_undegraded': '2024-05-11T01:13:55.559224+0000', 'last_fullsized': '2024-05-11T01:13:55.559224+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.559766+0000', 'last_change': '2024-05-11T01:13:55.559766+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.559766+0000', 'last_undegraded': '2024-05-11T01:13:55.559766+0000', 'last_fullsized': '2024-05-11T01:13:55.559766+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-05-11T01:14:02.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.556041+0000', 'last_change': '2024-05-11T01:13:55.556041+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.556041+0000', 'last_undegraded': '2024-05-11T01:13:55.556041+0000', 'last_fullsized': '2024-05-11T01:13:55.556041+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.554542+0000', 'last_change': '2024-05-11T01:13:55.554542+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.554542+0000', 'last_undegraded': '2024-05-11T01:13:55.554542+0000', 'last_fullsized': '2024-05-11T01:13:55.554542+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.559750+0000', 'last_change': '2024-05-11T01:13:55.559750+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.559750+0000', 'last_undegraded': '2024-05-11T01:13:55.559750+0000', 'last_fullsized': '2024-05-11T01:13:55.559750+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.553899+0000', 'last_change': '2024-05-11T01:13:55.553899+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.553899+0000', 'last_undegraded': '2024-05-11T01:13:55.553899+0000', 'last_fullsized': '2024-05-11T01:13:55.553899+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-05-11T01:14:02.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.553944+0000', 'last_change': '2024-05-11T01:13:55.553944+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.553944+0000', 'last_undegraded': '2024-05-11T01:13:55.553944+0000', 'last_fullsized': '2024-05-11T01:13:55.553944+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.558676+0000', 'last_change': '2024-05-11T01:13:55.558676+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.558676+0000', 'last_undegraded': '2024-05-11T01:13:55.558676+0000', 'last_fullsized': '2024-05-11T01:13:55.558676+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.350 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.556087+0000', 'last_change': '2024-05-11T01:13:55.556087+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.556087+0000', 'last_undegraded': '2024-05-11T01:13:55.556087+0000', 'last_fullsized': '2024-05-11T01:13:55.556087+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.556119+0000', 'last_change': '2024-05-11T01:13:55.556119+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.556119+0000', 'last_undegraded': '2024-05-11T01:13:55.556119+0000', 'last_fullsized': '2024-05-11T01:13:55.556119+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.553361+0000', 'last_change': '2024-05-11T01:13:55.553361+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.553361+0000', 'last_undegraded': '2024-05-11T01:13:55.553361+0000', 'last_fullsized': '2024-05-11T01:13:55.553361+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.351 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.559063+0000', 'last_change': '2024-05-11T01:13:55.559063+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.559063+0000', 'last_undegraded': '2024-05-11T01:13:55.559063+0000', 'last_fullsized': '2024-05-11T01:13:55.559063+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.553374+0000', 'last_change': '2024-05-11T01:13:55.553374+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.553374+0000', 'last_undegraded': '2024-05-11T01:13:55.553374+0000', 'last_fullsized': '2024-05-11T01:13:55.553374+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-05-11T01:14:02.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-11T01:13:56.549341+0000', 'last_change': '2024-05-11T01:13:56.549341+0000', 'last_active': '2024-05-11T01:13:56.549341+0000', 'last_peered': '2024-05-11T01:13:56.549341+0000', 'last_clean': '2024-05-11T01:13:56.549341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:56.549341+0000', 'last_undegraded': '2024-05-11T01:13:56.549341+0000', 'last_fullsized': '2024-05-11T01:13:56.549341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:56.549341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-11T01:14:02.353 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-05-11T01:14:02.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-05-11T01:13:55.556048+0000', 'last_change': '2024-05-11T01:13:55.556048+0000', 'last_active': '2024-05-11T01:13:55.544048+0000', 'last_peered': '2024-05-11T01:13:55.544048+0000', 'last_clean': '2024-05-11T01:13:55.544048+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-11T01:13:55.556048+0000', 'last_undegraded': '2024-05-11T01:13:55.556048+0000', 'last_fullsized': '2024-05-11T01:13:55.556048+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'last_clean_scrub_stamp': '2024-05-11T01:13:55.544048+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-11T01:14:02.353 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-11T01:14:02.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.482+0000 7efe75c09640 1 Processor -- start 2024-05-11T01:14:02.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.482+0000 7efe75c09640 1 -- start start 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.482+0000 7efe75c09640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe700b0ec0 0x7efe701639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.482+0000 7efe75c09640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe7015fde0 con 0x7efe7015f960 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.482+0000 7efe75c09640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe701600c0 con 0x7efe700b4ea0 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.482+0000 7efe75c09640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7efe701609f0 con 0x7efe700b0ec0 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6effd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7efe7015f960 0x7efe700b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53302/0 (socket says 172.21.15.16:53302) 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6effd640 1 -- 172.21.15.16:0/290755867 learned_addr learned my addr 172.21.15.16:0/290755867 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6f7fe640 1 --2- 172.21.15.16:0/290755867 >> v2:172.21.15.174:3300/0 conn(0x7efe700b0ec0 0x7efe701639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126954680 0 0) 0x7efe7015fde0 con 0x7efe7015f960 2024-05-11T01:14:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe5c003520 con 0x7efe7015f960 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2929162649 0 0) 0x7efe5c003520 con 0x7efe7015f960 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 >> v2:172.21.15.174:3300/0 conn(0x7efe700b0ec0 msgr2=0x7efe701639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 --2- 172.21.15.16:0/290755867 >> v2:172.21.15.174:3300/0 conn(0x7efe700b0ec0 0x7efe701639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 >> v1:172.21.15.174:6789/0 conn(0x7efe700b4ea0 legacy=0x7efe7006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe701603a0 con 0x7efe7015f960 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7efe580016f0 con 0x7efe7015f960 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 >> v1:172.21.15.16:6789/0 conn(0x7efe7015f960 legacy=0x7efe700b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe5c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe5c004800 0x7efe5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe5c0053c0 0x7efe5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efe701609f0 con 0x7efe5c003a50 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c00c230 con 0x7efe5c004800 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7efe5c00c430 con 0x7efe5c0053c0 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6f7fe640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe5c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6effd640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe5c004800 0x7efe5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.483+0000 7efe6ffff640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe5c0053c0 0x7efe5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6f7fe640 1 -- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe5c0053c0 msgr2=0x7efe5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6f7fe640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe5c0053c0 0x7efe5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6f7fe640 1 -- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe5c004800 msgr2=0x7efe5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6f7fe640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe5c004800 0x7efe5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6f7fe640 1 -- 172.21.15.16:0/290755867 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c003520 con 0x7efe5c003a50 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6ffff640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe5c0053c0 0x7efe5c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6ffff640 1 -- 172.21.15.16:0/290755867 reap_dead start 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6f7fe640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe5c003e70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efe60009ac0 tx=0x7efe5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3ce797401fe20c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60036070 con 0x7efe5c003a50 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60031400 con 0x7efe5c003a50 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.484+0000 7efe6e7fc640 1 -- 172.21.15.16:0/290755867 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60009690 con 0x7efe5c003a50 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.485+0000 7efe75c09640 1 -- 172.21.15.16:0/290755867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 msgr2=0x7efe5c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.485+0000 7efe75c09640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe5c003e70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efe60009ac0 tx=0x7efe5c005830 comp rx=0 tx=0).stop 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.485+0000 7efe75c09640 1 -- 172.21.15.16:0/290755867 shutdown_connections 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.485+0000 7efe75c09640 1 --2- 172.21.15.16:0/290755867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe5c003e70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.485+0000 7efe75c09640 1 -- 172.21.15.16:0/290755867 >> 172.21.15.16:0/290755867 conn(0x7efe700d17a0 msgr2=0x7efe700d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.485+0000 7efe75c09640 1 -- 172.21.15.16:0/290755867 shutdown_connections 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.485+0000 7efe75c09640 1 -- 172.21.15.16:0/290755867 wait complete. 2024-05-11T01:14:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.486+0000 7efe75c09640 1 Processor -- start 2024-05-11T01:14:02.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.486+0000 7efe75c09640 1 -- start start 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe75c09640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe70150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe75c09640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700afea0 0x7efe701555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe75c09640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700b0300 0x7efe70155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe75c09640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efe701639b0 con 0x7efe5c003a50 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe75c09640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efe700709b0 con 0x7efe700afea0 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe75c09640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7efe70163b30 con 0x7efe700b0300 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe70150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe6f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe70150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:38432/0 (socket says 172.21.15.16:38432) 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe6f7fe640 1 -- 172.21.15.16:0/2918717859 learned_addr learned my addr 172.21.15.16:0/2918717859 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe6effd640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700afea0 0x7efe701555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.487+0000 7efe6ffff640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700b0300 0x7efe70155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe6f7fe640 1 -- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700b0300 msgr2=0x7efe70155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe6f7fe640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700b0300 0x7efe70155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe6f7fe640 1 -- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700afea0 msgr2=0x7efe701555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe6f7fe640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700afea0 0x7efe701555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe6f7fe640 1 -- 172.21.15.16:0/2918717859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe700afbd0 con 0x7efe5c003a50 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe6ffff640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700b0300 0x7efe70155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe6f7fe640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe70150390 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efe60034040 tx=0x7efe60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe67fff640 1 -- 172.21.15.16:0/2918717859 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6003f020 con 0x7efe5c003a50 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe67fff640 1 -- 172.21.15.16:0/2918717859 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60037040 con 0x7efe5c003a50 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe70154230 con 0x7efe5c003a50 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe67fff640 1 -- 172.21.15.16:0/2918717859 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60036070 con 0x7efe5c003a50 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.488+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe701547f0 con 0x7efe5c003a50 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.489+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7006a5b0 con 0x7efe5c003a50 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.490+0000 7efe67fff640 1 -- 172.21.15.16:0/2918717859 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7efe60042020 con 0x7efe5c003a50 2024-05-11T01:14:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.490+0000 7efe67fff640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efe50076300 0x7efe500787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.490+0000 7efe67fff640 1 -- 172.21.15.16:0/2918717859 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7efe600b75f0 con 0x7efe5c003a50 2024-05-11T01:14:02.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.490+0000 7efe6effd640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efe50076300 0x7efe500787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.491+0000 7efe6effd640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efe50076300 0x7efe500787c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe7015f5e0 tx=0x7efe58007970 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.495+0000 7efe67fff640 1 -- 172.21.15.16:0/2918717859 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efe60049030 con 0x7efe5c003a50 2024-05-11T01:14:02.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.762+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7efe7015d820 con 0x7efe5c003a50 2024-05-11T01:14:02.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.762+0000 7efe67fff640 1 -- 172.21.15.16:0/2918717859 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1175 (secure 0 0 0) 0x7efe60080e70 con 0x7efe5c003a50 2024-05-11T01:14:02.763 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:02.763 INFO:teuthology.orchestra.run.smithi016.stdout:{"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":789,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1715389263,"num_in_osds":8,"osd_in_since":1715389255,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":43},{"state_name":"unknown","count":40},{"state_name":"creating+peering","count":14}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592708,"bytes_used":337412096,"bytes_avail":772756701184,"bytes_total":773094113280,"unknown_pgs_ratio":0.41237112879753113,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":2374,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5610}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-05-11T01:03:05.164611+0000","services":{}},"progress_events":{}} 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efe50076300 msgr2=0x7efe500787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efe50076300 0x7efe500787c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efe7015f5e0 tx=0x7efe58007970 comp rx=0 tx=0).stop 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 msgr2=0x7efe70150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe70150390 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efe60034040 tx=0x7efe60004730 comp rx=0 tx=0).stop 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 shutdown_connections 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7efe700b0300 0x7efe70155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efe50076300 0x7efe500787c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe700afea0 0x7efe701555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 --2- 172.21.15.16:0/2918717859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe5c003a50 0x7efe70150390 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 >> 172.21.15.16:0/2918717859 conn(0x7efe700d17a0 msgr2=0x7efe700b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:02.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.764+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 shutdown_connections 2024-05-11T01:14:02.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.765+0000 7efe75c09640 1 -- 172.21.15.16:0/2918717859 wait complete. 2024-05-11T01:14:02.776 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-11T01:14:02.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:14:02.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.880+0000 7fc861a25640 1 Processor -- start 2024-05-11T01:14:02.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.880+0000 7fc861a25640 1 -- start start 2024-05-11T01:14:02.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.880+0000 7fc861a25640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc85c0d4d80 0x7fc85c0b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.880+0000 7fc861a25640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc85c0b72b0 0x7fc85c0b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.880+0000 7fc861a25640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85c0b76d0 con 0x7fc85c15f670 2024-05-11T01:14:02.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.880+0000 7fc861a25640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc85c0d48f0 con 0x7fc85c0d4d80 2024-05-11T01:14:02.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.880+0000 7fc861a25640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc85c0d3a80 con 0x7fc85c0b72b0 2024-05-11T01:14:02.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85a7fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc85c0d4d80 0x7fc85c0b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85affd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc85c15f670 0x7fc85c0d3370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32930/0 (socket says 172.21.15.16:32930) 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85a7fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc85c0d4d80 0x7fc85c0b6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41796/0 (socket says 172.21.15.16:41796) 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85affd640 1 -- 172.21.15.16:0/2499315828 learned_addr learned my addr 172.21.15.16:0/2499315828 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85b7fe640 1 --2- 172.21.15.16:0/2499315828 >> v2:172.21.15.174:3300/0 conn(0x7fc85c0b72b0 0x7fc85c0b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85a7fc640 1 -- 172.21.15.16:0/2499315828 >> v2:172.21.15.174:3300/0 conn(0x7fc85c0b72b0 msgr2=0x7fc85c0b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85a7fc640 1 --2- 172.21.15.16:0/2499315828 >> v2:172.21.15.174:3300/0 conn(0x7fc85c0b72b0 0x7fc85c0b8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85a7fc640 1 -- 172.21.15.16:0/2499315828 >> v1:172.21.15.16:6789/0 conn(0x7fc85c15f670 legacy=0x7fc85c0d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc85a7fc640 1 -- 172.21.15.16:0/2499315828 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c0d3ce0 con 0x7fc85c0d4d80 2024-05-11T01:14:02.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.881+0000 7fc859ffb640 1 -- 172.21.15.16:0/2499315828 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578981742 0 0) 0x7fc85c0b76d0 con 0x7fc85c15f670 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc85a7fc640 1 --2- 172.21.15.16:0/2499315828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c0d4d80 0x7fc85c0b6d70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0b49d0 tx=0x7fc85002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6af0907003da12 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc859ffb640 1 -- 172.21.15.16:0/2499315828 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850037070 con 0x7fc85c0d4d80 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc859ffb640 1 -- 172.21.15.16:0/2499315828 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc850032440 con 0x7fc85c0d4d80 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc859ffb640 1 -- 172.21.15.16:0/2499315828 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850032810 con 0x7fc85c0d4d80 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc861a25640 1 -- 172.21.15.16:0/2499315828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c0d4d80 msgr2=0x7fc85c0b6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc861a25640 1 --2- 172.21.15.16:0/2499315828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c0d4d80 0x7fc85c0b6d70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0b49d0 tx=0x7fc85002a1a0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc861a25640 1 -- 172.21.15.16:0/2499315828 shutdown_connections 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc861a25640 1 --2- 172.21.15.16:0/2499315828 >> v2:172.21.15.174:3300/0 conn(0x7fc85c0b72b0 0x7fc85c0b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc861a25640 1 --2- 172.21.15.16:0/2499315828 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c0d4d80 0x7fc85c0b6d70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc861a25640 1 -- 172.21.15.16:0/2499315828 >> 172.21.15.16:0/2499315828 conn(0x7fc85c074140 msgr2=0x7fc85c0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.882+0000 7fc861a25640 1 -- 172.21.15.16:0/2499315828 shutdown_connections 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.883+0000 7fc861a25640 1 -- 172.21.15.16:0/2499315828 wait complete. 2024-05-11T01:14:02.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.884+0000 7fc861a25640 1 Processor -- start 2024-05-11T01:14:02.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.884+0000 7fc861a25640 1 -- start start 2024-05-11T01:14:02.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc861a25640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85c0b72b0 0x7fc85c154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc861a25640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc85c0d4d80 0x7fc85c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc861a25640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c15f670 0x7fc85c0ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc861a25640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c0d4580 con 0x7fc85c15f670 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc861a25640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c0d42a0 con 0x7fc85c0d4d80 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc861a25640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c0bb040 con 0x7fc85c0b72b0 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c15f670 0x7fc85c0ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c15f670 0x7fc85c0ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41804/0 (socket says 172.21.15.16:41804) 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 -- 172.21.15.16:0/989270476 learned_addr learned my addr 172.21.15.16:0/989270476 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85a7fc640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc85c0d4d80 0x7fc85c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85affd640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85c0b72b0 0x7fc85c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 -- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85c0b72b0 msgr2=0x7fc85c154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85c0b72b0 0x7fc85c154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 -- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc85c0d4d80 msgr2=0x7fc85c0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc85c0d4d80 0x7fc85c0ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:02.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 -- 172.21.15.16:0/989270476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c0cb3a0 con 0x7fc85c15f670 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85a7fc640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc85c0d4d80 0x7fc85c0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85affd640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85c0b72b0 0x7fc85c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc85b7fe640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c15f670 0x7fc85c0ca680 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc85400cd70 tx=0x7fc85400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc843fff640 1 -- 172.21.15.16:0/989270476 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854003b90 con 0x7fc85c15f670 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc843fff640 1 -- 172.21.15.16:0/989270476 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc854003d30 con 0x7fc85c15f670 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc843fff640 1 -- 172.21.15.16:0/989270476 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854004240 con 0x7fc85c15f670 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c0ce920 con 0x7fc85c15f670 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.885+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c154a90 con 0x7fc85c15f670 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.886+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc85c06a5b0 con 0x7fc85c15f670 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.887+0000 7fc843fff640 1 -- 172.21.15.16:0/989270476 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fc8540043e0 con 0x7fc85c15f670 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.887+0000 7fc843fff640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc8480762d0 0x7fc848078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:02.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.888+0000 7fc843fff640 1 -- 172.21.15.16:0/989270476 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7fc8540981d0 con 0x7fc85c15f670 2024-05-11T01:14:02.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.888+0000 7fc85affd640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc8480762d0 0x7fc848078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:02.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.888+0000 7fc85affd640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc8480762d0 0x7fc848078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc84c000f60 tx=0x7fc84c009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:02.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:02.892+0000 7fc843fff640 1 -- 172.21.15.16:0/989270476 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc854061400 con 0x7fc85c15f670 2024-05-11T01:14:03.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.078+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc85c15ee90 con 0x7fc8480762d0 2024-05-11T01:14:03.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.085+0000 7fc843fff640 1 -- 172.21.15.16:0/989270476 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245035 (secure 0 0 0) 0x7fc85c15ee90 con 0x7fc8480762d0 2024-05-11T01:14:03.088 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:03.089 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:14:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc8480762d0 msgr2=0x7fc848078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc8480762d0 0x7fc848078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc84c000f60 tx=0x7fc84c009040 comp rx=0 tx=0).stop 2024-05-11T01:14:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c15f670 msgr2=0x7fc85c0ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c15f670 0x7fc85c0ca680 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc85400cd70 tx=0x7fc85400a660 comp rx=0 tx=0).stop 2024-05-11T01:14:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 shutdown_connections 2024-05-11T01:14:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc85c15f670 0x7fc85c0ca680 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc8480762d0 0x7fc848078790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:03.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc85c0d4d80 0x7fc85c0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 --2- 172.21.15.16:0/989270476 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc85c0b72b0 0x7fc85c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 >> 172.21.15.16:0/989270476 conn(0x7fc85c074140 msgr2=0x7fc85c0b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 shutdown_connections 2024-05-11T01:14:03.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:03.088+0000 7fc861a25640 1 -- 172.21.15.16:0/989270476 wait complete. 2024-05-11T01:14:03.100 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-11T01:14:01.158571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592708,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":151,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":87,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":329504,"kb_used_data":6512,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754645216,"statfs":{"total":773094113280,"available":772756701184,"internally_reserved":0,"allocated":6668288,"data_stored":3728579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.606399"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564611+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:13:58.564611+0000","last_peered":"2024-05-11T01:13:58.564611+0000","last_clean":"2024-05-11T01:13:58.564611+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:13:58.564611+0000","last_undegraded":"2024-05-11T01:13:58.564611+0000","last_fullsized":"2024-05-11T01:13:58.564611+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577251+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:13:58.577251+0000","last_peered":"2024-05-11T01:13:58.577251+0000","last_clean":"2024-05-11T01:13:58.577251+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:13:58.577251+0000","last_undegraded":"2024-05-11T01:13:58.577251+0000","last_fullsized":"2024-05-11T01:13:58.577251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564736+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:13:58.564736+0000","last_peered":"2024-05-11T01:13:58.564736+0000","last_clean":"2024-05-11T01:13:58.564736+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:13:58.564736+0000","last_undegraded":"2024-05-11T01:13:58.564736+0000","last_fullsized":"2024-05-11T01:13:58.564736+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770697+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:13:58.770697+0000","last_peered":"2024-05-11T01:13:58.770697+0000","last_clean":"2024-05-11T01:13:58.770697+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:13:58.770697+0000","last_undegraded":"2024-05-11T01:13:58.770697+0000","last_fullsized":"2024-05-11T01:13:58.770697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577112+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:13:58.577112+0000","last_peered":"2024-05-11T01:13:58.577112+0000","last_clean":"2024-05-11T01:13:58.577112+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:13:58.577112+0000","last_undegraded":"2024-05-11T01:13:58.577112+0000","last_fullsized":"2024-05-11T01:13:58.577112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770687+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:13:58.770687+0000","last_peered":"2024-05-11T01:13:58.770687+0000","last_clean":"2024-05-11T01:13:58.770687+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:13:58.770687+0000","last_undegraded":"2024-05-11T01:13:58.770687+0000","last_fullsized":"2024-05-11T01:13:58.770687+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577524+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:13:58.577524+0000","last_peered":"2024-05-11T01:13:58.577524+0000","last_clean":"2024-05-11T01:13:58.577524+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:13:58.577524+0000","last_undegraded":"2024-05-11T01:13:58.577524+0000","last_fullsized":"2024-05-11T01:13:58.577524+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770272+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:13:58.770272+0000","last_peered":"2024-05-11T01:13:58.770272+0000","last_clean":"2024-05-11T01:13:58.770272+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:13:58.770272+0000","last_undegraded":"2024-05-11T01:13:58.770272+0000","last_fullsized":"2024-05-11T01:13:58.770272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577125+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:13:58.577125+0000","last_peered":"2024-05-11T01:13:58.577125+0000","last_clean":"2024-05-11T01:13:58.577125+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:13:58.577125+0000","last_undegraded":"2024-05-11T01:13:58.577125+0000","last_fullsized":"2024-05-11T01:13:58.577125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770214+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:13:58.770214+0000","last_peered":"2024-05-11T01:13:58.770214+0000","last_clean":"2024-05-11T01:13:58.770214+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:13:58.770214+0000","last_undegraded":"2024-05-11T01:13:58.770214+0000","last_fullsized":"2024-05-11T01:13:58.770214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770663+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:13:58.770663+0000","last_peered":"2024-05-11T01:13:58.770663+0000","last_clean":"2024-05-11T01:13:58.770663+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:13:58.770663+0000","last_undegraded":"2024-05-11T01:13:58.770663+0000","last_fullsized":"2024-05-11T01:13:58.770663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577582+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:13:58.577582+0000","last_peered":"2024-05-11T01:13:58.577582+0000","last_clean":"2024-05-11T01:13:58.577582+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:13:58.577582+0000","last_undegraded":"2024-05-11T01:13:58.577582+0000","last_fullsized":"2024-05-11T01:13:58.577582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559224+0000","last_change":"2024-05-11T01:13:55.559224+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559224+0000","last_undegraded":"2024-05-11T01:13:55.559224+0000","last_fullsized":"2024-05-11T01:13:55.559224+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770480+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:13:58.770480+0000","last_peered":"2024-05-11T01:13:58.770480+0000","last_clean":"2024-05-11T01:13:58.770480+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:13:58.770480+0000","last_undegraded":"2024-05-11T01:13:58.770480+0000","last_fullsized":"2024-05-11T01:13:58.770480+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770562+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:13:58.770562+0000","last_peered":"2024-05-11T01:13:58.770562+0000","last_clean":"2024-05-11T01:13:58.770562+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:13:58.770562+0000","last_undegraded":"2024-05-11T01:13:58.770562+0000","last_fullsized":"2024-05-11T01:13:58.770562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564250+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:13:58.564250+0000","last_peered":"2024-05-11T01:13:58.564250+0000","last_clean":"2024-05-11T01:13:58.564250+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:13:58.564250+0000","last_undegraded":"2024-05-11T01:13:58.564250+0000","last_fullsized":"2024-05-11T01:13:58.564250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577406+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:13:58.577406+0000","last_peered":"2024-05-11T01:13:58.577406+0000","last_clean":"2024-05-11T01:13:58.577406+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:13:58.577406+0000","last_undegraded":"2024-05-11T01:13:58.577406+0000","last_fullsized":"2024-05-11T01:13:58.577406+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559766+0000","last_change":"2024-05-11T01:13:55.559766+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559766+0000","last_undegraded":"2024-05-11T01:13:55.559766+0000","last_fullsized":"2024-05-11T01:13:55.559766+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556041+0000","last_change":"2024-05-11T01:13:55.556041+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556041+0000","last_undegraded":"2024-05-11T01:13:55.556041+0000","last_fullsized":"2024-05-11T01:13:55.556041+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.554542+0000","last_change":"2024-05-11T01:13:55.554542+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.554542+0000","last_undegraded":"2024-05-11T01:13:55.554542+0000","last_fullsized":"2024-05-11T01:13:55.554542+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559750+0000","last_change":"2024-05-11T01:13:55.559750+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559750+0000","last_undegraded":"2024-05-11T01:13:55.559750+0000","last_fullsized":"2024-05-11T01:13:55.559750+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564783+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:13:58.564783+0000","last_peered":"2024-05-11T01:13:58.564783+0000","last_clean":"2024-05-11T01:13:58.564783+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:13:58.564783+0000","last_undegraded":"2024-05-11T01:13:58.564783+0000","last_fullsized":"2024-05-11T01:13:58.564783+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553899+0000","last_change":"2024-05-11T01:13:55.553899+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553899+0000","last_undegraded":"2024-05-11T01:13:55.553899+0000","last_fullsized":"2024-05-11T01:13:55.553899+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577509+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:13:58.577509+0000","last_peered":"2024-05-11T01:13:58.577509+0000","last_clean":"2024-05-11T01:13:58.577509+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:13:58.577509+0000","last_undegraded":"2024-05-11T01:13:58.577509+0000","last_fullsized":"2024-05-11T01:13:58.577509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564669+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:13:58.564669+0000","last_peered":"2024-05-11T01:13:58.564669+0000","last_clean":"2024-05-11T01:13:58.564669+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:13:58.564669+0000","last_undegraded":"2024-05-11T01:13:58.564669+0000","last_fullsized":"2024-05-11T01:13:58.564669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564550+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:13:58.564550+0000","last_peered":"2024-05-11T01:13:58.564550+0000","last_clean":"2024-05-11T01:13:58.564550+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:13:58.564550+0000","last_undegraded":"2024-05-11T01:13:58.564550+0000","last_fullsized":"2024-05-11T01:13:58.564550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770658+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:13:58.770658+0000","last_peered":"2024-05-11T01:13:58.770658+0000","last_clean":"2024-05-11T01:13:58.770658+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:13:58.770658+0000","last_undegraded":"2024-05-11T01:13:58.770658+0000","last_fullsized":"2024-05-11T01:13:58.770658+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577530+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:13:58.577530+0000","last_peered":"2024-05-11T01:13:58.577530+0000","last_clean":"2024-05-11T01:13:58.577530+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:13:58.577530+0000","last_undegraded":"2024-05-11T01:13:58.577530+0000","last_fullsized":"2024-05-11T01:13:58.577530+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564439+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:13:58.564439+0000","last_peered":"2024-05-11T01:13:58.564439+0000","last_clean":"2024-05-11T01:13:58.564439+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:13:58.564439+0000","last_undegraded":"2024-05-11T01:13:58.564439+0000","last_fullsized":"2024-05-11T01:13:58.564439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577095+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:13:58.577095+0000","last_peered":"2024-05-11T01:13:58.577095+0000","last_clean":"2024-05-11T01:13:58.577095+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:13:58.577095+0000","last_undegraded":"2024-05-11T01:13:58.577095+0000","last_fullsized":"2024-05-11T01:13:58.577095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577171+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:13:58.577171+0000","last_peered":"2024-05-11T01:13:58.577171+0000","last_clean":"2024-05-11T01:13:58.577171+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:13:58.577171+0000","last_undegraded":"2024-05-11T01:13:58.577171+0000","last_fullsized":"2024-05-11T01:13:58.577171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564660+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:13:58.564660+0000","last_peered":"2024-05-11T01:13:58.564660+0000","last_clean":"2024-05-11T01:13:58.564660+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:13:58.564660+0000","last_undegraded":"2024-05-11T01:13:58.564660+0000","last_fullsized":"2024-05-11T01:13:58.564660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553944+0000","last_change":"2024-05-11T01:13:55.553944+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553944+0000","last_undegraded":"2024-05-11T01:13:55.553944+0000","last_fullsized":"2024-05-11T01:13:55.553944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770434+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:13:58.770434+0000","last_peered":"2024-05-11T01:13:58.770434+0000","last_clean":"2024-05-11T01:13:58.770434+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:13:58.770434+0000","last_undegraded":"2024-05-11T01:13:58.770434+0000","last_fullsized":"2024-05-11T01:13:58.770434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770133+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:13:58.770133+0000","last_peered":"2024-05-11T01:13:58.770133+0000","last_clean":"2024-05-11T01:13:58.770133+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:13:58.770133+0000","last_undegraded":"2024-05-11T01:13:58.770133+0000","last_fullsized":"2024-05-11T01:13:58.770133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.558676+0000","last_change":"2024-05-11T01:13:55.558676+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.558676+0000","last_undegraded":"2024-05-11T01:13:55.558676+0000","last_fullsized":"2024-05-11T01:13:55.558676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556087+0000","last_change":"2024-05-11T01:13:55.556087+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556087+0000","last_undegraded":"2024-05-11T01:13:55.556087+0000","last_fullsized":"2024-05-11T01:13:55.556087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577418+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:13:58.577418+0000","last_peered":"2024-05-11T01:13:58.577418+0000","last_clean":"2024-05-11T01:13:58.577418+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:13:58.577418+0000","last_undegraded":"2024-05-11T01:13:58.577418+0000","last_fullsized":"2024-05-11T01:13:58.577418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577260+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:13:58.577260+0000","last_peered":"2024-05-11T01:13:58.577260+0000","last_clean":"2024-05-11T01:13:58.577260+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:13:58.577260+0000","last_undegraded":"2024-05-11T01:13:58.577260+0000","last_fullsized":"2024-05-11T01:13:58.577260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577637+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:13:58.577637+0000","last_peered":"2024-05-11T01:13:58.577637+0000","last_clean":"2024-05-11T01:13:58.577637+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:13:58.577637+0000","last_undegraded":"2024-05-11T01:13:58.577637+0000","last_fullsized":"2024-05-11T01:13:58.577637+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770279+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:13:58.770279+0000","last_peered":"2024-05-11T01:13:58.770279+0000","last_clean":"2024-05-11T01:13:58.770279+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:13:58.770279+0000","last_undegraded":"2024-05-11T01:13:58.770279+0000","last_fullsized":"2024-05-11T01:13:58.770279+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556119+0000","last_change":"2024-05-11T01:13:55.556119+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556119+0000","last_undegraded":"2024-05-11T01:13:55.556119+0000","last_fullsized":"2024-05-11T01:13:55.556119+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770387+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:13:58.770387+0000","last_peered":"2024-05-11T01:13:58.770387+0000","last_clean":"2024-05-11T01:13:58.770387+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:13:58.770387+0000","last_undegraded":"2024-05-11T01:13:58.770387+0000","last_fullsized":"2024-05-11T01:13:58.770387+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553361+0000","last_change":"2024-05-11T01:13:55.553361+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553361+0000","last_undegraded":"2024-05-11T01:13:55.553361+0000","last_fullsized":"2024-05-11T01:13:55.553361+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563506+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:13:58.563506+0000","last_peered":"2024-05-11T01:13:58.563506+0000","last_clean":"2024-05-11T01:13:58.563506+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:13:58.563506+0000","last_undegraded":"2024-05-11T01:13:58.563506+0000","last_fullsized":"2024-05-11T01:13:58.563506+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577560+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:13:58.577560+0000","last_peered":"2024-05-11T01:13:58.577560+0000","last_clean":"2024-05-11T01:13:58.577560+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:13:58.577560+0000","last_undegraded":"2024-05-11T01:13:58.577560+0000","last_fullsized":"2024-05-11T01:13:58.577560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564780+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:13:58.564780+0000","last_peered":"2024-05-11T01:13:58.564780+0000","last_clean":"2024-05-11T01:13:58.564780+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:13:58.564780+0000","last_undegraded":"2024-05-11T01:13:58.564780+0000","last_fullsized":"2024-05-11T01:13:58.564780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564800+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:13:58.564800+0000","last_peered":"2024-05-11T01:13:58.564800+0000","last_clean":"2024-05-11T01:13:58.564800+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:13:58.564800+0000","last_undegraded":"2024-05-11T01:13:58.564800+0000","last_fullsized":"2024-05-11T01:13:58.564800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770337+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:13:58.770337+0000","last_peered":"2024-05-11T01:13:58.770337+0000","last_clean":"2024-05-11T01:13:58.770337+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:13:58.770337+0000","last_undegraded":"2024-05-11T01:13:58.770337+0000","last_fullsized":"2024-05-11T01:13:58.770337+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577410+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:13:58.577410+0000","last_peered":"2024-05-11T01:13:58.577410+0000","last_clean":"2024-05-11T01:13:58.577410+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:13:58.577410+0000","last_undegraded":"2024-05-11T01:13:58.577410+0000","last_fullsized":"2024-05-11T01:13:58.577410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564554+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:13:58.564554+0000","last_peered":"2024-05-11T01:13:58.564554+0000","last_clean":"2024-05-11T01:13:58.564554+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:13:58.564554+0000","last_undegraded":"2024-05-11T01:13:58.564554+0000","last_fullsized":"2024-05-11T01:13:58.564554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577348+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:13:58.577348+0000","last_peered":"2024-05-11T01:13:58.577348+0000","last_clean":"2024-05-11T01:13:58.577348+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:13:58.577348+0000","last_undegraded":"2024-05-11T01:13:58.577348+0000","last_fullsized":"2024-05-11T01:13:58.577348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.559063+0000","last_change":"2024-05-11T01:13:55.559063+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.559063+0000","last_undegraded":"2024-05-11T01:13:55.559063+0000","last_fullsized":"2024-05-11T01:13:55.559063+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770171+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:13:58.770171+0000","last_peered":"2024-05-11T01:13:58.770171+0000","last_clean":"2024-05-11T01:13:58.770171+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:13:58.770171+0000","last_undegraded":"2024-05-11T01:13:58.770171+0000","last_fullsized":"2024-05-11T01:13:58.770171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.553374+0000","last_change":"2024-05-11T01:13:55.553374+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.553374+0000","last_undegraded":"2024-05-11T01:13:55.553374+0000","last_fullsized":"2024-05-11T01:13:55.553374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-11T01:13:56.549341+0000","last_change":"2024-05-11T01:13:56.549341+0000","last_active":"2024-05-11T01:13:56.549341+0000","last_peered":"2024-05-11T01:13:56.549341+0000","last_clean":"2024-05-11T01:13:56.549341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:56.549341+0000","last_undegraded":"2024-05-11T01:13:56.549341+0000","last_fullsized":"2024-05-11T01:13:56.549341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-05-11T01:13:55.556048+0000","last_change":"2024-05-11T01:13:55.556048+0000","last_active":"2024-05-11T01:13:55.544048+0000","last_peered":"2024-05-11T01:13:55.544048+0000","last_clean":"2024-05-11T01:13:55.544048+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-11T01:13:55.556048+0000","last_undegraded":"2024-05-11T01:13:55.556048+0000","last_fullsized":"2024-05-11T01:13:55.556048+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":244,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564343+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:13:58.564343+0000","last_peered":"2024-05-11T01:13:58.564343+0000","last_clean":"2024-05-11T01:13:58.564343+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:13:58.564343+0000","last_undegraded":"2024-05-11T01:13:58.564343+0000","last_fullsized":"2024-05-11T01:13:58.564343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":48,"acting":48,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2340,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":919624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54036,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317804,"statfs":{"total":96636764160,"available":96581431296,"internally_reserved":0,"allocated":663552,"data_stored":308732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40204,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331636,"statfs":{"total":96636764160,"available":96595595264,"internally_reserved":0,"allocated":712704,"data_stored":329804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44360,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327480,"statfs":{"total":96636764160,"available":96591339520,"internally_reserved":0,"allocated":716800,"data_stored":330800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58240,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313600,"statfs":{"total":96636764160,"available":96577126400,"internally_reserved":0,"allocated":704512,"data_stored":329236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1245184,"data_stored":892919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:14:06.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:14:06.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.221+0000 7f85c1675640 1 Processor -- start 2024-05-11T01:14:06.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.221+0000 7f85c1675640 1 -- start start 2024-05-11T01:14:06.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85c1675640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc0baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85c1675640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f85bc163210 0x7f85bc0b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85c1675640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85bc0b7360 0x7f85bc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85c1675640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f85bc0d3700 con 0x7f85bc163210 2024-05-11T01:14:06.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85c1675640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f85bc1639f0 con 0x7f85bc0b7360 2024-05-11T01:14:06.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85c1675640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f85bc163cd0 con 0x7f85bc162d30 2024-05-11T01:14:06.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85ba7fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f85bc163210 0x7f85bc0b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85ba7fc640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f85bc163210 0x7f85bc0b6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41812/0 (socket says 172.21.15.16:41812) 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.222+0000 7f85ba7fc640 1 -- 172.21.15.16:0/2053447052 learned_addr learned my addr 172.21.15.16:0/2053447052 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.223+0000 7f85baffd640 1 --2- 172.21.15.16:0/2053447052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc0baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.223+0000 7f85bb7fe640 1 --2- 172.21.15.16:0/2053447052 >> v2:172.21.15.174:3300/0 conn(0x7f85bc0b7360 0x7f85bc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.223+0000 7f85ba7fc640 1 -- 172.21.15.16:0/2053447052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 msgr2=0x7f85bc0baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.223+0000 7f85ba7fc640 1 --2- 172.21.15.16:0/2053447052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc0baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.223+0000 7f85ba7fc640 1 -- 172.21.15.16:0/2053447052 >> v2:172.21.15.174:3300/0 conn(0x7f85bc0b7360 msgr2=0x7f85bc06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.223+0000 7f85ba7fc640 1 --2- 172.21.15.16:0/2053447052 >> v2:172.21.15.174:3300/0 conn(0x7f85bc0b7360 0x7f85bc06d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.223+0000 7f85ba7fc640 1 -- 172.21.15.16:0/2053447052 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc163fb0 con 0x7f85bc163210 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85ba7fc640 1 --2- 172.21.15.16:0/2053447052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc0b6e20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f85bc06ed30 tx=0x7f85b002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361cdf26ea8a3114 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85b9ffb640 1 -- 172.21.15.16:0/2053447052 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0037070 con 0x7f85bc163210 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85b9ffb640 1 -- 172.21.15.16:0/2053447052 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b002ae00 con 0x7f85bc163210 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85b9ffb640 1 -- 172.21.15.16:0/2053447052 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0032660 con 0x7f85bc163210 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 -- 172.21.15.16:0/2053447052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 msgr2=0x7f85bc0b6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 --2- 172.21.15.16:0/2053447052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc0b6e20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f85bc06ed30 tx=0x7f85b002a0b0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 -- 172.21.15.16:0/2053447052 shutdown_connections 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 --2- 172.21.15.16:0/2053447052 >> v2:172.21.15.174:3300/0 conn(0x7f85bc0b7360 0x7f85bc06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 --2- 172.21.15.16:0/2053447052 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc0b6e20 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 --2- 172.21.15.16:0/2053447052 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc0baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 -- 172.21.15.16:0/2053447052 >> 172.21.15.16:0/2053447052 conn(0x7f85bc0d1e20 msgr2=0x7f85bc0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 -- 172.21.15.16:0/2053447052 shutdown_connections 2024-05-11T01:14:06.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.224+0000 7f85c1675640 1 -- 172.21.15.16:0/2053447052 wait complete. 2024-05-11T01:14:06.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.226+0000 7f85c1675640 1 Processor -- start 2024-05-11T01:14:06.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.226+0000 7f85c1675640 1 -- start start 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85c1675640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85bc0b7360 0x7f85bc14c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85c1675640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc1eaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85c1675640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85c1675640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc06d800 con 0x7f85bc163210 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85c1675640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc163670 con 0x7f85bc0b7360 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85c1675640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f85bc06d980 con 0x7f85bc162d30 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc15d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41824/0 (socket says 172.21.15.16:41824) 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 -- 172.21.15.16:0/102357447 learned_addr learned my addr 172.21.15.16:0/102357447 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85baffd640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85bc0b7360 0x7f85bc14c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85ba7fc640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc1eaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 -- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 msgr2=0x7f85bc1eaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc1eaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 -- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85bc0b7360 msgr2=0x7f85bc14c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85bc0b7360 0x7f85bc14c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 -- 172.21.15.16:0/102357447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc0cce50 con 0x7f85bc163210 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85baffd640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85bc0b7360 0x7f85bc14c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85ba7fc640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc1eaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85bb7fe640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc15d9b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f85b400e860 tx=0x7f85b400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85a37fe640 1 -- 172.21.15.16:0/102357447 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4017070 con 0x7f85bc163210 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85a37fe640 1 -- 172.21.15.16:0/102357447 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b400c940 con 0x7f85bc163210 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85a37fe640 1 -- 172.21.15.16:0/102357447 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b400cd30 con 0x7f85bc163210 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.227+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc0cd0d0 con 0x7f85bc163210 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.228+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc0cd690 con 0x7f85bc163210 2024-05-11T01:14:06.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.229+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85bc069510 con 0x7f85bc163210 2024-05-11T01:14:06.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.229+0000 7f85a37fe640 1 -- 172.21.15.16:0/102357447 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f85b401a070 con 0x7f85bc163210 2024-05-11T01:14:06.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.230+0000 7f85a37fe640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f85a80762d0 0x7f85a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.230+0000 7f85a37fe640 1 -- 172.21.15.16:0/102357447 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7f85b40976e0 con 0x7f85bc163210 2024-05-11T01:14:06.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.230+0000 7f85baffd640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f85a80762d0 0x7f85a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.231+0000 7f85baffd640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f85a80762d0 0x7f85a8078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0cb5b0 tx=0x7f85ac00b040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:06.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.234+0000 7f85a37fe640 1 -- 172.21.15.16:0/102357447 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f85bc069510 con 0x7f85bc163210 2024-05-11T01:14:06.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.423+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85bc0cde50 con 0x7f85a80762d0 2024-05-11T01:14:06.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.430+0000 7f85a37fe640 1 -- 172.21.15.16:0/102357447 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7f85bc0cde50 con 0x7f85a80762d0 2024-05-11T01:14:06.432 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:06.434 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:14:06.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f85a80762d0 msgr2=0x7f85a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f85a80762d0 0x7f85a8078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0cb5b0 tx=0x7f85ac00b040 comp rx=0 tx=0).stop 2024-05-11T01:14:06.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 msgr2=0x7f85bc15d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc15d9b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f85b400e860 tx=0x7f85b400ed20 comp rx=0 tx=0).stop 2024-05-11T01:14:06.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 shutdown_connections 2024-05-11T01:14:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85bc163210 0x7f85bc15d9b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f85bc162d30 0x7f85bc1eaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f85a80762d0 0x7f85a8078790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 --2- 172.21.15.16:0/102357447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85bc0b7360 0x7f85bc14c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 >> 172.21.15.16:0/102357447 conn(0x7f85bc0d1e20 msgr2=0x7f85bc0cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 shutdown_connections 2024-05-11T01:14:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.433+0000 7f85c1675640 1 -- 172.21.15.16:0/102357447 wait complete. 2024-05-11T01:14:06.444 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-11T01:14:05.159549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":170,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329704,"kb_used_data":6696,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754645016,"statfs":{"total":773094113280,"available":772756496384,"internally_reserved":0,"allocated":6856704,"data_stored":3818884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001898"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564611+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:13:58.564611+0000","last_peered":"2024-05-11T01:13:58.564611+0000","last_clean":"2024-05-11T01:13:58.564611+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:13:58.564611+0000","last_undegraded":"2024-05-11T01:13:58.564611+0000","last_fullsized":"2024-05-11T01:13:58.564611+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771107+0000","last_change":"2024-05-11T01:13:57.592028+0000","last_active":"2024-05-11T01:13:58.771107+0000","last_peered":"2024-05-11T01:13:58.771107+0000","last_clean":"2024-05-11T01:13:58.771107+0000","last_became_active":"2024-05-11T01:13:57.591749+0000","last_became_peered":"2024-05-11T01:13:57.591749+0000","last_unstale":"2024-05-11T01:13:58.771107+0000","last_undegraded":"2024-05-11T01:13:58.771107+0000","last_fullsized":"2024-05-11T01:13:58.771107+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:07:26.697058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563712+0000","last_change":"2024-05-11T01:13:57.577565+0000","last_active":"2024-05-11T01:13:58.563712+0000","last_peered":"2024-05-11T01:13:58.563712+0000","last_clean":"2024-05-11T01:13:58.563712+0000","last_became_active":"2024-05-11T01:13:57.577002+0000","last_became_peered":"2024-05-11T01:13:57.577002+0000","last_unstale":"2024-05-11T01:13:58.563712+0000","last_undegraded":"2024-05-11T01:13:58.563712+0000","last_fullsized":"2024-05-11T01:13:58.563712+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:10:34.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562582+0000","last_change":"2024-05-11T01:13:57.588370+0000","last_active":"2024-05-11T01:13:58.562582+0000","last_peered":"2024-05-11T01:13:58.562582+0000","last_clean":"2024-05-11T01:13:58.562582+0000","last_became_active":"2024-05-11T01:13:57.587912+0000","last_became_peered":"2024-05-11T01:13:57.587912+0000","last_unstale":"2024-05-11T01:13:58.562582+0000","last_undegraded":"2024-05-11T01:13:58.562582+0000","last_fullsized":"2024-05-11T01:13:58.562582+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771003+0000","last_change":"2024-05-11T01:13:57.589752+0000","last_active":"2024-05-11T01:13:58.771003+0000","last_peered":"2024-05-11T01:13:58.771003+0000","last_clean":"2024-05-11T01:13:58.771003+0000","last_became_active":"2024-05-11T01:13:57.589446+0000","last_became_peered":"2024-05-11T01:13:57.589446+0000","last_unstale":"2024-05-11T01:13:58.771003+0000","last_undegraded":"2024-05-11T01:13:58.771003+0000","last_fullsized":"2024-05-11T01:13:58.771003+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:28:37.601407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577251+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:13:58.577251+0000","last_peered":"2024-05-11T01:13:58.577251+0000","last_clean":"2024-05-11T01:13:58.577251+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:13:58.577251+0000","last_undegraded":"2024-05-11T01:13:58.577251+0000","last_fullsized":"2024-05-11T01:13:58.577251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564736+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:13:58.564736+0000","last_peered":"2024-05-11T01:13:58.564736+0000","last_clean":"2024-05-11T01:13:58.564736+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:13:58.564736+0000","last_undegraded":"2024-05-11T01:13:58.564736+0000","last_fullsized":"2024-05-11T01:13:58.564736+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562084+0000","last_change":"2024-05-11T01:13:57.584499+0000","last_active":"2024-05-11T01:13:58.562084+0000","last_peered":"2024-05-11T01:13:58.562084+0000","last_clean":"2024-05-11T01:13:58.562084+0000","last_became_active":"2024-05-11T01:13:57.584207+0000","last_became_peered":"2024-05-11T01:13:57.584207+0000","last_unstale":"2024-05-11T01:13:58.562084+0000","last_undegraded":"2024-05-11T01:13:58.562084+0000","last_fullsized":"2024-05-11T01:13:58.562084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:32:22.587470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562453+0000","last_change":"2024-05-11T01:13:57.587045+0000","last_active":"2024-05-11T01:13:58.562453+0000","last_peered":"2024-05-11T01:13:58.562453+0000","last_clean":"2024-05-11T01:13:58.562453+0000","last_became_active":"2024-05-11T01:13:57.586787+0000","last_became_peered":"2024-05-11T01:13:57.586787+0000","last_unstale":"2024-05-11T01:13:58.562453+0000","last_undegraded":"2024-05-11T01:13:58.562453+0000","last_fullsized":"2024-05-11T01:13:58.562453+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562773+0000","last_change":"2024-05-11T01:13:57.587253+0000","last_active":"2024-05-11T01:13:58.562773+0000","last_peered":"2024-05-11T01:13:58.562773+0000","last_clean":"2024-05-11T01:13:58.562773+0000","last_became_active":"2024-05-11T01:13:57.586646+0000","last_became_peered":"2024-05-11T01:13:57.586646+0000","last_unstale":"2024-05-11T01:13:58.562773+0000","last_undegraded":"2024-05-11T01:13:58.562773+0000","last_fullsized":"2024-05-11T01:13:58.562773+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562331+0000","last_change":"2024-05-11T01:13:57.587659+0000","last_active":"2024-05-11T01:13:58.562331+0000","last_peered":"2024-05-11T01:13:58.562331+0000","last_clean":"2024-05-11T01:13:58.562331+0000","last_became_active":"2024-05-11T01:13:57.587368+0000","last_became_peered":"2024-05-11T01:13:57.587368+0000","last_unstale":"2024-05-11T01:13:58.562331+0000","last_undegraded":"2024-05-11T01:13:58.562331+0000","last_fullsized":"2024-05-11T01:13:58.562331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771386+0000","last_change":"2024-05-11T01:13:57.584583+0000","last_active":"2024-05-11T01:13:58.771386+0000","last_peered":"2024-05-11T01:13:58.771386+0000","last_clean":"2024-05-11T01:13:58.771386+0000","last_became_active":"2024-05-11T01:13:57.584324+0000","last_became_peered":"2024-05-11T01:13:57.584324+0000","last_unstale":"2024-05-11T01:13:58.771386+0000","last_undegraded":"2024-05-11T01:13:58.771386+0000","last_fullsized":"2024-05-11T01:13:58.771386+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:39:33.068502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770697+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:13:58.770697+0000","last_peered":"2024-05-11T01:13:58.770697+0000","last_clean":"2024-05-11T01:13:58.770697+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:13:58.770697+0000","last_undegraded":"2024-05-11T01:13:58.770697+0000","last_fullsized":"2024-05-11T01:13:58.770697+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562418+0000","last_change":"2024-05-11T01:13:57.576297+0000","last_active":"2024-05-11T01:13:58.562418+0000","last_peered":"2024-05-11T01:13:58.562418+0000","last_clean":"2024-05-11T01:13:58.562418+0000","last_became_active":"2024-05-11T01:13:57.575994+0000","last_became_peered":"2024-05-11T01:13:57.575994+0000","last_unstale":"2024-05-11T01:13:58.562418+0000","last_undegraded":"2024-05-11T01:13:58.562418+0000","last_fullsized":"2024-05-11T01:13:58.562418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:51.169562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577112+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:13:58.577112+0000","last_peered":"2024-05-11T01:13:58.577112+0000","last_clean":"2024-05-11T01:13:58.577112+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:13:58.577112+0000","last_undegraded":"2024-05-11T01:13:58.577112+0000","last_fullsized":"2024-05-11T01:13:58.577112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770853+0000","last_change":"2024-05-11T01:13:57.587648+0000","last_active":"2024-05-11T01:13:58.770853+0000","last_peered":"2024-05-11T01:13:58.770853+0000","last_clean":"2024-05-11T01:13:58.770853+0000","last_became_active":"2024-05-11T01:13:57.587111+0000","last_became_peered":"2024-05-11T01:13:57.587111+0000","last_unstale":"2024-05-11T01:13:58.770853+0000","last_undegraded":"2024-05-11T01:13:58.770853+0000","last_fullsized":"2024-05-11T01:13:58.770853+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563872+0000","last_change":"2024-05-11T01:13:57.580387+0000","last_active":"2024-05-11T01:13:58.563872+0000","last_peered":"2024-05-11T01:13:58.563872+0000","last_clean":"2024-05-11T01:13:58.563872+0000","last_became_active":"2024-05-11T01:13:57.580071+0000","last_became_peered":"2024-05-11T01:13:57.580071+0000","last_unstale":"2024-05-11T01:13:58.563872+0000","last_undegraded":"2024-05-11T01:13:58.563872+0000","last_fullsized":"2024-05-11T01:13:58.563872+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:23:20.774634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563839+0000","last_change":"2024-05-11T01:13:57.591548+0000","last_active":"2024-05-11T01:13:58.563839+0000","last_peered":"2024-05-11T01:13:58.563839+0000","last_clean":"2024-05-11T01:13:58.563839+0000","last_became_active":"2024-05-11T01:13:57.591258+0000","last_became_peered":"2024-05-11T01:13:57.591258+0000","last_unstale":"2024-05-11T01:13:58.563839+0000","last_undegraded":"2024-05-11T01:13:58.563839+0000","last_fullsized":"2024-05-11T01:13:58.563839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:35:06.829596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771447+0000","last_change":"2024-05-11T01:13:57.587536+0000","last_active":"2024-05-11T01:13:58.771447+0000","last_peered":"2024-05-11T01:13:58.771447+0000","last_clean":"2024-05-11T01:13:58.771447+0000","last_became_active":"2024-05-11T01:13:57.587071+0000","last_became_peered":"2024-05-11T01:13:57.587071+0000","last_unstale":"2024-05-11T01:13:58.771447+0000","last_undegraded":"2024-05-11T01:13:58.771447+0000","last_fullsized":"2024-05-11T01:13:58.771447+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:23:18.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770687+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:13:58.770687+0000","last_peered":"2024-05-11T01:13:58.770687+0000","last_clean":"2024-05-11T01:13:58.770687+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:13:58.770687+0000","last_undegraded":"2024-05-11T01:13:58.770687+0000","last_fullsized":"2024-05-11T01:13:58.770687+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577524+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:13:58.577524+0000","last_peered":"2024-05-11T01:13:58.577524+0000","last_clean":"2024-05-11T01:13:58.577524+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:13:58.577524+0000","last_undegraded":"2024-05-11T01:13:58.577524+0000","last_fullsized":"2024-05-11T01:13:58.577524+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562275+0000","last_change":"2024-05-11T01:13:57.585351+0000","last_active":"2024-05-11T01:13:58.562275+0000","last_peered":"2024-05-11T01:13:58.562275+0000","last_clean":"2024-05-11T01:13:58.562275+0000","last_became_active":"2024-05-11T01:13:57.585036+0000","last_became_peered":"2024-05-11T01:13:57.585036+0000","last_unstale":"2024-05-11T01:13:58.562275+0000","last_undegraded":"2024-05-11T01:13:58.562275+0000","last_fullsized":"2024-05-11T01:13:58.562275+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771474+0000","last_change":"2024-05-11T01:13:57.579302+0000","last_active":"2024-05-11T01:13:58.771474+0000","last_peered":"2024-05-11T01:13:58.771474+0000","last_clean":"2024-05-11T01:13:58.771474+0000","last_became_active":"2024-05-11T01:13:57.578993+0000","last_became_peered":"2024-05-11T01:13:57.578993+0000","last_unstale":"2024-05-11T01:13:58.771474+0000","last_undegraded":"2024-05-11T01:13:58.771474+0000","last_fullsized":"2024-05-11T01:13:58.771474+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771101+0000","last_change":"2024-05-11T01:13:57.578977+0000","last_active":"2024-05-11T01:13:58.771101+0000","last_peered":"2024-05-11T01:13:58.771101+0000","last_clean":"2024-05-11T01:13:58.771101+0000","last_became_active":"2024-05-11T01:13:57.578695+0000","last_became_peered":"2024-05-11T01:13:57.578695+0000","last_unstale":"2024-05-11T01:13:58.771101+0000","last_undegraded":"2024-05-11T01:13:58.771101+0000","last_fullsized":"2024-05-11T01:13:58.771101+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771517+0000","last_change":"2024-05-11T01:13:57.577301+0000","last_active":"2024-05-11T01:13:58.771517+0000","last_peered":"2024-05-11T01:13:58.771517+0000","last_clean":"2024-05-11T01:13:58.771517+0000","last_became_active":"2024-05-11T01:13:57.576996+0000","last_became_peered":"2024-05-11T01:13:57.576996+0000","last_unstale":"2024-05-11T01:13:58.771517+0000","last_undegraded":"2024-05-11T01:13:58.771517+0000","last_fullsized":"2024-05-11T01:13:58.771517+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770272+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:13:58.770272+0000","last_peered":"2024-05-11T01:13:58.770272+0000","last_clean":"2024-05-11T01:13:58.770272+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:13:58.770272+0000","last_undegraded":"2024-05-11T01:13:58.770272+0000","last_fullsized":"2024-05-11T01:13:58.770272+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564253+0000","last_change":"2024-05-11T01:13:57.577630+0000","last_active":"2024-05-11T01:13:58.564253+0000","last_peered":"2024-05-11T01:13:58.564253+0000","last_clean":"2024-05-11T01:13:58.564253+0000","last_became_active":"2024-05-11T01:13:57.577363+0000","last_became_peered":"2024-05-11T01:13:57.577363+0000","last_unstale":"2024-05-11T01:13:58.564253+0000","last_undegraded":"2024-05-11T01:13:58.564253+0000","last_fullsized":"2024-05-11T01:13:58.564253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:45:17.071449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771331+0000","last_change":"2024-05-11T01:13:57.584410+0000","last_active":"2024-05-11T01:13:58.771331+0000","last_peered":"2024-05-11T01:13:58.771331+0000","last_clean":"2024-05-11T01:13:58.771331+0000","last_became_active":"2024-05-11T01:13:57.584164+0000","last_became_peered":"2024-05-11T01:13:57.584164+0000","last_unstale":"2024-05-11T01:13:58.771331+0000","last_undegraded":"2024-05-11T01:13:58.771331+0000","last_fullsized":"2024-05-11T01:13:58.771331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:57.382038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771299+0000","last_change":"2024-05-11T01:13:57.576284+0000","last_active":"2024-05-11T01:13:58.771299+0000","last_peered":"2024-05-11T01:13:58.771299+0000","last_clean":"2024-05-11T01:13:58.771299+0000","last_became_active":"2024-05-11T01:13:57.575987+0000","last_became_peered":"2024-05-11T01:13:57.575987+0000","last_unstale":"2024-05-11T01:13:58.771299+0000","last_undegraded":"2024-05-11T01:13:58.771299+0000","last_fullsized":"2024-05-11T01:13:58.771299+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563409+0000","last_change":"2024-05-11T01:13:57.577419+0000","last_active":"2024-05-11T01:13:58.563409+0000","last_peered":"2024-05-11T01:13:58.563409+0000","last_clean":"2024-05-11T01:13:58.563409+0000","last_became_active":"2024-05-11T01:13:57.576839+0000","last_became_peered":"2024-05-11T01:13:57.576839+0000","last_unstale":"2024-05-11T01:13:58.563409+0000","last_undegraded":"2024-05-11T01:13:58.563409+0000","last_fullsized":"2024-05-11T01:13:58.563409+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:40:40.812341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577125+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:13:58.577125+0000","last_peered":"2024-05-11T01:13:58.577125+0000","last_clean":"2024-05-11T01:13:58.577125+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:13:58.577125+0000","last_undegraded":"2024-05-11T01:13:58.577125+0000","last_fullsized":"2024-05-11T01:13:58.577125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770214+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:13:58.770214+0000","last_peered":"2024-05-11T01:13:58.770214+0000","last_clean":"2024-05-11T01:13:58.770214+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:13:58.770214+0000","last_undegraded":"2024-05-11T01:13:58.770214+0000","last_fullsized":"2024-05-11T01:13:58.770214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770663+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:13:58.770663+0000","last_peered":"2024-05-11T01:13:58.770663+0000","last_clean":"2024-05-11T01:13:58.770663+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:13:58.770663+0000","last_undegraded":"2024-05-11T01:13:58.770663+0000","last_fullsized":"2024-05-11T01:13:58.770663+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":18,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577582+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:13:58.577582+0000","last_peered":"2024-05-11T01:13:58.577582+0000","last_clean":"2024-05-11T01:13:58.577582+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:13:58.577582+0000","last_undegraded":"2024-05-11T01:13:58.577582+0000","last_fullsized":"2024-05-11T01:13:58.577582+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771508+0000","last_change":"2024-05-11T01:13:57.572345+0000","last_active":"2024-05-11T01:13:58.771508+0000","last_peered":"2024-05-11T01:13:58.771508+0000","last_clean":"2024-05-11T01:13:58.771508+0000","last_became_active":"2024-05-11T01:13:57.572038+0000","last_became_peered":"2024-05-11T01:13:57.572038+0000","last_unstale":"2024-05-11T01:13:58.771508+0000","last_undegraded":"2024-05-11T01:13:58.771508+0000","last_fullsized":"2024-05-11T01:13:58.771508+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564040+0000","last_change":"2024-05-11T01:13:56.576801+0000","last_active":"2024-05-11T01:13:58.564040+0000","last_peered":"2024-05-11T01:13:58.564040+0000","last_clean":"2024-05-11T01:13:58.564040+0000","last_became_active":"2024-05-11T01:13:56.576512+0000","last_became_peered":"2024-05-11T01:13:56.576512+0000","last_unstale":"2024-05-11T01:13:58.564040+0000","last_undegraded":"2024-05-11T01:13:58.564040+0000","last_fullsized":"2024-05-11T01:13:58.564040+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771482+0000","last_change":"2024-05-11T01:13:57.576538+0000","last_active":"2024-05-11T01:13:58.771482+0000","last_peered":"2024-05-11T01:13:58.771482+0000","last_clean":"2024-05-11T01:13:58.771482+0000","last_became_active":"2024-05-11T01:13:57.576234+0000","last_became_peered":"2024-05-11T01:13:57.576234+0000","last_unstale":"2024-05-11T01:13:58.771482+0000","last_undegraded":"2024-05-11T01:13:58.771482+0000","last_fullsized":"2024-05-11T01:13:58.771482+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:05:14.944546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770480+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:13:58.770480+0000","last_peered":"2024-05-11T01:13:58.770480+0000","last_clean":"2024-05-11T01:13:58.770480+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:13:58.770480+0000","last_undegraded":"2024-05-11T01:13:58.770480+0000","last_fullsized":"2024-05-11T01:13:58.770480+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770562+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:13:58.770562+0000","last_peered":"2024-05-11T01:13:58.770562+0000","last_clean":"2024-05-11T01:13:58.770562+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:13:58.770562+0000","last_undegraded":"2024-05-11T01:13:58.770562+0000","last_fullsized":"2024-05-11T01:13:58.770562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564250+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:13:58.564250+0000","last_peered":"2024-05-11T01:13:58.564250+0000","last_clean":"2024-05-11T01:13:58.564250+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:13:58.564250+0000","last_undegraded":"2024-05-11T01:13:58.564250+0000","last_fullsized":"2024-05-11T01:13:58.564250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563408+0000","last_change":"2024-05-11T01:13:57.578580+0000","last_active":"2024-05-11T01:13:58.563408+0000","last_peered":"2024-05-11T01:13:58.563408+0000","last_clean":"2024-05-11T01:13:58.563408+0000","last_became_active":"2024-05-11T01:13:57.578287+0000","last_became_peered":"2024-05-11T01:13:57.578287+0000","last_unstale":"2024-05-11T01:13:58.563408+0000","last_undegraded":"2024-05-11T01:13:58.563408+0000","last_fullsized":"2024-05-11T01:13:58.563408+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:39:09.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577406+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:13:58.577406+0000","last_peered":"2024-05-11T01:13:58.577406+0000","last_clean":"2024-05-11T01:13:58.577406+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:13:58.577406+0000","last_undegraded":"2024-05-11T01:13:58.577406+0000","last_fullsized":"2024-05-11T01:13:58.577406+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562705+0000","last_change":"2024-05-11T01:13:57.591245+0000","last_active":"2024-05-11T01:13:58.562705+0000","last_peered":"2024-05-11T01:13:58.562705+0000","last_clean":"2024-05-11T01:13:58.562705+0000","last_became_active":"2024-05-11T01:13:57.590734+0000","last_became_peered":"2024-05-11T01:13:57.590734+0000","last_unstale":"2024-05-11T01:13:58.562705+0000","last_undegraded":"2024-05-11T01:13:58.562705+0000","last_fullsized":"2024-05-11T01:13:58.562705+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563477+0000","last_change":"2024-05-11T01:13:56.574294+0000","last_active":"2024-05-11T01:13:58.563477+0000","last_peered":"2024-05-11T01:13:58.563477+0000","last_clean":"2024-05-11T01:13:58.563477+0000","last_became_active":"2024-05-11T01:13:56.574005+0000","last_became_peered":"2024-05-11T01:13:56.574005+0000","last_unstale":"2024-05-11T01:13:58.563477+0000","last_undegraded":"2024-05-11T01:13:58.563477+0000","last_fullsized":"2024-05-11T01:13:58.563477+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:10:19.793450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562191+0000","last_change":"2024-05-11T01:13:57.584809+0000","last_active":"2024-05-11T01:13:58.562191+0000","last_peered":"2024-05-11T01:13:58.562191+0000","last_clean":"2024-05-11T01:13:58.562191+0000","last_became_active":"2024-05-11T01:13:57.584406+0000","last_became_peered":"2024-05-11T01:13:57.584406+0000","last_unstale":"2024-05-11T01:13:58.562191+0000","last_undegraded":"2024-05-11T01:13:58.562191+0000","last_fullsized":"2024-05-11T01:13:58.562191+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770587+0000","last_change":"2024-05-11T01:13:56.573597+0000","last_active":"2024-05-11T01:13:58.770587+0000","last_peered":"2024-05-11T01:13:58.770587+0000","last_clean":"2024-05-11T01:13:58.770587+0000","last_became_active":"2024-05-11T01:13:56.573279+0000","last_became_peered":"2024-05-11T01:13:56.573279+0000","last_unstale":"2024-05-11T01:13:58.770587+0000","last_undegraded":"2024-05-11T01:13:58.770587+0000","last_fullsized":"2024-05-11T01:13:58.770587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:16:43.996372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771264+0000","last_change":"2024-05-11T01:13:57.579325+0000","last_active":"2024-05-11T01:13:58.771264+0000","last_peered":"2024-05-11T01:13:58.771264+0000","last_clean":"2024-05-11T01:13:58.771264+0000","last_became_active":"2024-05-11T01:13:57.578950+0000","last_became_peered":"2024-05-11T01:13:57.578950+0000","last_unstale":"2024-05-11T01:13:58.771264+0000","last_undegraded":"2024-05-11T01:13:58.771264+0000","last_fullsized":"2024-05-11T01:13:58.771264+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562362+0000","last_change":"2024-05-11T01:13:56.572658+0000","last_active":"2024-05-11T01:13:58.562362+0000","last_peered":"2024-05-11T01:13:58.562362+0000","last_clean":"2024-05-11T01:13:58.562362+0000","last_became_active":"2024-05-11T01:13:56.572329+0000","last_became_peered":"2024-05-11T01:13:56.572329+0000","last_unstale":"2024-05-11T01:13:58.562362+0000","last_undegraded":"2024-05-11T01:13:58.562362+0000","last_fullsized":"2024-05-11T01:13:58.562362+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:07:43.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563987+0000","last_change":"2024-05-11T01:13:57.590749+0000","last_active":"2024-05-11T01:13:58.563987+0000","last_peered":"2024-05-11T01:13:58.563987+0000","last_clean":"2024-05-11T01:13:58.563987+0000","last_became_active":"2024-05-11T01:13:57.590241+0000","last_became_peered":"2024-05-11T01:13:57.590241+0000","last_unstale":"2024-05-11T01:13:58.563987+0000","last_undegraded":"2024-05-11T01:13:58.563987+0000","last_fullsized":"2024-05-11T01:13:58.563987+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:07:21.860466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563892+0000","last_change":"2024-05-11T01:13:56.571495+0000","last_active":"2024-05-11T01:13:58.563892+0000","last_peered":"2024-05-11T01:13:58.563892+0000","last_clean":"2024-05-11T01:13:58.563892+0000","last_became_active":"2024-05-11T01:13:56.571211+0000","last_became_peered":"2024-05-11T01:13:56.571211+0000","last_unstale":"2024-05-11T01:13:58.563892+0000","last_undegraded":"2024-05-11T01:13:58.563892+0000","last_fullsized":"2024-05-11T01:13:58.563892+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:26:54.553975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564783+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:13:58.564783+0000","last_peered":"2024-05-11T01:13:58.564783+0000","last_clean":"2024-05-11T01:13:58.564783+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:13:58.564783+0000","last_undegraded":"2024-05-11T01:13:58.564783+0000","last_fullsized":"2024-05-11T01:13:58.564783+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562823+0000","last_change":"2024-05-11T01:13:56.576731+0000","last_active":"2024-05-11T01:13:58.562823+0000","last_peered":"2024-05-11T01:13:58.562823+0000","last_clean":"2024-05-11T01:13:58.562823+0000","last_became_active":"2024-05-11T01:13:56.576163+0000","last_became_peered":"2024-05-11T01:13:56.576163+0000","last_unstale":"2024-05-11T01:13:58.562823+0000","last_undegraded":"2024-05-11T01:13:58.562823+0000","last_fullsized":"2024-05-11T01:13:58.562823+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:38:23.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577509+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:13:58.577509+0000","last_peered":"2024-05-11T01:13:58.577509+0000","last_clean":"2024-05-11T01:13:58.577509+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:13:58.577509+0000","last_undegraded":"2024-05-11T01:13:58.577509+0000","last_fullsized":"2024-05-11T01:13:58.577509+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":17,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564669+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:13:58.564669+0000","last_peered":"2024-05-11T01:13:58.564669+0000","last_clean":"2024-05-11T01:13:58.564669+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:13:58.564669+0000","last_undegraded":"2024-05-11T01:13:58.564669+0000","last_fullsized":"2024-05-11T01:13:58.564669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564550+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:13:58.564550+0000","last_peered":"2024-05-11T01:13:58.564550+0000","last_clean":"2024-05-11T01:13:58.564550+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:13:58.564550+0000","last_undegraded":"2024-05-11T01:13:58.564550+0000","last_fullsized":"2024-05-11T01:13:58.564550+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"58'6","reported_seq":20,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770658+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:13:58.770658+0000","last_peered":"2024-05-11T01:13:58.770658+0000","last_clean":"2024-05-11T01:13:58.770658+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:13:58.770658+0000","last_undegraded":"2024-05-11T01:13:58.770658+0000","last_fullsized":"2024-05-11T01:13:58.770658+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771149+0000","last_change":"2024-05-11T01:13:57.587446+0000","last_active":"2024-05-11T01:13:58.771149+0000","last_peered":"2024-05-11T01:13:58.771149+0000","last_clean":"2024-05-11T01:13:58.771149+0000","last_became_active":"2024-05-11T01:13:57.587034+0000","last_became_peered":"2024-05-11T01:13:57.587034+0000","last_unstale":"2024-05-11T01:13:58.771149+0000","last_undegraded":"2024-05-11T01:13:58.771149+0000","last_fullsized":"2024-05-11T01:13:58.771149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:51.169562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577530+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:13:58.577530+0000","last_peered":"2024-05-11T01:13:58.577530+0000","last_clean":"2024-05-11T01:13:58.577530+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:13:58.577530+0000","last_undegraded":"2024-05-11T01:13:58.577530+0000","last_fullsized":"2024-05-11T01:13:58.577530+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562794+0000","last_change":"2024-05-11T01:13:57.589755+0000","last_active":"2024-05-11T01:13:58.562794+0000","last_peered":"2024-05-11T01:13:58.562794+0000","last_clean":"2024-05-11T01:13:58.562794+0000","last_became_active":"2024-05-11T01:13:57.589439+0000","last_became_peered":"2024-05-11T01:13:57.589439+0000","last_unstale":"2024-05-11T01:13:58.562794+0000","last_undegraded":"2024-05-11T01:13:58.562794+0000","last_fullsized":"2024-05-11T01:13:58.562794+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564439+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:13:58.564439+0000","last_peered":"2024-05-11T01:13:58.564439+0000","last_clean":"2024-05-11T01:13:58.564439+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:13:58.564439+0000","last_undegraded":"2024-05-11T01:13:58.564439+0000","last_fullsized":"2024-05-11T01:13:58.564439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577095+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:13:58.577095+0000","last_peered":"2024-05-11T01:13:58.577095+0000","last_clean":"2024-05-11T01:13:58.577095+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:13:58.577095+0000","last_undegraded":"2024-05-11T01:13:58.577095+0000","last_fullsized":"2024-05-11T01:13:58.577095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577171+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:13:58.577171+0000","last_peered":"2024-05-11T01:13:58.577171+0000","last_clean":"2024-05-11T01:13:58.577171+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:13:58.577171+0000","last_undegraded":"2024-05-11T01:13:58.577171+0000","last_fullsized":"2024-05-11T01:13:58.577171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564660+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:13:58.564660+0000","last_peered":"2024-05-11T01:13:58.564660+0000","last_clean":"2024-05-11T01:13:58.564660+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:13:58.564660+0000","last_undegraded":"2024-05-11T01:13:58.564660+0000","last_fullsized":"2024-05-11T01:13:58.564660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"58'8","reported_seq":22,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562257+0000","last_change":"2024-05-11T01:13:56.576267+0000","last_active":"2024-05-11T01:13:58.562257+0000","last_peered":"2024-05-11T01:13:58.562257+0000","last_clean":"2024-05-11T01:13:58.562257+0000","last_became_active":"2024-05-11T01:13:56.575422+0000","last_became_peered":"2024-05-11T01:13:56.575422+0000","last_unstale":"2024-05-11T01:13:58.562257+0000","last_undegraded":"2024-05-11T01:13:58.562257+0000","last_fullsized":"2024-05-11T01:13:58.562257+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:46:03.149087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770434+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:13:58.770434+0000","last_peered":"2024-05-11T01:13:58.770434+0000","last_clean":"2024-05-11T01:13:58.770434+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:13:58.770434+0000","last_undegraded":"2024-05-11T01:13:58.770434+0000","last_fullsized":"2024-05-11T01:13:58.770434+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770133+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:13:58.770133+0000","last_peered":"2024-05-11T01:13:58.770133+0000","last_clean":"2024-05-11T01:13:58.770133+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:13:58.770133+0000","last_undegraded":"2024-05-11T01:13:58.770133+0000","last_fullsized":"2024-05-11T01:13:58.770133+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562659+0000","last_change":"2024-05-11T01:13:57.589024+0000","last_active":"2024-05-11T01:13:58.562659+0000","last_peered":"2024-05-11T01:13:58.562659+0000","last_clean":"2024-05-11T01:13:58.562659+0000","last_became_active":"2024-05-11T01:13:57.588641+0000","last_became_peered":"2024-05-11T01:13:57.588641+0000","last_unstale":"2024-05-11T01:13:58.562659+0000","last_undegraded":"2024-05-11T01:13:58.562659+0000","last_fullsized":"2024-05-11T01:13:58.562659+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564077+0000","last_change":"2024-05-11T01:13:56.571741+0000","last_active":"2024-05-11T01:13:58.564077+0000","last_peered":"2024-05-11T01:13:58.564077+0000","last_clean":"2024-05-11T01:13:58.564077+0000","last_became_active":"2024-05-11T01:13:56.571143+0000","last_became_peered":"2024-05-11T01:13:56.571143+0000","last_unstale":"2024-05-11T01:13:58.564077+0000","last_undegraded":"2024-05-11T01:13:58.564077+0000","last_fullsized":"2024-05-11T01:13:58.564077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771112+0000","last_change":"2024-05-11T01:13:57.573076+0000","last_active":"2024-05-11T01:13:58.771112+0000","last_peered":"2024-05-11T01:13:58.771112+0000","last_clean":"2024-05-11T01:13:58.771112+0000","last_became_active":"2024-05-11T01:13:57.572777+0000","last_became_peered":"2024-05-11T01:13:57.572777+0000","last_unstale":"2024-05-11T01:13:58.771112+0000","last_undegraded":"2024-05-11T01:13:58.771112+0000","last_fullsized":"2024-05-11T01:13:58.771112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"58'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771281+0000","last_change":"2024-05-11T01:13:56.573996+0000","last_active":"2024-05-11T01:13:58.771281+0000","last_peered":"2024-05-11T01:13:58.771281+0000","last_clean":"2024-05-11T01:13:58.771281+0000","last_became_active":"2024-05-11T01:13:56.573737+0000","last_became_peered":"2024-05-11T01:13:56.573737+0000","last_unstale":"2024-05-11T01:13:58.771281+0000","last_undegraded":"2024-05-11T01:13:58.771281+0000","last_fullsized":"2024-05-11T01:13:58.771281+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771257+0000","last_change":"2024-05-11T01:13:57.577270+0000","last_active":"2024-05-11T01:13:58.771257+0000","last_peered":"2024-05-11T01:13:58.771257+0000","last_clean":"2024-05-11T01:13:58.771257+0000","last_became_active":"2024-05-11T01:13:57.576978+0000","last_became_peered":"2024-05-11T01:13:57.576978+0000","last_unstale":"2024-05-11T01:13:58.771257+0000","last_undegraded":"2024-05-11T01:13:58.771257+0000","last_fullsized":"2024-05-11T01:13:58.771257+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577418+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:13:58.577418+0000","last_peered":"2024-05-11T01:13:58.577418+0000","last_clean":"2024-05-11T01:13:58.577418+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:13:58.577418+0000","last_undegraded":"2024-05-11T01:13:58.577418+0000","last_fullsized":"2024-05-11T01:13:58.577418+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577260+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:13:58.577260+0000","last_peered":"2024-05-11T01:13:58.577260+0000","last_clean":"2024-05-11T01:13:58.577260+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:13:58.577260+0000","last_undegraded":"2024-05-11T01:13:58.577260+0000","last_fullsized":"2024-05-11T01:13:58.577260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577637+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:13:58.577637+0000","last_peered":"2024-05-11T01:13:58.577637+0000","last_clean":"2024-05-11T01:13:58.577637+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:13:58.577637+0000","last_undegraded":"2024-05-11T01:13:58.577637+0000","last_fullsized":"2024-05-11T01:13:58.577637+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770279+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:13:58.770279+0000","last_peered":"2024-05-11T01:13:58.770279+0000","last_clean":"2024-05-11T01:13:58.770279+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:13:58.770279+0000","last_undegraded":"2024-05-11T01:13:58.770279+0000","last_fullsized":"2024-05-11T01:13:58.770279+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770839+0000","last_change":"2024-05-11T01:13:56.581631+0000","last_active":"2024-05-11T01:13:58.770839+0000","last_peered":"2024-05-11T01:13:58.770839+0000","last_clean":"2024-05-11T01:13:58.770839+0000","last_became_active":"2024-05-11T01:13:56.581299+0000","last_became_peered":"2024-05-11T01:13:56.581299+0000","last_unstale":"2024-05-11T01:13:58.770839+0000","last_undegraded":"2024-05-11T01:13:58.770839+0000","last_fullsized":"2024-05-11T01:13:58.770839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:35:01.793210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770387+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:13:58.770387+0000","last_peered":"2024-05-11T01:13:58.770387+0000","last_clean":"2024-05-11T01:13:58.770387+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:13:58.770387+0000","last_undegraded":"2024-05-11T01:13:58.770387+0000","last_fullsized":"2024-05-11T01:13:58.770387+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562241+0000","last_change":"2024-05-11T01:13:56.575003+0000","last_active":"2024-05-11T01:13:58.562241+0000","last_peered":"2024-05-11T01:13:58.562241+0000","last_clean":"2024-05-11T01:13:58.562241+0000","last_became_active":"2024-05-11T01:13:56.574726+0000","last_became_peered":"2024-05-11T01:13:56.574726+0000","last_unstale":"2024-05-11T01:13:58.562241+0000","last_undegraded":"2024-05-11T01:13:58.562241+0000","last_fullsized":"2024-05-11T01:13:58.562241+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:15:10.911003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562612+0000","last_change":"2024-05-11T01:13:57.576056+0000","last_active":"2024-05-11T01:13:58.562612+0000","last_peered":"2024-05-11T01:13:58.562612+0000","last_clean":"2024-05-11T01:13:58.562612+0000","last_became_active":"2024-05-11T01:13:57.575723+0000","last_became_peered":"2024-05-11T01:13:57.575723+0000","last_unstale":"2024-05-11T01:13:58.562612+0000","last_undegraded":"2024-05-11T01:13:58.562612+0000","last_fullsized":"2024-05-11T01:13:58.562612+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:23:18.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563506+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:13:58.563506+0000","last_peered":"2024-05-11T01:13:58.563506+0000","last_clean":"2024-05-11T01:13:58.563506+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:13:58.563506+0000","last_undegraded":"2024-05-11T01:13:58.563506+0000","last_fullsized":"2024-05-11T01:13:58.563506+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771614+0000","last_change":"2024-05-11T01:13:57.587557+0000","last_active":"2024-05-11T01:13:58.771614+0000","last_peered":"2024-05-11T01:13:58.771614+0000","last_clean":"2024-05-11T01:13:58.771614+0000","last_became_active":"2024-05-11T01:13:57.587255+0000","last_became_peered":"2024-05-11T01:13:57.587255+0000","last_unstale":"2024-05-11T01:13:58.771614+0000","last_undegraded":"2024-05-11T01:13:58.771614+0000","last_fullsized":"2024-05-11T01:13:58.771614+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"59'1","reported_seq":15,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577560+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:13:58.577560+0000","last_peered":"2024-05-11T01:13:58.577560+0000","last_clean":"2024-05-11T01:13:58.577560+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:13:58.577560+0000","last_undegraded":"2024-05-11T01:13:58.577560+0000","last_fullsized":"2024-05-11T01:13:58.577560+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562583+0000","last_change":"2024-05-11T01:13:57.588129+0000","last_active":"2024-05-11T01:13:58.562583+0000","last_peered":"2024-05-11T01:13:58.562583+0000","last_clean":"2024-05-11T01:13:58.562583+0000","last_became_active":"2024-05-11T01:13:57.577948+0000","last_became_peered":"2024-05-11T01:13:57.577948+0000","last_unstale":"2024-05-11T01:13:58.562583+0000","last_undegraded":"2024-05-11T01:13:58.562583+0000","last_fullsized":"2024-05-11T01:13:58.562583+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564780+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:13:58.564780+0000","last_peered":"2024-05-11T01:13:58.564780+0000","last_clean":"2024-05-11T01:13:58.564780+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:13:58.564780+0000","last_undegraded":"2024-05-11T01:13:58.564780+0000","last_fullsized":"2024-05-11T01:13:58.564780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564800+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:13:58.564800+0000","last_peered":"2024-05-11T01:13:58.564800+0000","last_clean":"2024-05-11T01:13:58.564800+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:13:58.564800+0000","last_undegraded":"2024-05-11T01:13:58.564800+0000","last_fullsized":"2024-05-11T01:13:58.564800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770337+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:13:58.770337+0000","last_peered":"2024-05-11T01:13:58.770337+0000","last_clean":"2024-05-11T01:13:58.770337+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:13:58.770337+0000","last_undegraded":"2024-05-11T01:13:58.770337+0000","last_fullsized":"2024-05-11T01:13:58.770337+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577410+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:13:58.577410+0000","last_peered":"2024-05-11T01:13:58.577410+0000","last_clean":"2024-05-11T01:13:58.577410+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:13:58.577410+0000","last_undegraded":"2024-05-11T01:13:58.577410+0000","last_fullsized":"2024-05-11T01:13:58.577410+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564554+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:13:58.564554+0000","last_peered":"2024-05-11T01:13:58.564554+0000","last_clean":"2024-05-11T01:13:58.564554+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:13:58.564554+0000","last_undegraded":"2024-05-11T01:13:58.564554+0000","last_fullsized":"2024-05-11T01:13:58.564554+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.577348+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:13:58.577348+0000","last_peered":"2024-05-11T01:13:58.577348+0000","last_clean":"2024-05-11T01:13:58.577348+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:13:58.577348+0000","last_undegraded":"2024-05-11T01:13:58.577348+0000","last_fullsized":"2024-05-11T01:13:58.577348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563516+0000","last_change":"2024-05-11T01:13:56.573647+0000","last_active":"2024-05-11T01:13:58.563516+0000","last_peered":"2024-05-11T01:13:58.563516+0000","last_clean":"2024-05-11T01:13:58.563516+0000","last_became_active":"2024-05-11T01:13:56.573347+0000","last_became_peered":"2024-05-11T01:13:56.573347+0000","last_unstale":"2024-05-11T01:13:58.563516+0000","last_undegraded":"2024-05-11T01:13:58.563516+0000","last_fullsized":"2024-05-11T01:13:58.563516+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:47:34.803535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770770+0000","last_change":"2024-05-11T01:13:57.582673+0000","last_active":"2024-05-11T01:13:58.770770+0000","last_peered":"2024-05-11T01:13:58.770770+0000","last_clean":"2024-05-11T01:13:58.770770+0000","last_became_active":"2024-05-11T01:13:57.582398+0000","last_became_peered":"2024-05-11T01:13:57.582398+0000","last_unstale":"2024-05-11T01:13:58.770770+0000","last_undegraded":"2024-05-11T01:13:58.770770+0000","last_fullsized":"2024-05-11T01:13:58.770770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:53:00.000306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.770171+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:13:58.770171+0000","last_peered":"2024-05-11T01:13:58.770171+0000","last_clean":"2024-05-11T01:13:58.770171+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:13:58.770171+0000","last_undegraded":"2024-05-11T01:13:58.770171+0000","last_fullsized":"2024-05-11T01:13:58.770171+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.563435+0000","last_change":"2024-05-11T01:13:57.575506+0000","last_active":"2024-05-11T01:13:58.563435+0000","last_peered":"2024-05-11T01:13:58.563435+0000","last_clean":"2024-05-11T01:13:58.563435+0000","last_became_active":"2024-05-11T01:13:57.575239+0000","last_became_peered":"2024-05-11T01:13:57.575239+0000","last_unstale":"2024-05-11T01:13:58.563435+0000","last_undegraded":"2024-05-11T01:13:58.563435+0000","last_fullsized":"2024-05-11T01:13:58.563435+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:33:02.113131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562361+0000","last_change":"2024-05-11T01:13:56.576345+0000","last_active":"2024-05-11T01:13:58.562361+0000","last_peered":"2024-05-11T01:13:58.562361+0000","last_clean":"2024-05-11T01:13:58.562361+0000","last_became_active":"2024-05-11T01:13:56.575838+0000","last_became_peered":"2024-05-11T01:13:56.575838+0000","last_unstale":"2024-05-11T01:13:58.562361+0000","last_undegraded":"2024-05-11T01:13:58.562361+0000","last_fullsized":"2024-05-11T01:13:58.562361+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:51.632315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.562811+0000","last_change":"2024-05-11T01:13:57.588794+0000","last_active":"2024-05-11T01:13:58.562811+0000","last_peered":"2024-05-11T01:13:58.562811+0000","last_clean":"2024-05-11T01:13:58.562811+0000","last_became_active":"2024-05-11T01:13:57.586986+0000","last_became_peered":"2024-05-11T01:13:57.586986+0000","last_unstale":"2024-05-11T01:13:58.562811+0000","last_undegraded":"2024-05-11T01:13:58.562811+0000","last_fullsized":"2024-05-11T01:13:58.562811+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:00:28.690447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"58'2","reported_seq":16,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.771572+0000","last_change":"2024-05-11T01:13:56.579830+0000","last_active":"2024-05-11T01:13:58.771572+0000","last_peered":"2024-05-11T01:13:58.771572+0000","last_clean":"2024-05-11T01:13:58.771572+0000","last_became_active":"2024-05-11T01:13:56.579637+0000","last_became_peered":"2024-05-11T01:13:56.579637+0000","last_unstale":"2024-05-11T01:13:58.771572+0000","last_undegraded":"2024-05-11T01:13:58.771572+0000","last_fullsized":"2024-05-11T01:13:58.771572+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":244,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-05-11T01:13:58.564343+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:13:58.564343+0000","last_peered":"2024-05-11T01:13:58.564343+0000","last_clean":"2024-05-11T01:13:58.564343+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:13:58.564343+0000","last_undegraded":"2024-05-11T01:13:58.564343+0000","last_fullsized":"2024-05-11T01:13:58.564343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":919624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":708608,"data_stored":329838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":704512,"data_stored":329236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54088,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317752,"statfs":{"total":96636764160,"available":96581378048,"internally_reserved":0,"allocated":712704,"data_stored":330778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40204,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331636,"statfs":{"total":96636764160,"available":96595595264,"internally_reserved":0,"allocated":712704,"data_stored":329804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44360,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327480,"statfs":{"total":96636764160,"available":96591339520,"internally_reserved":0,"allocated":716800,"data_stored":330800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58240,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313600,"statfs":{"total":96636764160,"available":96577126400,"internally_reserved":0,"allocated":704512,"data_stored":329236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575006,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1298432,"data_stored":919568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:14:06.448 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-11T01:14:06.448 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-11T01:14:06.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.594+0000 7f6f925f7640 1 Processor -- start 2024-05-11T01:14:06.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.594+0000 7f6f925f7640 1 -- start start 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.595+0000 7f6f925f7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f8c15f4f0 0x7f6f8c0bad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.595+0000 7f6f925f7640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c0d61b0 con 0x7f6f8c0d2370 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.595+0000 7f6f925f7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c1632b0 con 0x7f6f8c0d4ac0 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.595+0000 7f6f925f7640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8c163060 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.595+0000 7f6f8bfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f8c15f4f0 0x7f6f8c0bad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.595+0000 7f6f83fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6f8c0d2370 0x7f6f8c0d5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32942/0 (socket says 172.21.15.16:32942) 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.595+0000 7f6f83fff640 1 -- 172.21.15.16:0/2916842291 learned_addr learned my addr 172.21.15.16:0/2916842291 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.596+0000 7f6f8bfff640 1 -- 172.21.15.16:0/2916842291 >> v1:172.21.15.174:6789/0 conn(0x7f6f8c0d4ac0 legacy=0x7f6f8c0d5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.596+0000 7f6f8bfff640 1 -- 172.21.15.16:0/2916842291 >> v1:172.21.15.16:6789/0 conn(0x7f6f8c0d2370 legacy=0x7f6f8c0d5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.596+0000 7f6f8bfff640 1 -- 172.21.15.16:0/2916842291 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c163590 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.596+0000 7f6f8b7fe640 1 -- 172.21.15.16:0/2916842291 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102312688 0 0) 0x7f6f8c0d61b0 con 0x7f6f8c0d2370 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.596+0000 7f6f8bfff640 1 --2- 172.21.15.16:0/2916842291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0bad20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0097d0 tx=0x7f6f7c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ed0dc14293cfe8 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f8b7fe640 1 -- 172.21.15.16:0/2916842291 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c037070 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f8b7fe640 1 -- 172.21.15.16:0/2916842291 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7c032440 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f8b7fe640 1 -- 172.21.15.16:0/2916842291 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c032810 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f925f7640 1 -- 172.21.15.16:0/2916842291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 msgr2=0x7f6f8c0bad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f925f7640 1 --2- 172.21.15.16:0/2916842291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0bad20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0097d0 tx=0x7f6f7c02a1c0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f925f7640 1 -- 172.21.15.16:0/2916842291 shutdown_connections 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f925f7640 1 --2- 172.21.15.16:0/2916842291 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0bad20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f925f7640 1 -- 172.21.15.16:0/2916842291 >> 172.21.15.16:0/2916842291 conn(0x7f6f8c073f60 msgr2=0x7f6f8c074370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f925f7640 1 -- 172.21.15.16:0/2916842291 shutdown_connections 2024-05-11T01:14:06.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.597+0000 7f6f925f7640 1 -- 172.21.15.16:0/2916842291 wait complete. 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f925f7640 1 Processor -- start 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f925f7640 1 -- start start 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f925f7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f8c0d2370 0x7f6f8c0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f925f7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f8c0d4ac0 0x7f6f8c0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f925f7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f925f7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c163b50 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f925f7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c163ec0 con 0x7f6f8c0d2370 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f925f7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8c0b4ba0 con 0x7f6f8c0d4ac0 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f90b94640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f90b94640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41842/0 (socket says 172.21.15.16:41842) 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.599+0000 7f6f90b94640 1 -- 172.21.15.16:0/3900555942 learned_addr learned my addr 172.21.15.16:0/3900555942 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f83fff640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f8c0d4ac0 0x7f6f8c0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f8bfff640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f8c0d2370 0x7f6f8c0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f90b94640 1 -- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f8c0d4ac0 msgr2=0x7f6f8c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f90b94640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f8c0d4ac0 0x7f6f8c0ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f90b94640 1 -- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f8c0d2370 msgr2=0x7f6f8c0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f90b94640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f8c0d2370 0x7f6f8c0ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f90b94640 1 -- 172.21.15.16:0/3900555942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c0c9090 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f90b94640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0cd420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400c7b0 tx=0x7f6f8400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f897fa640 1 -- 172.21.15.16:0/3900555942 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f84004b60 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f897fa640 1 -- 172.21.15.16:0/3900555942 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f84004d00 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c0c9370 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f897fa640 1 -- 172.21.15.16:0/3900555942 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400aa90 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.600+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8c0c9930 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.601+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8c06a5b0 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.602+0000 7f6f897fa640 1 -- 172.21.15.16:0/3900555942 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f6f8400ac30 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.602+0000 7f6f897fa640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6f6c0762d0 0x7f6f6c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.602+0000 7f6f897fa640 1 -- 172.21.15.16:0/3900555942 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7f6f84097980 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.603+0000 7f6f8bfff640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6f6c0762d0 0x7f6f6c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.603+0000 7f6f8bfff640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6f6c0762d0 0x7f6f6c078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c034000 tx=0x7f6f7c02e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:06.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.607+0000 7f6f897fa640 1 -- 172.21.15.16:0/3900555942 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6f84020070 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.869+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6f8c15eea0 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.871+0000 7f6f897fa640 1 -- 172.21.15.16:0/3900555942 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f6f84061200 con 0x7f6f8c15f4f0 2024-05-11T01:14:06.871 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-05-11T01:14:06.871 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAlwz5mBE92NxAAwjJJ4BDqTpd7qQZiD1YlYA== 2024-05-11T01:14:06.871 INFO:teuthology.orchestra.run.smithi016.stdout: caps mds = "allow" 2024-05-11T01:14:06.871 INFO:teuthology.orchestra.run.smithi016.stdout: caps mon = "allow r" 2024-05-11T01:14:06.871 INFO:teuthology.orchestra.run.smithi016.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-11T01:14:06.871 INFO:teuthology.orchestra.run.smithi016.stderr:updated caps for client.0 2024-05-11T01:14:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6f6c0762d0 msgr2=0x7f6f6c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6f6c0762d0 0x7f6f6c078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c034000 tx=0x7f6f7c02e000 comp rx=0 tx=0).stop 2024-05-11T01:14:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 msgr2=0x7f6f8c0cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0cd420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400c7b0 tx=0x7f6f8400cc70 comp rx=0 tx=0).stop 2024-05-11T01:14:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 shutdown_connections 2024-05-11T01:14:06.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f8c15f4f0 0x7f6f8c0cd420 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6f8c0d4ac0 0x7f6f8c0ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6f6c0762d0 0x7f6f6c078790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 --2- 172.21.15.16:0/3900555942 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f8c0d2370 0x7f6f8c0ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 >> 172.21.15.16:0/3900555942 conn(0x7f6f8c073f60 msgr2=0x7f6f8c0d3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:06.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 shutdown_connections 2024-05-11T01:14:06.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.873+0000 7f6f925f7640 1 -- 172.21.15.16:0/3900555942 wait complete. 2024-05-11T01:14:06.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:14:06.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.988+0000 7fcc40171640 1 Processor -- start 2024-05-11T01:14:06.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.988+0000 7fcc40171640 1 -- start start 2024-05-11T01:14:06.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc40171640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcc380b2f40 0x7fcc38142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc40171640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3813f850 0x7fcc3813fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc40171640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc38160470 con 0x7fcc380b3320 2024-05-11T01:14:06.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc40171640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcc38160750 con 0x7fcc380b2f40 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc40171640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fcc38160a30 con 0x7fcc3813f850 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3df0d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcc380b2f40 0x7fcc38142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3d70c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcc380b3320 0x7fcc3815fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32944/0 (socket says 172.21.15.16:32944) 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3d70c640 1 -- 172.21.15.16:0/2352262140 learned_addr learned my addr 172.21.15.16:0/2352262140 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3e70e640 1 --2- 172.21.15.16:0/2352262140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3813f850 0x7fcc3813fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3cf0b640 1 -- 172.21.15.16:0/2352262140 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274162613 0 0) 0x7fcc38160470 con 0x7fcc380b3320 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3cf0b640 1 -- 172.21.15.16:0/2352262140 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc24005730 con 0x7fcc380b3320 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3df0d640 1 -- 172.21.15.16:0/2352262140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3813f850 msgr2=0x7fcc3813fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3df0d640 1 --2- 172.21.15.16:0/2352262140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3813f850 0x7fcc3813fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3df0d640 1 -- 172.21.15.16:0/2352262140 >> v1:172.21.15.16:6789/0 conn(0x7fcc380b3320 legacy=0x7fcc3815fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3df0d640 1 -- 172.21.15.16:0/2352262140 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc380738b0 con 0x7fcc380b2f40 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.989+0000 7fcc3e70e640 1 --2- 172.21.15.16:0/2352262140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3813f850 0x7fcc3813fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:14:06.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.990+0000 7fcc3df0d640 1 --2- 172.21.15.16:0/2352262140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38142440 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fcc340097a0 tx=0x7fcc3402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af772ffcb604d5a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:06.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.990+0000 7fcc3cf0b640 1 -- 172.21.15.16:0/2352262140 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34037070 con 0x7fcc380b2f40 2024-05-11T01:14:06.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.990+0000 7fcc3cf0b640 1 -- 172.21.15.16:0/2352262140 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc34032440 con 0x7fcc380b2f40 2024-05-11T01:14:06.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.990+0000 7fcc3cf0b640 1 -- 172.21.15.16:0/2352262140 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34032810 con 0x7fcc380b2f40 2024-05-11T01:14:06.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.991+0000 7fcc40171640 1 -- 172.21.15.16:0/2352262140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 msgr2=0x7fcc38142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.991+0000 7fcc40171640 1 --2- 172.21.15.16:0/2352262140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38142440 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fcc340097a0 tx=0x7fcc3402a180 comp rx=0 tx=0).stop 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.991+0000 7fcc40171640 1 -- 172.21.15.16:0/2352262140 shutdown_connections 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.991+0000 7fcc40171640 1 --2- 172.21.15.16:0/2352262140 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc3813f850 0x7fcc3813fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.991+0000 7fcc40171640 1 --2- 172.21.15.16:0/2352262140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38142440 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.991+0000 7fcc40171640 1 -- 172.21.15.16:0/2352262140 >> 172.21.15.16:0/2352262140 conn(0x7fcc3806fd90 msgr2=0x7fcc3806c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.991+0000 7fcc40171640 1 -- 172.21.15.16:0/2352262140 shutdown_connections 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.991+0000 7fcc40171640 1 -- 172.21.15.16:0/2352262140 wait complete. 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.992+0000 7fcc40171640 1 Processor -- start 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.992+0000 7fcc40171640 1 -- start start 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc40171640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc40171640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc380b3320 0x7fcc38137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc40171640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3813f850 0x7fcc380cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc40171640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38074160 con 0x7fcc380b2f40 2024-05-11T01:14:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc40171640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38073fe0 con 0x7fcc3813f850 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc40171640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fcc380742e0 con 0x7fcc380b3320 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41858/0 (socket says 172.21.15.16:41858) 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 -- 172.21.15.16:0/3968117124 learned_addr learned my addr 172.21.15.16:0/3968117124 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3d70c640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc380b3320 0x7fcc38137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3e70e640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3813f850 0x7fcc380cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 -- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc380b3320 msgr2=0x7fcc38137a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc380b3320 0x7fcc38137a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 -- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3813f850 msgr2=0x7fcc380cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3813f850 0x7fcc380cfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 -- 172.21.15.16:0/3968117124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc38154000 con 0x7fcc380b2f40 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3d70c640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc380b3320 0x7fcc38137a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.993+0000 7fcc3df0d640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38154dc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcc34035040 tx=0x7fcc340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.994+0000 7fcc2e7fc640 1 -- 172.21.15.16:0/3968117124 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34037040 con 0x7fcc380b2f40 2024-05-11T01:14:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.994+0000 7fcc2e7fc640 1 -- 172.21.15.16:0/3968117124 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc34030500 con 0x7fcc380b2f40 2024-05-11T01:14:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.994+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc381542e0 con 0x7fcc380b2f40 2024-05-11T01:14:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.994+0000 7fcc2e7fc640 1 -- 172.21.15.16:0/3968117124 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34030910 con 0x7fcc380b2f40 2024-05-11T01:14:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.994+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc38137f50 con 0x7fcc380b2f40 2024-05-11T01:14:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.995+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc3806a5b0 con 0x7fcc380b2f40 2024-05-11T01:14:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.995+0000 7fcc2e7fc640 1 -- 172.21.15.16:0/3968117124 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fcc34044020 con 0x7fcc380b2f40 2024-05-11T01:14:06.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.996+0000 7fcc2e7fc640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcc1c0762d0 0x7fcc1c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:06.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.996+0000 7fcc2e7fc640 1 -- 172.21.15.16:0/3968117124 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7fcc340b79e0 con 0x7fcc380b2f40 2024-05-11T01:14:06.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.996+0000 7fcc3d70c640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcc1c0762d0 0x7fcc1c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:06.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:06.997+0000 7fcc3d70c640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcc1c0762d0 0x7fcc1c078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc38138320 tx=0x7fcc28009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.000+0000 7fcc2e7fc640 1 -- 172.21.15.16:0/3968117124 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc340811d0 con 0x7fcc380b2f40 2024-05-11T01:14:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.232+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc38073480 con 0x7fcc380b2f40 2024-05-11T01:14:07.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.232+0000 7fcc2e7fc640 1 -- 172.21.15.16:0/3968117124 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5184 (secure 0 0 0) 0x7fcc34080ad0 con 0x7fcc380b2f40 2024-05-11T01:14:07.233 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:14:07.233 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2061855514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2061855514},{"type":"v1","addr":"172.21.15.16:6835","nonce":2061855514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/1304273524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1304273524},{"type":"v1","addr":"172.21.15.174:6836","nonce":1304273524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/878993880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":878993880},{"type":"v1","addr":"172.21.15.174:6837","nonce":878993880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:13:56.948645+0000","modified":"2024-05-11T01:13:59.949604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/3060746236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3060746236},{"type":"v1","addr":"172.21.15.16:6834","nonce":3060746236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5610,"qdb_cluster":[5610]},"id":3}]} 2024-05-11T01:14:07.233 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcc1c0762d0 msgr2=0x7fcc1c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcc1c0762d0 0x7fcc1c078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc38138320 tx=0x7fcc28009040 comp rx=0 tx=0).stop 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 msgr2=0x7fcc38154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38154dc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcc34035040 tx=0x7fcc340046c0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 shutdown_connections 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcc1c0762d0 0x7fcc1c078790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcc3813f850 0x7fcc380cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcc380b3320 0x7fcc38137a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 --2- 172.21.15.16:0/3968117124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc380b2f40 0x7fcc38154dc0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 >> 172.21.15.16:0/3968117124 conn(0x7fcc3806fd90 msgr2=0x7fcc38142040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:07.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 shutdown_connections 2024-05-11T01:14:07.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.234+0000 7fcc40171640 1 -- 172.21.15.16:0/3968117124 wait complete. 2024-05-11T01:14:07.648 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-11T01:13:56.948645+0000', 'modified': '2024-05-11T01:13:59.949604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5610': {'gid': 5610, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6834/3060746236', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 3060746236}, {'type': 'v1', 'addr': '172.21.15.16:6834', 'nonce': 3060746236}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5610, 'qdb_cluster': [5610]} 2024-05-11T01:14:07.648 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-11T01:14:07.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-11T01:14:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.758+0000 7ff47863f640 1 Processor -- start 2024-05-11T01:14:07.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.758+0000 7ff47863f640 1 -- start start 2024-05-11T01:14:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff47863f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff470145ae0 0x7ff47015d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff47863f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4700b33e0 0x7ff4700b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff47863f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff47015c6e0 con 0x7ff4700b4040 2024-05-11T01:14:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff47863f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff47015ccc0 con 0x7ff470145ae0 2024-05-11T01:14:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff47863f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff470145ec0 con 0x7ff4700b33e0 2024-05-11T01:14:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff4763db640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff470145ae0 0x7ff47015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff475bda640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff4700b4040 0x7ff4700b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32956/0 (socket says 172.21.15.16:32956) 2024-05-11T01:14:07.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff475bda640 1 -- 172.21.15.16:0/3127430275 learned_addr learned my addr 172.21.15.16:0/3127430275 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff476bdc640 1 --2- 172.21.15.16:0/3127430275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4700b33e0 0x7ff4700b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff4763db640 1 -- 172.21.15.16:0/3127430275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4700b33e0 msgr2=0x7ff4700b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff4763db640 1 --2- 172.21.15.16:0/3127430275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4700b33e0 0x7ff4700b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff4763db640 1 -- 172.21.15.16:0/3127430275 >> v1:172.21.15.16:6789/0 conn(0x7ff4700b4040 legacy=0x7ff4700b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff4763db640 1 -- 172.21.15.16:0/3127430275 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47015d690 con 0x7ff470145ae0 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff4753d9640 1 -- 172.21.15.16:0/3127430275 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207780887 0 0) 0x7ff47015c6e0 con 0x7ff4700b4040 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.759+0000 7ff476bdc640 1 --2- 172.21.15.16:0/3127430275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4700b33e0 0x7ff4700b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.760+0000 7ff4763db640 1 --2- 172.21.15.16:0/3127430275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff470145ae0 0x7ff47015d150 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0097a0 tx=0x7ff46c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bef58b34d9c73f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.760+0000 7ff4753d9640 1 -- 172.21.15.16:0/3127430275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c037070 con 0x7ff470145ae0 2024-05-11T01:14:07.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.760+0000 7ff4753d9640 1 -- 172.21.15.16:0/3127430275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff46c032440 con 0x7ff470145ae0 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.760+0000 7ff4753d9640 1 -- 172.21.15.16:0/3127430275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c032810 con 0x7ff470145ae0 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.761+0000 7ff47863f640 1 -- 172.21.15.16:0/3127430275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff470145ae0 msgr2=0x7ff47015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.761+0000 7ff47863f640 1 --2- 172.21.15.16:0/3127430275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff470145ae0 0x7ff47015d150 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0097a0 tx=0x7ff46c02a180 comp rx=0 tx=0).stop 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.761+0000 7ff47863f640 1 -- 172.21.15.16:0/3127430275 shutdown_connections 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.761+0000 7ff47863f640 1 --2- 172.21.15.16:0/3127430275 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff4700b33e0 0x7ff4700b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.761+0000 7ff47863f640 1 --2- 172.21.15.16:0/3127430275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff470145ae0 0x7ff47015d150 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.761+0000 7ff47863f640 1 -- 172.21.15.16:0/3127430275 >> 172.21.15.16:0/3127430275 conn(0x7ff47006fd90 msgr2=0x7ff47006c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.761+0000 7ff47863f640 1 -- 172.21.15.16:0/3127430275 shutdown_connections 2024-05-11T01:14:07.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.761+0000 7ff47863f640 1 -- 172.21.15.16:0/3127430275 wait complete. 2024-05-11T01:14:07.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.762+0000 7ff47863f640 1 Processor -- start 2024-05-11T01:14:07.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.762+0000 7ff47863f640 1 -- start start 2024-05-11T01:14:07.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff47863f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4700b33e0 0x7ff47013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff47863f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4700b4040 0x7ff470140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff47863f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff470145ae0 0x7ff47013f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff47863f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff47015c950 con 0x7ff4700b4040 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff47863f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4700b4d70 con 0x7ff4700b33e0 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff47863f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff470073b70 con 0x7ff470145ae0 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4700b4040 0x7ff470140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4700b4040 0x7ff470140880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41876/0 (socket says 172.21.15.16:41876) 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 -- 172.21.15.16:0/1897958842 learned_addr learned my addr 172.21.15.16:0/1897958842 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff476bdc640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff470145ae0 0x7ff47013f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff4763db640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4700b33e0 0x7ff47013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 -- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff470145ae0 msgr2=0x7ff47013f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff470145ae0 0x7ff47013f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 -- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4700b33e0 msgr2=0x7ff47013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4700b33e0 0x7ff47013d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 -- 172.21.15.16:0/1897958842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47013e230 con 0x7ff4700b4040 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff475bda640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4700b4040 0x7ff470140880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c490 tx=0x7ff46000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff466ffd640 1 -- 172.21.15.16:0/1897958842 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460018070 con 0x7ff4700b4040 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff466ffd640 1 -- 172.21.15.16:0/1897958842 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460007500 con 0x7ff4700b4040 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff466ffd640 1 -- 172.21.15.16:0/1897958842 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460004a20 con 0x7ff4700b4040 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.763+0000 7ff47863f640 1 -- 172.21.15.16:0/1897958842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47013e570 con 0x7ff4700b4040 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.764+0000 7ff47863f640 1 -- 172.21.15.16:0/1897958842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47013f210 con 0x7ff4700b4040 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.765+0000 7ff466ffd640 1 -- 172.21.15.16:0/1897958842 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7ff46001b070 con 0x7ff4700b4040 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.766+0000 7ff466ffd640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff4540762d0 0x7ff454078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.766+0000 7ff466ffd640 1 -- 172.21.15.16:0/1897958842 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7ff460096aa0 con 0x7ff4700b4040 2024-05-11T01:14:07.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.766+0000 7ff4763db640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff4540762d0 0x7ff454078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff47b431740 1 Processor -- start 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff4763db640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff4540762d0 0x7ff454078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff46c034000 tx=0x7ff46c02e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff47b431740 1 -- start start 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff47b431740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac443ff0 0x55d0ac446800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff47b431740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac446d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff47b431740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac416c50 0x55d0ac41a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff47b431740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d0ac3808d0 con 0x55d0ac4443d0 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff47b431740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d0ac339c10 con 0x55d0ac416c50 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.767+0000 7ff47b431740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55d0ac37c890 con 0x55d0ac443ff0 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac446d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac446d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41882/0 (socket says 172.21.15.16:41882) 2024-05-11T01:14:07.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 -- 172.21.15.16:0/411525239 learned_addr learned my addr 172.21.15.16:0/411525239 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff4763db640 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac443ff0 0x55d0ac446800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff476bdc640 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac416c50 0x55d0ac41a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 -- 172.21.15.16:0/411525239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac443ff0 msgr2=0x55d0ac446800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac443ff0 0x55d0ac446800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 -- 172.21.15.16:0/411525239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac416c50 msgr2=0x55d0ac41a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac416c50 0x55d0ac41a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 -- 172.21.15.16:0/411525239 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ac3415d0 con 0x55d0ac4443d0 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff475bda640 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac446d40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff46005c180 tx=0x7ff460000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef4c98ff5e7b780 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff453fff640 1 -- 172.21.15.16:0/411525239 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4600682b0 con 0x55d0ac4443d0 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff453fff640 1 -- 172.21.15.16:0/411525239 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460063f40 con 0x55d0ac4443d0 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.768+0000 7ff453fff640 1 -- 172.21.15.16:0/411525239 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460004dc0 con 0x55d0ac4443d0 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 -- 172.21.15.16:0/411525239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 msgr2=0x55d0ac446d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac446d40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff46005c180 tx=0x7ff460000ed0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 -- 172.21.15.16:0/411525239 shutdown_connections 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac416c50 0x55d0ac41a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac446d40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 --2- 172.21.15.16:0/411525239 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac443ff0 0x55d0ac446800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 -- 172.21.15.16:0/411525239 >> 172.21.15.16:0/411525239 conn(0x55d0ac418ec0 msgr2=0x55d0ac461800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 -- 172.21.15.16:0/411525239 shutdown_connections 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.769+0000 7ff47b431740 1 -- 172.21.15.16:0/411525239 wait complete. 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.770+0000 7ff47b431740 1 -- start start 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.770+0000 7ff47b431740 1 Processor -- start 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff47b431740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac443660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff47b431740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 0x55d0ac465ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff47b431740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 0x55d0ac466410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff47b431740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d0ac41c070 con 0x55d0ac443ff0 2024-05-11T01:14:07.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff47b431740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d0ac33d760 con 0x55d0ac43d450 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff47b431740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55d0ac41c350 con 0x55d0ac4443d0 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff47b431740 10 client.0 _ll_register_callbacks cb 0x55d0ac376cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac443660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac443660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41892/0 (socket says 172.21.15.16:41892) 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 -- 172.21.15.16:0/108185368 learned_addr learned my addr 172.21.15.16:0/108185368 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff476bdc640 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 0x55d0ac466410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff475bda640 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 0x55d0ac465ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 -- 172.21.15.16:0/108185368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 msgr2=0x55d0ac465ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 0x55d0ac465ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 -- 172.21.15.16:0/108185368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 msgr2=0x55d0ac466410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 0x55d0ac466410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 -- 172.21.15.16:0/108185368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ac0922d0 con 0x55d0ac443ff0 2024-05-11T01:14:07.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4763db640 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac443660 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0097a0 tx=0x7ff46c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76952a659bd1f3b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4517fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4517fa640 1 -- 172.21.15.16:0/108185368 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c037040 con 0x55d0ac443ff0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff4517fa640 1 -- 172.21.15.16:0/108185368 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7ff46c003a20 con 0x55d0ac443ff0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.771+0000 7ff47b431740 1 -- 172.21.15.16:0/108185368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff460063f40 con 0x55d0ac443ff0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff4517fa640 1 -- 172.21.15.16:0/108185368 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff46c056050 con 0x55d0ac443ff0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff47b431740 10 client.5760 fetch_fsmap learned FSMap version 25 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff47b431740 1 -- 172.21.15.16:0/108185368 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55d0ac15c6b0 con 0x55d0ac443ff0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff4517fa640 1 -- 172.21.15.16:0/108185368 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460063f40 con 0x55d0ac443ff0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff4517fa640 1 -- 172.21.15.16:0/108185368 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7ff46c059020 con 0x55d0ac443ff0 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff47b431740 10 client.5760 fetch_fsmap finished waiting for FSMap version 25 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff47b431740 10 client.5760 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff47b431740 20 client.5760 populate_metadata read hostname 'smithi016' 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff47b431740 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] conn(0x55d0ac468e50 0x55d0ac469250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff47b431740 4 client.5760 mds_command: new command op to 5610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-11T01:14:07.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff47b431740 1 -- 172.21.15.16:0/108185368 --> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0ac304760 con 0x55d0ac468e50 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff475bda640 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] conn(0x55d0ac468e50 0x55d0ac469250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff4517fa640 10 client.5760 ms_handle_connect on v2:172.21.15.16:6832/3060746236 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.772+0000 7ff475bda640 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] conn(0x55d0ac468e50 0x55d0ac469250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b25360e236cd241 server_cookie=dde8f05858563732 in_seq=0 out_seq=0 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.773+0000 7ff4517fa640 1 -- 172.21.15.16:0/108185368 <== mds.0 v2:172.21.15.16:6832/3060746236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d0ac304760 con 0x55d0ac468e50 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.773+0000 7ff4517fa640 10 client.5760 handle_command_reply: tid=0 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.773+0000 7ff47b431740 1 client.5760 shutdown 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.773+0000 7ff47b431740 1 -- 172.21.15.16:0/108185368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 msgr2=0x55d0ac443660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.773+0000 7ff47b431740 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac443660 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0097a0 tx=0x7ff46c004730 comp rx=0 tx=0).stop 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.773+0000 7ff47b431740 1 -- 172.21.15.16:0/108185368 shutdown_connections 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.773+0000 7ff47b431740 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 0x55d0ac466410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.774+0000 7ff47b431740 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 0x55d0ac465ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.774+0000 7ff47b431740 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] conn(0x55d0ac468e50 0x55d0ac469250 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.774+0000 7ff47b431740 1 --2- 172.21.15.16:0/108185368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac443660 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.774+0000 7ff4517fa640 0 client.5760 ms_handle_reset on v2:172.21.15.16:6832/3060746236 2024-05-11T01:14:07.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.774+0000 7ff47b431740 1 -- 172.21.15.16:0/108185368 >> 172.21.15.16:0/108185368 conn(0x55d0ac416c50 msgr2=0x55d0ac44a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.774+0000 7ff47b431740 1 -- 172.21.15.16:0/108185368 shutdown_connections 2024-05-11T01:14:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.774+0000 7ff47b431740 1 -- 172.21.15.16:0/108185368 wait complete. 2024-05-11T01:14:07.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.774+0000 7ff47b431740 20 client.5760 trim_cache size 0 max 16384 2024-05-11T01:14:07.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.792+0000 7ff47b431740 1 Processor -- start 2024-05-11T01:14:07.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.792+0000 7ff47b431740 1 -- start start 2024-05-11T01:14:07.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff47b431740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac43d450 0x55d0ac443570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff47b431740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac443ff0 0x55d0ac412050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff47b431740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac47b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff47b431740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701ff9a0 con 0x55d0ac4443d0 2024-05-11T01:14:07.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff47b431740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701fe9a0 con 0x55d0ac443ff0 2024-05-11T01:14:07.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff47b431740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7ff47015bff0 con 0x55d0ac43d450 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff476bdc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac47b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff476bdc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac47b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41894/0 (socket says 172.21.15.16:41894) 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff476bdc640 1 -- 172.21.15.16:0/2531963914 learned_addr learned my addr 172.21.15.16:0/2531963914 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff4763db640 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac43d450 0x55d0ac443570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff475bda640 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac443ff0 0x55d0ac412050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff476bdc640 1 -- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac43d450 msgr2=0x55d0ac443570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff476bdc640 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac43d450 0x55d0ac443570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff476bdc640 1 -- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac443ff0 msgr2=0x55d0ac412050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff476bdc640 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac443ff0 0x55d0ac412050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff476bdc640 1 -- 172.21.15.16:0/2531963914 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ac385b50 con 0x55d0ac4443d0 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff4763db640 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac43d450 0x55d0ac443570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.793+0000 7ff475bda640 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac443ff0 0x55d0ac412050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:14:07.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff476bdc640 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac47b420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d590 tx=0x7ff4680078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333632860985e490 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff4537fe640 1 -- 172.21.15.16:0/2531963914 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46800a9b0 con 0x55d0ac4443d0 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff4537fe640 1 -- 172.21.15.16:0/2531963914 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff46801c070 con 0x55d0ac4443d0 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff4537fe640 1 -- 172.21.15.16:0/2531963914 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46800ad50 con 0x55d0ac4443d0 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 -- 172.21.15.16:0/2531963914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 msgr2=0x55d0ac47b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac47b420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d590 tx=0x7ff4680078e0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 -- 172.21.15.16:0/2531963914 shutdown_connections 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac4443d0 0x55d0ac47b420 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac443ff0 0x55d0ac412050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 --2- 172.21.15.16:0/2531963914 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac43d450 0x55d0ac443570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 -- 172.21.15.16:0/2531963914 >> 172.21.15.16:0/2531963914 conn(0x55d0ac416c50 msgr2=0x55d0ac44a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 -- 172.21.15.16:0/2531963914 shutdown_connections 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.794+0000 7ff47b431740 1 -- 172.21.15.16:0/2531963914 wait complete. 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.795+0000 7ff47b431740 1 -- start start 2024-05-11T01:14:07.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.795+0000 7ff47b431740 1 Processor -- start 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff47b431740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 0x55d0ac463f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff47b431740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac43c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff47b431740 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 0x55d0ac43c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff47b431740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d0ac468260 con 0x55d0ac443ff0 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff47b431740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4701f7010 con 0x55d0ac43d450 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff47b431740 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x55d0ac4651a0 con 0x55d0ac4443d0 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff47b431740 10 client.0 _ll_register_callbacks cb 0x7ff46c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac43c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac43c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41900/0 (socket says 172.21.15.16:41900) 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 -- 172.21.15.16:0/3926982234 learned_addr learned my addr 172.21.15.16:0/3926982234 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:07.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff4763db640 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 0x55d0ac463f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff476bdc640 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 0x55d0ac43c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 -- 172.21.15.16:0/3926982234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 msgr2=0x55d0ac43c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 0x55d0ac43c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 -- 172.21.15.16:0/3926982234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 msgr2=0x55d0ac463f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 0x55d0ac463f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 -- 172.21.15.16:0/3926982234 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ac4494c0 con 0x55d0ac443ff0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff475bda640 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac43c470 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff46005c180 tx=0x7ff460062040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2079735509207a2e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.796+0000 7ff4517fa640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff4517fa640 1 -- 172.21.15.16:0/3926982234 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46005c1e0 con 0x55d0ac443ff0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff4517fa640 1 -- 172.21.15.16:0/3926982234 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7ff46007f8d0 con 0x55d0ac443ff0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 1 -- 172.21.15.16:0/3926982234 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff46801c070 con 0x55d0ac443ff0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff4517fa640 1 -- 172.21.15.16:0/3926982234 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff46007fad0 con 0x55d0ac443ff0 2024-05-11T01:14:07.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 10 client.5766 fetch_fsmap learned FSMap version 25 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 1 -- 172.21.15.16:0/3926982234 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) -- 0x55d0ac462f10 con 0x55d0ac443ff0 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff4517fa640 1 -- 172.21.15.16:0/3926982234 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff46801c070 con 0x55d0ac443ff0 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff4517fa640 1 -- 172.21.15.16:0/3926982234 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 25) ==== 3494+0+0 (secure 0 0 0) 0x7ff46007a050 con 0x55d0ac443ff0 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 10 client.5766 fetch_fsmap finished waiting for FSMap version 25 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 10 client.5766 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 20 client.5766 populate_metadata read hostname 'smithi016' 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] conn(0x55d0ac417a10 0x55d0ac4840b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 4 client.5766 mds_command: new command op to 5610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff47b431740 1 -- 172.21.15.16:0/3926982234 --> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] -- command(tid 0: {"prefix": "status"}) -- 0x55d0ac38e4e0 con 0x55d0ac417a10 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff4763db640 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] conn(0x55d0ac417a10 0x55d0ac4840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.797+0000 7ff4517fa640 10 client.5766 ms_handle_connect on v2:172.21.15.16:6832/3060746236 2024-05-11T01:14:07.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff4763db640 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] conn(0x55d0ac417a10 0x55d0ac4840b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=630cac311dc88702 server_cookie=667634369ae4ac99 in_seq=0 out_seq=0 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff4517fa640 1 -- 172.21.15.16:0/3926982234 <== mds.0 v2:172.21.15.16:6832/3060746236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d0ac38e4e0 con 0x55d0ac417a10 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff4517fa640 10 client.5766 handle_command_reply: tid=0 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 client.5766 shutdown 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 -- 172.21.15.16:0/3926982234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 msgr2=0x55d0ac43c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac43c470 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff46005c180 tx=0x7ff460062040 comp rx=0 tx=0).stop 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 -- 172.21.15.16:0/3926982234 shutdown_connections 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x55d0ac4443d0 0x55d0ac43c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.16:6832/3060746236,v1:172.21.15.16:6834/3060746236] conn(0x55d0ac417a10 0x55d0ac4840b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d0ac443ff0 0x55d0ac43c470 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 --2- 172.21.15.16:0/3926982234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d0ac43d450 0x55d0ac463f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 -- 172.21.15.16:0/3926982234 >> 172.21.15.16:0/3926982234 conn(0x55d0ac416c50 msgr2=0x55d0ac43dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff4517fa640 0 client.5766 ms_handle_reset on v2:172.21.15.16:6832/3060746236 2024-05-11T01:14:07.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 -- 172.21.15.16:0/3926982234 shutdown_connections 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 1 -- 172.21.15.16:0/3926982234 wait complete. 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.798+0000 7ff47b431740 20 client.5766 trim_cache size 0 max 16384 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "3d939707-6559-4ce1-a2ce-e98842b2ed86", 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 5610, 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-05-11T01:14:07.806 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-05-11T01:14:07.807 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 10.231651730999999, 2024-05-11T01:14:07.807 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 25, 2024-05-11T01:14:07.807 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 59, 2024-05-11T01:14:07.807 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 59, 2024-05-11T01:14:07.807 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 15.221451957999999 2024-05-11T01:14:07.807 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:14:07.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 -- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff4540762d0 msgr2=0x7ff454078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff4540762d0 0x7ff454078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff46c034000 tx=0x7ff46c02e000 comp rx=0 tx=0).stop 2024-05-11T01:14:07.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 -- 172.21.15.16:0/1897958842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4700b4040 msgr2=0x7ff470140880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4700b4040 0x7ff470140880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c490 tx=0x7ff46000c950 comp rx=0 tx=0).stop 2024-05-11T01:14:07.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 -- 172.21.15.16:0/1897958842 shutdown_connections 2024-05-11T01:14:07.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7ff470145ae0 0x7ff47013f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4700b4040 0x7ff470140880 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7ff4540762d0 0x7ff454078790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 --2- 172.21.15.16:0/1897958842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4700b33e0 0x7ff47013d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 -- 172.21.15.16:0/1897958842 >> 172.21.15.16:0/1897958842 conn(0x7ff47006fd90 msgr2=0x7ff4700ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:07.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 -- 172.21.15.16:0/1897958842 shutdown_connections 2024-05-11T01:14:07.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.799+0000 7ff47863f640 1 -- 172.21.15.16:0/1897958842 wait complete. 2024-05-11T01:14:07.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-11T01:14:07.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.913+0000 7fe8ab4fc640 1 Processor -- start 2024-05-11T01:14:07.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.913+0000 7fe8ab4fc640 1 -- start start 2024-05-11T01:14:07.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.914+0000 7fe8ab4fc640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8a40d0000 0x7fe8a40d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.914+0000 7fe8ab4fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.914+0000 7fe8ab4fc640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8a40d0920 con 0x7fe8a40baed0 2024-05-11T01:14:07.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.914+0000 7fe8ab4fc640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fe8a4163820 con 0x7fe8a40d0000 2024-05-11T01:14:07.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.914+0000 7fe8ab4fc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a4163b00 con 0x7fe8a40d3bf0 2024-05-11T01:14:07.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9298640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8a40d0000 0x7fe8a40d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9a99640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9298640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8a40d0000 0x7fe8a40d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.16:48170/0 (socket says 172.21.15.16:48170) 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a8a97640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe8a40baed0 0x7fe8a4162fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:59688/0 (socket says 172.21.15.16:59688) 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9a99640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40d4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:33378/0 (socket says 172.21.15.16:33378) 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a8a97640 1 -- 172.21.15.16:0/2122877347 learned_addr learned my addr 172.21.15.16:0/2122877347 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9a99640 1 -- 172.21.15.16:0/2122877347 >> v2:172.21.15.174:3300/0 conn(0x7fe8a40d0000 msgr2=0x7fe8a40d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9a99640 1 --2- 172.21.15.16:0/2122877347 >> v2:172.21.15.174:3300/0 conn(0x7fe8a40d0000 0x7fe8a40d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9a99640 1 -- 172.21.15.16:0/2122877347 >> v1:172.21.15.174:6789/0 conn(0x7fe8a40baed0 legacy=0x7fe8a4162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9a99640 1 -- 172.21.15.16:0/2122877347 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40d33f0 con 0x7fe8a40d3bf0 2024-05-11T01:14:07.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.915+0000 7fe8a9298640 1 --2- 172.21.15.16:0/2122877347 >> v2:172.21.15.174:3300/0 conn(0x7fe8a40d0000 0x7fe8a40d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.916+0000 7fe8a9a99640 1 --2- 172.21.15.16:0/2122877347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40d4080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe894009d90 tx=0x7fe89402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d26ad0137b6267d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.916+0000 7fe8a3fff640 1 -- 172.21.15.16:0/2122877347 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894007740 con 0x7fe8a40d3bf0 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.916+0000 7fe8a3fff640 1 -- 172.21.15.16:0/2122877347 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8940078e0 con 0x7fe8a40d3bf0 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.916+0000 7fe8a3fff640 1 -- 172.21.15.16:0/2122877347 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe894007cb0 con 0x7fe8a40d3bf0 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.916+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2122877347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 msgr2=0x7fe8a40d4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.916+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2122877347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40d4080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe894009d90 tx=0x7fe89402a660 comp rx=0 tx=0).stop 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.917+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2122877347 shutdown_connections 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.917+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2122877347 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40d4080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.917+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2122877347 >> v2:172.21.15.174:3300/0 conn(0x7fe8a40d0000 0x7fe8a40d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.917+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2122877347 >> 172.21.15.16:0/2122877347 conn(0x7fe8a4074140 msgr2=0x7fe8a40b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:07.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.917+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2122877347 shutdown_connections 2024-05-11T01:14:07.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.917+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2122877347 wait complete. 2024-05-11T01:14:07.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.918+0000 7fe8ab4fc640 1 Processor -- start 2024-05-11T01:14:07.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.918+0000 7fe8ab4fc640 1 -- start start 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8ab4fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a40baed0 0x7fe8a40c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8ab4fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a40d0000 0x7fe8a40b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8ab4fc640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8ab4fc640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a415f750 con 0x7fe8a40d0000 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8ab4fc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe8a4163de0 con 0x7fe8a40baed0 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8ab4fc640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe8a415f8d0 con 0x7fe8a40d3bf0 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a40d0000 0x7fe8a40b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a40d0000 0x7fe8a40b8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41904/0 (socket says 172.21.15.16:41904) 2024-05-11T01:14:07.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 -- 172.21.15.16:0/2682769095 learned_addr learned my addr 172.21.15.16:0/2682769095 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a9298640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a40baed0 0x7fe8a40c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a9a99640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 -- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 msgr2=0x7fe8a40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 -- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a40baed0 msgr2=0x7fe8a40c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a40baed0 0x7fe8a40c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 -- 172.21.15.16:0/2682769095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8a40cdcf0 con 0x7fe8a40d0000 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.919+0000 7fe8a8a97640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a40d0000 0x7fe8a40b8e10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c400 tx=0x7fe89800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.920+0000 7fe8a1ffb640 1 -- 172.21.15.16:0/2682769095 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898017070 con 0x7fe8a40d0000 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.920+0000 7fe8a1ffb640 1 -- 172.21.15.16:0/2682769095 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe898005d00 con 0x7fe8a40d0000 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.920+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8a40b7640 con 0x7fe8a40d0000 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.920+0000 7fe8a1ffb640 1 -- 172.21.15.16:0/2682769095 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe898007310 con 0x7fe8a40d0000 2024-05-11T01:14:07.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.920+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8a40ce270 con 0x7fe8a40d0000 2024-05-11T01:14:07.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.921+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8a406a5b0 con 0x7fe8a40d0000 2024-05-11T01:14:07.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.921+0000 7fe8a1ffb640 1 -- 172.21.15.16:0/2682769095 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fe89801a070 con 0x7fe8a40d0000 2024-05-11T01:14:07.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.922+0000 7fe8a1ffb640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8900762d0 0x7fe890078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:07.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.922+0000 7fe8a1ffb640 1 -- 172.21.15.16:0/2682769095 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7fe898096a20 con 0x7fe8a40d0000 2024-05-11T01:14:07.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.922+0000 7fe8a9298640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8900762d0 0x7fe890078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:07.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.923+0000 7fe8a9298640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8900762d0 0x7fe890078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009560 tx=0x7fe89c009190 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:07.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:07.926+0000 7fe8a1ffb640 1 -- 172.21.15.16:0/2682769095 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe89805fbc0 con 0x7fe8a40d0000 2024-05-11T01:14:08.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.160+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe8a415c860 con 0x7fe8a40d0000 2024-05-11T01:14:08.161 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.160+0000 7fe8a1ffb640 1 -- 172.21.15.16:0/2682769095 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+73 (secure 0 0 0) 0x7fe898068070 con 0x7fe8a40d0000 2024-05-11T01:14:08.161 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8900762d0 msgr2=0x7fe890078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8900762d0 0x7fe890078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009560 tx=0x7fe89c009190 comp rx=0 tx=0).stop 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a40d0000 msgr2=0x7fe8a40b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a40d0000 0x7fe8a40b8e10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe89800c400 tx=0x7fe89800c8c0 comp rx=0 tx=0).stop 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 shutdown_connections 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8a40d3bf0 0x7fe8a40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8a40d0000 0x7fe8a40b8e10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8900762d0 0x7fe890078790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 --2- 172.21.15.16:0/2682769095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8a40baed0 0x7fe8a40c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 >> 172.21.15.16:0/2682769095 conn(0x7fe8a4074140 msgr2=0x7fe8a415b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 shutdown_connections 2024-05-11T01:14:08.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08.162+0000 7fe8ab4fc640 1 -- 172.21.15.16:0/2682769095 wait complete. 2024-05-11T01:14:08.173 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-11T01:14:08.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-11T01:14:08.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-05-11T01:14:08.174 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-11T01:14:08.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-11T01:14:08.174 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-11T01:14:08.174 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-11T01:14:08.174 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-11T01:14:08.174 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-11T01:14:08.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:14:08.174 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-05-11T01:14:08.191 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-11T01:14:08.192 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42001sec preferred_lft 42001sec 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link noprefixroute 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 66:7c:9f:9d:19:03 brd ff:ff:ff:ff:ff:ff 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::245b:6cff:fe33:c9f/64 scope link 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:14:08.193 INFO:teuthology.orchestra.run.smithi016.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-11T01:14:08.194 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 8e:ce:99:4a:60:d1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-11T01:14:08.194 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::8cce:99ff:fe4a:60d1/64 scope link 2024-05-11T01:14:08.194 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:14:08.194 INFO:teuthology.orchestra.run.smithi016.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-11T01:14:08.194 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 66:7c:9f:9d:19:03 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-11T01:14:08.194 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::647c:9fff:fe9d:1903/64 scope link 2024-05-11T01:14:08.194 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-05-11T01:14:08.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:14:08.194 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-11T01:14:08.256 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-05-11T01:14:08.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:14:08.258 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-05-11T01:14:08.316 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-05-11T01:14:08.316 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-11T01:14:08.316 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-11T01:14:08.316 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-11T01:14:08.316 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-11T01:14:08.317 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-11T01:14:08.317 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-05-11T01:14:08.317 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-11T01:14:08.317 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-11T01:14:08.317 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-11T01:14:08.317 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-05-11T01:14:08.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-11T01:14:08.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:14:08.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:14:08.446 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-05-11T01:14:08.463 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-11T01:14:08.463 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-11T01:14:08.463 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-11T01:14:08.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:14:08.463 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-05-11T01:14:08.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:14:08.529 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-11T01:14:08.585 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-11T01:14:08.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-11T01:14:08.585 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-11T01:14:08.640 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-11T01:14:08.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:14:08.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:14:08.726 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:14:08.726 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:14:08.735 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-11T01:14:08.735 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-11T01:14:08.735 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.174:3300,172.21.15.174:3301" 2024-05-11T01:14:08.735 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with new device syntax: 0@3d939707-6559-4ce1-a2ce-e98842b2ed86.cephfs=/ 2024-05-11T01:14:08.735 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.16:3300/172.21.15.174:3300/172.21.15.174:3301" will pass to kernel 2024-05-11T01:14:08.736 INFO:teuthology.orchestra.run.smithi016.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-11T01:14:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: You just mounted a file system that supports labels which does not 2024-05-11T01:14:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-11T01:14:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: applications will generate AVC messages and not be allowed access to 2024-05-11T01:14:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-11T01:14:08.737 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-11T01:14:08.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:14:08.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-11T01:14:08.764 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-11T01:14:08.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-11T01:14:08.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-11T01:14:08.869 INFO:teuthology.orchestra.run.smithi016.stdout:client5144 2024-05-11T01:14:08.869 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:14:08.869 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:14:08.886 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-11T01:14:09.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.031+0000 7fc592b59640 1 Processor -- start 2024-05-11T01:14:09.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.031+0000 7fc592b59640 1 -- start start 2024-05-11T01:14:09.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.031+0000 7fc592b59640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc58c0d0000 0x7fc58c0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:09.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.031+0000 7fc592b59640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58c0d0920 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.031+0000 7fc592b59640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc58c163820 con 0x7fc58c0baed0 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.031+0000 7fc592b59640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc58c163b00 con 0x7fc58c0d0000 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc5910f6640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc58c0d3bf0 0x7fc58c0d4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:32966/0 (socket says 172.21.15.16:32966) 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc5910f6640 1 -- 172.21.15.16:0/184077278 learned_addr learned my addr 172.21.15.16:0/184077278 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc5908f5640 1 --2- 172.21.15.16:0/184077278 >> v2:172.21.15.174:3300/0 conn(0x7fc58c0d0000 0x7fc58c0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc58b7fe640 1 -- 172.21.15.16:0/184077278 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050498747 0 0) 0x7fc58c0d0920 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc58b7fe640 1 -- 172.21.15.16:0/184077278 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc578003520 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc58b7fe640 1 -- 172.21.15.16:0/184077278 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290592890 0 0) 0x7fc58c163820 con 0x7fc58c0baed0 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc58b7fe640 1 -- 172.21.15.16:0/184077278 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc58c0d0920 con 0x7fc58c0baed0 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc58b7fe640 1 -- 172.21.15.16:0/184077278 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1510717972 0 0) 0x7fc578003520 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc5908f5640 1 -- 172.21.15.16:0/184077278 >> v1:172.21.15.174:6789/0 conn(0x7fc58c0baed0 legacy=0x7fc58c162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc5908f5640 1 -- 172.21.15.16:0/184077278 >> v1:172.21.15.16:6789/0 conn(0x7fc58c0d3bf0 legacy=0x7fc58c0d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:09.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.032+0000 7fc5908f5640 1 -- 172.21.15.16:0/184077278 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c0d33f0 con 0x7fc58c0d0000 2024-05-11T01:14:09.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.033+0000 7fc5908f5640 1 --2- 172.21.15.16:0/184077278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58c0d0000 0x7fc58c0d03e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc5840097a0 tx=0x7fc58402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31e62bd2b4f618d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:09.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.033+0000 7fc58b7fe640 1 -- 172.21.15.16:0/184077278 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584037070 con 0x7fc58c0d0000 2024-05-11T01:14:09.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.033+0000 7fc58b7fe640 1 -- 172.21.15.16:0/184077278 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58402ac50 con 0x7fc58c0d0000 2024-05-11T01:14:09.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.033+0000 7fc58b7fe640 1 -- 172.21.15.16:0/184077278 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740016f0 con 0x7fc58c0d0000 2024-05-11T01:14:09.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.034+0000 7fc592b59640 1 -- 172.21.15.16:0/184077278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58c0d0000 msgr2=0x7fc58c0d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:09.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.034+0000 7fc592b59640 1 --2- 172.21.15.16:0/184077278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58c0d0000 0x7fc58c0d03e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc5840097a0 tx=0x7fc58402a1c0 comp rx=0 tx=0).stop 2024-05-11T01:14:09.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.034+0000 7fc592b59640 1 -- 172.21.15.16:0/184077278 shutdown_connections 2024-05-11T01:14:09.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.034+0000 7fc592b59640 1 --2- 172.21.15.16:0/184077278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58c0d0000 0x7fc58c0d03e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:09.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.034+0000 7fc592b59640 1 -- 172.21.15.16:0/184077278 >> 172.21.15.16:0/184077278 conn(0x7fc58c074140 msgr2=0x7fc58c0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:14:09.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.034+0000 7fc592b59640 1 -- 172.21.15.16:0/184077278 shutdown_connections 2024-05-11T01:14:09.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.034+0000 7fc592b59640 1 -- 172.21.15.16:0/184077278 wait complete. 2024-05-11T01:14:09.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.035+0000 7fc592b59640 1 Processor -- start 2024-05-11T01:14:09.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.035+0000 7fc592b59640 1 -- start start 2024-05-11T01:14:09.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc592b59640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58c0baed0 0x7fc58c14ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc592b59640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc58c0d0000 0x7fc58c150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc592b59640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc58c0d3bf0 0x7fc58c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc592b59640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c15f750 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc592b59640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc58c163de0 con 0x7fc58c0baed0 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc592b59640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc58c15f8d0 con 0x7fc58c0d0000 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5910f6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc58c0d3bf0 0x7fc58c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5908f5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58c0baed0 0x7fc58c14ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5910f6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc58c0d3bf0 0x7fc58c0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:41916/0 (socket says 172.21.15.16:41916) 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5910f6640 1 -- 172.21.15.16:0/2569183689 learned_addr learned my addr 172.21.15.16:0/2569183689 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc58bfff640 1 --2- 172.21.15.16:0/2569183689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc58c0d0000 0x7fc58c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:09.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5910f6640 1 -- 172.21.15.16:0/2569183689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc58c0d0000 msgr2=0x7fc58c150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5910f6640 1 --2- 172.21.15.16:0/2569183689 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc58c0d0000 0x7fc58c150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5910f6640 1 -- 172.21.15.16:0/2569183689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58c0baed0 msgr2=0x7fc58c14ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5910f6640 1 --2- 172.21.15.16:0/2569183689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc58c0baed0 0x7fc58c14ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.036+0000 7fc5910f6640 1 -- 172.21.15.16:0/2569183689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58c1623f0 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.037+0000 7fc5910f6640 1 --2- 172.21.15.16:0/2569183689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc58c0d3bf0 0x7fc58c0ce080 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc57400c680 tx=0x7fc57400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.037+0000 7fc5897fa640 1 -- 172.21.15.16:0/2569183689 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574017070 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.037+0000 7fc5897fa640 1 -- 172.21.15.16:0/2569183689 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc574005ad0 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.037+0000 7fc5897fa640 1 -- 172.21.15.16:0/2569183689 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574007070 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.037+0000 7fc592b59640 1 -- 172.21.15.16:0/2569183689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc58c1e8e10 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.037+0000 7fc592b59640 1 -- 172.21.15.16:0/2569183689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc58c1e93d0 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.038+0000 7fc592b59640 1 -- 172.21.15.16:0/2569183689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc58c06a5b0 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.039+0000 7fc5897fa640 1 -- 172.21.15.16:0/2569183689 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fc57401a070 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.039+0000 7fc5897fa640 1 --2- 172.21.15.16:0/2569183689 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc56c0762d0 0x7fc56c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:14:09.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.039+0000 7fc5897fa640 1 -- 172.21.15.16:0/2569183689 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6073+0+0 (secure 0 0 0) 0x7fc574096a90 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.039+0000 7fc5908f5640 1 --2- 172.21.15.16:0/2569183689 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc56c0762d0 0x7fc56c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:14:09.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.040+0000 7fc5908f5640 1 --2- 172.21.15.16:0/2569183689 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc56c0762d0 0x7fc56c078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc584034000 tx=0x7fc58402e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:14:09.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.043+0000 7fc5897fa640 1 -- 172.21.15.16:0/2569183689 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc57405fcc0 con 0x7fc58c0d3bf0 2024-05-11T01:14:09.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:14:09.261+0000 7fc592b59640 1 -- 172.21.15.16:0/2569183689 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fc58c1e95a0 con 0x7fc56c0762d0 2024-05-11T01:14:22.259 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:14:22.263 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:14:52.323 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:14:52.327 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:15:22.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:15:22.385 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:15:52.517 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:15:52.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:16:08.958 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-05-11T01:16:08.960 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ERROR 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner: 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner:ERROR: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/cephfs/test_snap_schedules.py", line 103, in setUp 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner: self._create_or_reuse_test_volume() 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/cephfs/test_snap_schedules.py", line 79, in _create_or_reuse_test_volume 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner: result = json.loads(self._fs_cmd("volume", "ls")) 2024-05-11T01:16:08.961 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/cephfs/test_snap_schedules.py", line 63, in _fs_cmd 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: r.wait() 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls' 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner: 2024-05-11T01:16:08.962 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner:Ran 2 tests in 875.372s 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner:ERROR: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/cephfs/test_snap_schedules.py", line 103, in setUp 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: self._create_or_reuse_test_volume() 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/cephfs/test_snap_schedules.py", line 79, in _create_or_reuse_test_volume 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: result = json.loads(self._fs_cmd("volume", "ls")) 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/cephfs/test_snap_schedules.py", line 63, in _fs_cmd 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-05-11T01:16:08.963 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: r.wait() 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls' 2024-05-11T01:16:08.964 INFO:tasks.cephfs_test_runner: 2024-05-11T01:16:08.964 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-05-11T01:16:09.205 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a1b35ae711fa4db3ab7cf7c0a18f22fd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_10380055a1fc5e7d3b37b252af7045f5c2c8ba29/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-05-11T01:16:09.207 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-11T01:16:09.216 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-11T01:16:09.224 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-11T01:16:09.224 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:16:09.224 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:16:09.247 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:16:09.247 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:16:09.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-11T01:16:09.462 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.462+0000 7eff1cbe7640 1 Processor -- start 2024-05-11T01:16:09.463 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.462+0000 7eff1cbe7640 1 -- start start 2024-05-11T01:16:09.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.463+0000 7eff1cbe7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7eff180b4cf0 0x7eff180d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:09.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.463+0000 7eff1cbe7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7eff18164010 0x7eff180b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:09.464 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.463+0000 7eff1cbe7640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff180b5610 con 0x7eff180d0d40 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.463+0000 7eff1cbe7640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7eff180d16e0 con 0x7eff180b4cf0 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.463+0000 7eff1cbe7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7eff180d30c0 con 0x7eff18164010 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff16d9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7eff180d0d40 0x7eff180cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44648/0 (socket says 172.21.15.16:44648) 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff16d9d640 1 -- 172.21.15.16:0/285615449 learned_addr learned my addr 172.21.15.16:0/285615449 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff1659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7eff180b4cf0 0x7eff180d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff15d9b640 1 --2- 172.21.15.16:0/285615449 >> v2:172.21.15.174:3300/0 conn(0x7eff18164010 0x7eff180b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff1559a640 1 -- 172.21.15.16:0/285615449 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4218122180 0 0) 0x7eff180b5610 con 0x7eff180d0d40 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff1559a640 1 -- 172.21.15.16:0/285615449 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff04003520 con 0x7eff180d0d40 2024-05-11T01:16:09.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff1659c640 1 -- 172.21.15.16:0/285615449 >> v2:172.21.15.174:3300/0 conn(0x7eff18164010 msgr2=0x7eff180b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:09.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff1659c640 1 --2- 172.21.15.16:0/285615449 >> v2:172.21.15.174:3300/0 conn(0x7eff18164010 0x7eff180b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff1659c640 1 -- 172.21.15.16:0/285615449 >> v1:172.21.15.16:6789/0 conn(0x7eff180d0d40 legacy=0x7eff180cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:09.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.464+0000 7eff1659c640 1 -- 172.21.15.16:0/285615449 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff180d33a0 con 0x7eff180b4cf0 2024-05-11T01:16:09.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.465+0000 7eff1659c640 1 --2- 172.21.15.16:0/285615449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff180d3ba0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7eff180717a0 tx=0x7eff1002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7640b23b49e9b93e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:09.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.465+0000 7eff1559a640 1 -- 172.21.15.16:0/285615449 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10007740 con 0x7eff180b4cf0 2024-05-11T01:16:09.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.465+0000 7eff1559a640 1 -- 172.21.15.16:0/285615449 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff100078e0 con 0x7eff180b4cf0 2024-05-11T01:16:09.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.465+0000 7eff1559a640 1 -- 172.21.15.16:0/285615449 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10007cb0 con 0x7eff180b4cf0 2024-05-11T01:16:09.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.466+0000 7eff1cbe7640 1 -- 172.21.15.16:0/285615449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 msgr2=0x7eff180d3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:09.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.466+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/285615449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff180d3ba0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7eff180717a0 tx=0x7eff1002a680 comp rx=0 tx=0).stop 2024-05-11T01:16:09.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.466+0000 7eff1cbe7640 1 -- 172.21.15.16:0/285615449 shutdown_connections 2024-05-11T01:16:09.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.466+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/285615449 >> v2:172.21.15.174:3300/0 conn(0x7eff18164010 0x7eff180b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.466+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/285615449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff180d3ba0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.466+0000 7eff1cbe7640 1 -- 172.21.15.16:0/285615449 >> 172.21.15.16:0/285615449 conn(0x7eff180681c0 msgr2=0x7eff180685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:09.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.466+0000 7eff1cbe7640 1 -- 172.21.15.16:0/285615449 shutdown_connections 2024-05-11T01:16:09.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.466+0000 7eff1cbe7640 1 -- 172.21.15.16:0/285615449 wait complete. 2024-05-11T01:16:09.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.467+0000 7eff1cbe7640 1 Processor -- start 2024-05-11T01:16:09.469 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.467+0000 7eff1cbe7640 1 -- start start 2024-05-11T01:16:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1cbe7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff1814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1cbe7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff180d0d40 0x7eff1815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1cbe7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff18164010 0x7eff1815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1cbe7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff1815fa80 con 0x7eff180b4cf0 2024-05-11T01:16:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1cbe7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7eff180d2d70 con 0x7eff18164010 2024-05-11T01:16:09.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1cbe7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7eff180d11b0 con 0x7eff180d0d40 2024-05-11T01:16:09.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff1814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:09.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff1814c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60874/0 (socket says 172.21.15.16:60874) 2024-05-11T01:16:09.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 -- 172.21.15.16:0/67526017 learned_addr learned my addr 172.21.15.16:0/67526017 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:09.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff16d9d640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff18164010 0x7eff1815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:09.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff15d9b640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff180d0d40 0x7eff1815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:09.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 -- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff180d0d40 msgr2=0x7eff1815b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:09.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff180d0d40 0x7eff1815b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 -- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff18164010 msgr2=0x7eff1815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:09.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff18164010 0x7eff1815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 -- 172.21.15.16:0/67526017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1815c090 con 0x7eff180b4cf0 2024-05-11T01:16:09.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff16d9d640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff18164010 0x7eff1815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:09.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.468+0000 7eff1659c640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff1814c530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7eff1002ac70 tx=0x7eff10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:09.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.469+0000 7eff0effd640 1 -- 172.21.15.16:0/67526017 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10040070 con 0x7eff180b4cf0 2024-05-11T01:16:09.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.469+0000 7eff0effd640 1 -- 172.21.15.16:0/67526017 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff10031c40 con 0x7eff180b4cf0 2024-05-11T01:16:09.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.469+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1815c370 con 0x7eff180b4cf0 2024-05-11T01:16:09.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.469+0000 7eff0effd640 1 -- 172.21.15.16:0/67526017 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10009450 con 0x7eff180b4cf0 2024-05-11T01:16:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.469+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1815cc10 con 0x7eff180b4cf0 2024-05-11T01:16:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.470+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1815ce10 con 0x7eff180b4cf0 2024-05-11T01:16:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.470+0000 7eff0effd640 1 -- 172.21.15.16:0/67526017 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7eff10039040 con 0x7eff180b4cf0 2024-05-11T01:16:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.471+0000 7eff0effd640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efef80762d0 0x7efef8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.471+0000 7eff0effd640 1 -- 172.21.15.16:0/67526017 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7eff100b8c00 con 0x7eff180b4cf0 2024-05-11T01:16:09.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.471+0000 7eff15d9b640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efef80762d0 0x7efef8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:09.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.472+0000 7eff15d9b640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efef80762d0 0x7efef8078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff180d1f00 tx=0x7eff00008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:09.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.476+0000 7eff0effd640 1 -- 172.21.15.16:0/67526017 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7eff1815ce10 con 0x7eff180b4cf0 2024-05-11T01:16:09.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.678+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7eff1806a5b0 con 0x7eff180b4cf0 2024-05-11T01:16:09.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.678+0000 7eff0effd640 1 -- 172.21.15.16:0/67526017 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) ==== 80+0+0 (secure 0 0 0) 0x7eff100bf080 con 0x7eff180b4cf0 2024-05-11T01:16:09.678 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-05-11T01:16:09.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efef80762d0 msgr2=0x7efef8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:09.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efef80762d0 0x7efef8078790 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff180d1f00 tx=0x7eff00008040 comp rx=0 tx=0).stop 2024-05-11T01:16:09.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 msgr2=0x7eff1814c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:09.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff1814c530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7eff1002ac70 tx=0x7eff10004a40 comp rx=0 tx=0).stop 2024-05-11T01:16:09.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 shutdown_connections 2024-05-11T01:16:09.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7efef80762d0 0x7efef8078790 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff18164010 0x7eff1815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7eff180d0d40 0x7eff1815b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 --2- 172.21.15.16:0/67526017 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff180b4cf0 0x7eff1814c530 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:09.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 >> 172.21.15.16:0/67526017 conn(0x7eff180681c0 msgr2=0x7eff180ceef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:09.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 shutdown_connections 2024-05-11T01:16:09.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:09.680+0000 7eff1cbe7640 1 -- 172.21.15.16:0/67526017 wait complete. 2024-05-11T01:16:09.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-11T01:16:09.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:09.691 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-11T01:16:09.721 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:16:09.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:09.721 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-11T01:16:09.777 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-05-11T01:16:09.777 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:16:09.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057103,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=11459 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249452k,nr_inodes=812363,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498912k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-11T01:16:09.835 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:16:09.835 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:16:09.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-11T01:16:09.854 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-05-11T01:16:09.854 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-11T01:16:09.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056322,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-11T01:16:09.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:09.913 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-05-11T01:16:09.929 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-11T01:16:09.929 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-11T01:16:09.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:09.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-11T01:16:09.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:09.996 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-11T01:16:10.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.063 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-05-11T01:16:10.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.152 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-05-11T01:16:10.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.168 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-05-11T01:16:10.238 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2024-05-11T01:16:10.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:16:10.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.240 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-11T01:16:10.259 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-11T01:16:10.259 INFO:teuthology.orchestra.run.smithi174.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-11T01:16:10.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.260 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-11T01:16:10.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.331 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-11T01:16:10.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.401 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-11T01:16:10.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.500 DEBUG:teuthology.orchestra.run.smithi174:> ip netns list 2024-05-11T01:16:10.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-11T01:16:10.515 DEBUG:teuthology.orchestra.run.smithi174:> sudo ip link delete ceph-brx 2024-05-11T01:16:10.585 INFO:teuthology.orchestra.run.smithi174.stderr:Cannot find device "ceph-brx" 2024-05-11T01:16:10.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:16:10.586 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-11T01:16:10.595 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-11T01:16:10.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:16:10.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.701+0000 7fcb55bf7640 1 Processor -- start 2024-05-11T01:16:10.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.701+0000 7fcb55bf7640 1 -- start start 2024-05-11T01:16:10.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.701+0000 7fcb55bf7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb500b33e0 0x7fcb500b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:10.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.701+0000 7fcb55bf7640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb5015c6e0 con 0x7fcb50145ae0 2024-05-11T01:16:10.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.701+0000 7fcb55bf7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb50145ec0 con 0x7fcb500b4040 2024-05-11T01:16:10.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.701+0000 7fcb55bf7640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcb5015ccc0 con 0x7fcb500b33e0 2024-05-11T01:16:10.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.702+0000 7fcb4ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb500b33e0 0x7fcb500b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:10.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.702+0000 7fcb4f7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcb50145ae0 0x7fcb5015d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44658/0 (socket says 172.21.15.16:44658) 2024-05-11T01:16:10.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.702+0000 7fcb4f7fe640 1 -- 172.21.15.16:0/2242322681 learned_addr learned my addr 172.21.15.16:0/2242322681 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:10.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.702+0000 7fcb4ffff640 1 -- 172.21.15.16:0/2242322681 >> v1:172.21.15.174:6789/0 conn(0x7fcb500b4040 legacy=0x7fcb500b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:10.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.702+0000 7fcb4ffff640 1 -- 172.21.15.16:0/2242322681 >> v1:172.21.15.16:6789/0 conn(0x7fcb50145ae0 legacy=0x7fcb5015d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:10.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.702+0000 7fcb4e7fc640 1 -- 172.21.15.16:0/2242322681 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809188799 0 0) 0x7fcb5015c6e0 con 0x7fcb50145ae0 2024-05-11T01:16:10.703 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.702+0000 7fcb4ffff640 1 -- 172.21.15.16:0/2242322681 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb500b4a90 con 0x7fcb500b33e0 2024-05-11T01:16:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb4ffff640 1 --2- 172.21.15.16:0/2242322681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb500b33e0 0x7fcb500b44a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009d90 tx=0x7fcb4802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a6efaaf6e77d0c server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:10.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb4e7fc640 1 -- 172.21.15.16:0/2242322681 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48007740 con 0x7fcb500b33e0 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb4e7fc640 1 -- 172.21.15.16:0/2242322681 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb480078e0 con 0x7fcb500b33e0 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb4e7fc640 1 -- 172.21.15.16:0/2242322681 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48007cb0 con 0x7fcb500b33e0 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb55bf7640 1 -- 172.21.15.16:0/2242322681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb500b33e0 msgr2=0x7fcb500b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb55bf7640 1 --2- 172.21.15.16:0/2242322681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb500b33e0 0x7fcb500b44a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009d90 tx=0x7fcb4802a6f0 comp rx=0 tx=0).stop 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb55bf7640 1 -- 172.21.15.16:0/2242322681 shutdown_connections 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb55bf7640 1 --2- 172.21.15.16:0/2242322681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb500b33e0 0x7fcb500b44a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.703+0000 7fcb55bf7640 1 -- 172.21.15.16:0/2242322681 >> 172.21.15.16:0/2242322681 conn(0x7fcb5006fd90 msgr2=0x7fcb5006c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.704+0000 7fcb55bf7640 1 -- 172.21.15.16:0/2242322681 shutdown_connections 2024-05-11T01:16:10.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.704+0000 7fcb55bf7640 1 -- 172.21.15.16:0/2242322681 wait complete. 2024-05-11T01:16:10.706 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.705+0000 7fcb55bf7640 1 Processor -- start 2024-05-11T01:16:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.705+0000 7fcb55bf7640 1 -- start start 2024-05-11T01:16:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb55bf7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb500b33e0 0x7fcb500ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb55bf7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb500b4040 0x7fcb500cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb55bf7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50145ae0 0x7fcb500c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:10.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb55bf7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb50073b70 con 0x7fcb50145ae0 2024-05-11T01:16:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb55bf7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5015c950 con 0x7fcb500b4040 2024-05-11T01:16:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb55bf7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fcb50073cf0 con 0x7fcb500b33e0 2024-05-11T01:16:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50145ae0 0x7fcb500c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50145ae0 0x7fcb500c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60896/0 (socket says 172.21.15.16:60896) 2024-05-11T01:16:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 -- 172.21.15.16:0/1448294992 learned_addr learned my addr 172.21.15.16:0/1448294992 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4effd640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb500b4040 0x7fcb500cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4f7fe640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb500b33e0 0x7fcb500ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:10.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 -- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb500b33e0 msgr2=0x7fcb500ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb500b33e0 0x7fcb500ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 -- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb500b4040 msgr2=0x7fcb500cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb500b4040 0x7fcb500cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 -- 172.21.15.16:0/1448294992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb501372c0 con 0x7fcb50145ae0 2024-05-11T01:16:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.706+0000 7fcb4ffff640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50145ae0 0x7fcb500c8900 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009d90 tx=0x7fcb48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.707+0000 7fcb37fff640 1 -- 172.21.15.16:0/1448294992 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48040070 con 0x7fcb50145ae0 2024-05-11T01:16:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.707+0000 7fcb37fff640 1 -- 172.21.15.16:0/1448294992 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb48031c40 con 0x7fcb50145ae0 2024-05-11T01:16:10.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.707+0000 7fcb37fff640 1 -- 172.21.15.16:0/1448294992 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48003990 con 0x7fcb50145ae0 2024-05-11T01:16:10.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.707+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb501375a0 con 0x7fcb50145ae0 2024-05-11T01:16:10.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.707+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb50137b60 con 0x7fcb50145ae0 2024-05-11T01:16:10.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.708+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5006a5b0 con 0x7fcb50145ae0 2024-05-11T01:16:10.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.708+0000 7fcb37fff640 1 -- 172.21.15.16:0/1448294992 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fcb48039040 con 0x7fcb50145ae0 2024-05-11T01:16:10.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.709+0000 7fcb37fff640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcb3c0762d0 0x7fcb3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:10.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.709+0000 7fcb37fff640 1 -- 172.21.15.16:0/1448294992 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7fcb480b8b50 con 0x7fcb50145ae0 2024-05-11T01:16:10.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.709+0000 7fcb4f7fe640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcb3c0762d0 0x7fcb3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:10.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.710+0000 7fcb4f7fe640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcb3c0762d0 0x7fcb3c078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000f60 tx=0x7fcb40007d00 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:10.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.713+0000 7fcb37fff640 1 -- 172.21.15.16:0/1448294992 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcb48082270 con 0x7fcb50145ae0 2024-05-11T01:16:10.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.898+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb500caea0 con 0x7fcb3c0762d0 2024-05-11T01:16:10.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.905+0000 7fcb37fff640 1 -- 172.21.15.16:0/1448294992 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251834 (secure 0 0 0) 0x7fcb500caea0 con 0x7fcb3c0762d0 2024-05-11T01:16:10.908 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:16:10.909 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:16:10.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcb3c0762d0 msgr2=0x7fcb3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:10.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcb3c0762d0 0x7fcb3c078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000f60 tx=0x7fcb40007d00 comp rx=0 tx=0).stop 2024-05-11T01:16:10.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50145ae0 msgr2=0x7fcb500c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:10.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50145ae0 0x7fcb500c8900 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009d90 tx=0x7fcb48004a40 comp rx=0 tx=0).stop 2024-05-11T01:16:10.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 shutdown_connections 2024-05-11T01:16:10.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb50145ae0 0x7fcb500c8900 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:10.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fcb3c0762d0 0x7fcb3c078790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:10.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcb500b4040 0x7fcb500cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:10.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 --2- 172.21.15.16:0/1448294992 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fcb500b33e0 0x7fcb500ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:10.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 >> 172.21.15.16:0/1448294992 conn(0x7fcb5006fd90 msgr2=0x7fcb500cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:10.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 shutdown_connections 2024-05-11T01:16:10.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:10.908+0000 7fcb55bf7640 1 -- 172.21.15.16:0/1448294992 wait complete. 2024-05-11T01:16:10.919 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-05-11T01:16:09.189967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594021,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":175,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329892,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754644828,"statfs":{"total":773094113280,"available":772756303872,"internally_reserved":0,"allocated":7053312,"data_stored":3923258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003171"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285253+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:14:46.285253+0000","last_peered":"2024-05-11T01:14:46.285253+0000","last_clean":"2024-05-11T01:14:46.285253+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:14:46.285253+0000","last_undegraded":"2024-05-11T01:14:46.285253+0000","last_fullsized":"2024-05-11T01:14:46.285253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287984+0000","last_change":"2024-05-11T01:13:57.592028+0000","last_active":"2024-05-11T01:14:46.287984+0000","last_peered":"2024-05-11T01:14:46.287984+0000","last_clean":"2024-05-11T01:14:46.287984+0000","last_became_active":"2024-05-11T01:13:57.591749+0000","last_became_peered":"2024-05-11T01:13:57.591749+0000","last_unstale":"2024-05-11T01:14:46.287984+0000","last_undegraded":"2024-05-11T01:14:46.287984+0000","last_fullsized":"2024-05-11T01:14:46.287984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:07:26.697058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283899+0000","last_change":"2024-05-11T01:13:57.577565+0000","last_active":"2024-05-11T01:14:46.283899+0000","last_peered":"2024-05-11T01:14:46.283899+0000","last_clean":"2024-05-11T01:14:46.283899+0000","last_became_active":"2024-05-11T01:13:57.577002+0000","last_became_peered":"2024-05-11T01:13:57.577002+0000","last_unstale":"2024-05-11T01:14:46.283899+0000","last_undegraded":"2024-05-11T01:14:46.283899+0000","last_fullsized":"2024-05-11T01:14:46.283899+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:10:34.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189449+0000","last_change":"2024-05-11T01:13:57.588370+0000","last_active":"2024-05-11T01:14:47.189449+0000","last_peered":"2024-05-11T01:14:47.189449+0000","last_clean":"2024-05-11T01:14:47.189449+0000","last_became_active":"2024-05-11T01:13:57.587912+0000","last_became_peered":"2024-05-11T01:13:57.587912+0000","last_unstale":"2024-05-11T01:14:47.189449+0000","last_undegraded":"2024-05-11T01:14:47.189449+0000","last_fullsized":"2024-05-11T01:14:47.189449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286887+0000","last_change":"2024-05-11T01:13:57.589752+0000","last_active":"2024-05-11T01:14:46.286887+0000","last_peered":"2024-05-11T01:14:46.286887+0000","last_clean":"2024-05-11T01:14:46.286887+0000","last_became_active":"2024-05-11T01:13:57.589446+0000","last_became_peered":"2024-05-11T01:13:57.589446+0000","last_unstale":"2024-05-11T01:14:46.286887+0000","last_undegraded":"2024-05-11T01:14:46.286887+0000","last_fullsized":"2024-05-11T01:14:46.286887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:28:37.601407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776331+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:14:46.776331+0000","last_peered":"2024-05-11T01:14:46.776331+0000","last_clean":"2024-05-11T01:14:46.776331+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:14:46.776331+0000","last_undegraded":"2024-05-11T01:14:46.776331+0000","last_fullsized":"2024-05-11T01:14:46.776331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284108+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:14:46.284108+0000","last_peered":"2024-05-11T01:14:46.284108+0000","last_clean":"2024-05-11T01:14:46.284108+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:14:46.284108+0000","last_undegraded":"2024-05-11T01:14:46.284108+0000","last_fullsized":"2024-05-11T01:14:46.284108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.188981+0000","last_change":"2024-05-11T01:13:57.584499+0000","last_active":"2024-05-11T01:14:47.188981+0000","last_peered":"2024-05-11T01:14:47.188981+0000","last_clean":"2024-05-11T01:14:47.188981+0000","last_became_active":"2024-05-11T01:13:57.584207+0000","last_became_peered":"2024-05-11T01:13:57.584207+0000","last_unstale":"2024-05-11T01:14:47.188981+0000","last_undegraded":"2024-05-11T01:14:47.188981+0000","last_fullsized":"2024-05-11T01:14:47.188981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:32:22.587470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189594+0000","last_change":"2024-05-11T01:13:57.587045+0000","last_active":"2024-05-11T01:14:47.189594+0000","last_peered":"2024-05-11T01:14:47.189594+0000","last_clean":"2024-05-11T01:14:47.189594+0000","last_became_active":"2024-05-11T01:13:57.586787+0000","last_became_peered":"2024-05-11T01:13:57.586787+0000","last_unstale":"2024-05-11T01:14:47.189594+0000","last_undegraded":"2024-05-11T01:14:47.189594+0000","last_fullsized":"2024-05-11T01:14:47.189594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189713+0000","last_change":"2024-05-11T01:13:57.587253+0000","last_active":"2024-05-11T01:14:47.189713+0000","last_peered":"2024-05-11T01:14:47.189713+0000","last_clean":"2024-05-11T01:14:47.189713+0000","last_became_active":"2024-05-11T01:13:57.586646+0000","last_became_peered":"2024-05-11T01:13:57.586646+0000","last_unstale":"2024-05-11T01:14:47.189713+0000","last_undegraded":"2024-05-11T01:14:47.189713+0000","last_fullsized":"2024-05-11T01:14:47.189713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189903+0000","last_change":"2024-05-11T01:13:57.587659+0000","last_active":"2024-05-11T01:14:47.189903+0000","last_peered":"2024-05-11T01:14:47.189903+0000","last_clean":"2024-05-11T01:14:47.189903+0000","last_became_active":"2024-05-11T01:13:57.587368+0000","last_became_peered":"2024-05-11T01:13:57.587368+0000","last_unstale":"2024-05-11T01:14:47.189903+0000","last_undegraded":"2024-05-11T01:14:47.189903+0000","last_fullsized":"2024-05-11T01:14:47.189903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286908+0000","last_change":"2024-05-11T01:13:57.584583+0000","last_active":"2024-05-11T01:14:46.286908+0000","last_peered":"2024-05-11T01:14:46.286908+0000","last_clean":"2024-05-11T01:14:46.286908+0000","last_became_active":"2024-05-11T01:13:57.584324+0000","last_became_peered":"2024-05-11T01:13:57.584324+0000","last_unstale":"2024-05-11T01:14:46.286908+0000","last_undegraded":"2024-05-11T01:14:46.286908+0000","last_fullsized":"2024-05-11T01:14:46.286908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:39:33.068502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283756+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:14:46.283756+0000","last_peered":"2024-05-11T01:14:46.283756+0000","last_clean":"2024-05-11T01:14:46.283756+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:14:46.283756+0000","last_undegraded":"2024-05-11T01:14:46.283756+0000","last_fullsized":"2024-05-11T01:14:46.283756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.342397+0000","last_change":"2024-05-11T01:14:46.342397+0000","last_active":"2024-05-11T01:14:46.342397+0000","last_peered":"2024-05-11T01:14:46.342397+0000","last_clean":"2024-05-11T01:14:46.342397+0000","last_became_active":"2024-05-11T01:14:46.342122+0000","last_became_peered":"2024-05-11T01:14:46.342122+0000","last_unstale":"2024-05-11T01:14:46.342397+0000","last_undegraded":"2024-05-11T01:14:46.342397+0000","last_fullsized":"2024-05-11T01:14:46.342397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:01:11.288206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776260+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:14:46.776260+0000","last_peered":"2024-05-11T01:14:46.776260+0000","last_clean":"2024-05-11T01:14:46.776260+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:14:46.776260+0000","last_undegraded":"2024-05-11T01:14:46.776260+0000","last_fullsized":"2024-05-11T01:14:46.776260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286984+0000","last_change":"2024-05-11T01:13:57.587648+0000","last_active":"2024-05-11T01:14:46.286984+0000","last_peered":"2024-05-11T01:14:46.286984+0000","last_clean":"2024-05-11T01:14:46.286984+0000","last_became_active":"2024-05-11T01:13:57.587111+0000","last_became_peered":"2024-05-11T01:13:57.587111+0000","last_unstale":"2024-05-11T01:14:46.286984+0000","last_undegraded":"2024-05-11T01:14:46.286984+0000","last_fullsized":"2024-05-11T01:14:46.286984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284670+0000","last_change":"2024-05-11T01:13:57.580387+0000","last_active":"2024-05-11T01:14:46.284670+0000","last_peered":"2024-05-11T01:14:46.284670+0000","last_clean":"2024-05-11T01:14:46.284670+0000","last_became_active":"2024-05-11T01:13:57.580071+0000","last_became_peered":"2024-05-11T01:13:57.580071+0000","last_unstale":"2024-05-11T01:14:46.284670+0000","last_undegraded":"2024-05-11T01:14:46.284670+0000","last_fullsized":"2024-05-11T01:14:46.284670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:23:20.774634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284854+0000","last_change":"2024-05-11T01:13:57.591548+0000","last_active":"2024-05-11T01:14:46.284854+0000","last_peered":"2024-05-11T01:14:46.284854+0000","last_clean":"2024-05-11T01:14:46.284854+0000","last_became_active":"2024-05-11T01:13:57.591258+0000","last_became_peered":"2024-05-11T01:13:57.591258+0000","last_unstale":"2024-05-11T01:14:46.284854+0000","last_undegraded":"2024-05-11T01:14:46.284854+0000","last_fullsized":"2024-05-11T01:14:46.284854+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:35:06.829596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.289685+0000","last_change":"2024-05-11T01:14:46.289685+0000","last_active":"2024-05-11T01:14:46.289685+0000","last_peered":"2024-05-11T01:14:46.289685+0000","last_clean":"2024-05-11T01:14:46.289685+0000","last_became_active":"2024-05-11T01:14:46.289402+0000","last_became_peered":"2024-05-11T01:14:46.289402+0000","last_unstale":"2024-05-11T01:14:46.289685+0000","last_undegraded":"2024-05-11T01:14:46.289685+0000","last_fullsized":"2024-05-11T01:14:46.289685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:34:21.164320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283990+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:14:46.283990+0000","last_peered":"2024-05-11T01:14:46.283990+0000","last_clean":"2024-05-11T01:14:46.283990+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:14:46.283990+0000","last_undegraded":"2024-05-11T01:14:46.283990+0000","last_fullsized":"2024-05-11T01:14:46.283990+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776383+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:14:46.776383+0000","last_peered":"2024-05-11T01:14:46.776383+0000","last_clean":"2024-05-11T01:14:46.776383+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:14:46.776383+0000","last_undegraded":"2024-05-11T01:14:46.776383+0000","last_fullsized":"2024-05-11T01:14:46.776383+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189389+0000","last_change":"2024-05-11T01:13:57.585351+0000","last_active":"2024-05-11T01:14:47.189389+0000","last_peered":"2024-05-11T01:14:47.189389+0000","last_clean":"2024-05-11T01:14:47.189389+0000","last_became_active":"2024-05-11T01:13:57.585036+0000","last_became_peered":"2024-05-11T01:13:57.585036+0000","last_unstale":"2024-05-11T01:14:47.189389+0000","last_undegraded":"2024-05-11T01:14:47.189389+0000","last_fullsized":"2024-05-11T01:14:47.189389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287134+0000","last_change":"2024-05-11T01:13:57.579302+0000","last_active":"2024-05-11T01:14:46.287134+0000","last_peered":"2024-05-11T01:14:46.287134+0000","last_clean":"2024-05-11T01:14:46.287134+0000","last_became_active":"2024-05-11T01:13:57.578993+0000","last_became_peered":"2024-05-11T01:13:57.578993+0000","last_unstale":"2024-05-11T01:14:46.287134+0000","last_undegraded":"2024-05-11T01:14:46.287134+0000","last_fullsized":"2024-05-11T01:14:46.287134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287011+0000","last_change":"2024-05-11T01:13:57.578977+0000","last_active":"2024-05-11T01:14:46.287011+0000","last_peered":"2024-05-11T01:14:46.287011+0000","last_clean":"2024-05-11T01:14:46.287011+0000","last_became_active":"2024-05-11T01:13:57.578695+0000","last_became_peered":"2024-05-11T01:13:57.578695+0000","last_unstale":"2024-05-11T01:14:46.287011+0000","last_undegraded":"2024-05-11T01:14:46.287011+0000","last_fullsized":"2024-05-11T01:14:46.287011+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287638+0000","last_change":"2024-05-11T01:13:57.577301+0000","last_active":"2024-05-11T01:14:46.287638+0000","last_peered":"2024-05-11T01:14:46.287638+0000","last_clean":"2024-05-11T01:14:46.287638+0000","last_became_active":"2024-05-11T01:13:57.576996+0000","last_became_peered":"2024-05-11T01:13:57.576996+0000","last_unstale":"2024-05-11T01:14:46.287638+0000","last_undegraded":"2024-05-11T01:14:46.287638+0000","last_fullsized":"2024-05-11T01:14:46.287638+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283913+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:14:46.283913+0000","last_peered":"2024-05-11T01:14:46.283913+0000","last_clean":"2024-05-11T01:14:46.283913+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:14:46.283913+0000","last_undegraded":"2024-05-11T01:14:46.283913+0000","last_fullsized":"2024-05-11T01:14:46.283913+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283957+0000","last_change":"2024-05-11T01:13:57.577630+0000","last_active":"2024-05-11T01:14:46.283957+0000","last_peered":"2024-05-11T01:14:46.283957+0000","last_clean":"2024-05-11T01:14:46.283957+0000","last_became_active":"2024-05-11T01:13:57.577363+0000","last_became_peered":"2024-05-11T01:13:57.577363+0000","last_unstale":"2024-05-11T01:14:46.283957+0000","last_undegraded":"2024-05-11T01:14:46.283957+0000","last_fullsized":"2024-05-11T01:14:46.283957+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:45:17.071449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286992+0000","last_change":"2024-05-11T01:13:57.584410+0000","last_active":"2024-05-11T01:14:46.286992+0000","last_peered":"2024-05-11T01:14:46.286992+0000","last_clean":"2024-05-11T01:14:46.286992+0000","last_became_active":"2024-05-11T01:13:57.584164+0000","last_became_peered":"2024-05-11T01:13:57.584164+0000","last_unstale":"2024-05-11T01:14:46.286992+0000","last_undegraded":"2024-05-11T01:14:46.286992+0000","last_fullsized":"2024-05-11T01:14:46.286992+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:57.382038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287343+0000","last_change":"2024-05-11T01:13:57.576284+0000","last_active":"2024-05-11T01:14:46.287343+0000","last_peered":"2024-05-11T01:14:46.287343+0000","last_clean":"2024-05-11T01:14:46.287343+0000","last_became_active":"2024-05-11T01:13:57.575987+0000","last_became_peered":"2024-05-11T01:13:57.575987+0000","last_unstale":"2024-05-11T01:14:46.287343+0000","last_undegraded":"2024-05-11T01:14:46.287343+0000","last_fullsized":"2024-05-11T01:14:46.287343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284095+0000","last_change":"2024-05-11T01:13:57.577419+0000","last_active":"2024-05-11T01:14:46.284095+0000","last_peered":"2024-05-11T01:14:46.284095+0000","last_clean":"2024-05-11T01:14:46.284095+0000","last_became_active":"2024-05-11T01:13:57.576839+0000","last_became_peered":"2024-05-11T01:13:57.576839+0000","last_unstale":"2024-05-11T01:14:46.284095+0000","last_undegraded":"2024-05-11T01:14:46.284095+0000","last_fullsized":"2024-05-11T01:14:46.284095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:40:40.812341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776393+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:14:46.776393+0000","last_peered":"2024-05-11T01:14:46.776393+0000","last_clean":"2024-05-11T01:14:46.776393+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:14:46.776393+0000","last_undegraded":"2024-05-11T01:14:46.776393+0000","last_fullsized":"2024-05-11T01:14:46.776393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283679+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:14:46.283679+0000","last_peered":"2024-05-11T01:14:46.283679+0000","last_clean":"2024-05-11T01:14:46.283679+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:14:46.283679+0000","last_undegraded":"2024-05-11T01:14:46.283679+0000","last_fullsized":"2024-05-11T01:14:46.283679+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341554+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:14:46.341554+0000","last_peered":"2024-05-11T01:14:46.341554+0000","last_clean":"2024-05-11T01:14:46.341554+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:14:46.341554+0000","last_undegraded":"2024-05-11T01:14:46.341554+0000","last_fullsized":"2024-05-11T01:14:46.341554+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776851+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:14:46.776851+0000","last_peered":"2024-05-11T01:14:46.776851+0000","last_clean":"2024-05-11T01:14:46.776851+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:14:46.776851+0000","last_undegraded":"2024-05-11T01:14:46.776851+0000","last_fullsized":"2024-05-11T01:14:46.776851+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287789+0000","last_change":"2024-05-11T01:13:57.572345+0000","last_active":"2024-05-11T01:14:46.287789+0000","last_peered":"2024-05-11T01:14:46.287789+0000","last_clean":"2024-05-11T01:14:46.287789+0000","last_became_active":"2024-05-11T01:13:57.572038+0000","last_became_peered":"2024-05-11T01:13:57.572038+0000","last_unstale":"2024-05-11T01:14:46.287789+0000","last_undegraded":"2024-05-11T01:14:46.287789+0000","last_fullsized":"2024-05-11T01:14:46.287789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285033+0000","last_change":"2024-05-11T01:13:56.576801+0000","last_active":"2024-05-11T01:14:46.285033+0000","last_peered":"2024-05-11T01:14:46.285033+0000","last_clean":"2024-05-11T01:14:46.285033+0000","last_became_active":"2024-05-11T01:13:56.576512+0000","last_became_peered":"2024-05-11T01:13:56.576512+0000","last_unstale":"2024-05-11T01:14:46.285033+0000","last_undegraded":"2024-05-11T01:14:46.285033+0000","last_fullsized":"2024-05-11T01:14:46.285033+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287076+0000","last_change":"2024-05-11T01:13:57.576538+0000","last_active":"2024-05-11T01:14:46.287076+0000","last_peered":"2024-05-11T01:14:46.287076+0000","last_clean":"2024-05-11T01:14:46.287076+0000","last_became_active":"2024-05-11T01:13:57.576234+0000","last_became_peered":"2024-05-11T01:13:57.576234+0000","last_unstale":"2024-05-11T01:14:46.287076+0000","last_undegraded":"2024-05-11T01:14:46.287076+0000","last_fullsized":"2024-05-11T01:14:46.287076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:05:14.944546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341642+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:14:46.341642+0000","last_peered":"2024-05-11T01:14:46.341642+0000","last_clean":"2024-05-11T01:14:46.341642+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:14:46.341642+0000","last_undegraded":"2024-05-11T01:14:46.341642+0000","last_fullsized":"2024-05-11T01:14:46.341642+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341541+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:14:46.341541+0000","last_peered":"2024-05-11T01:14:46.341541+0000","last_clean":"2024-05-11T01:14:46.341541+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:14:46.341541+0000","last_undegraded":"2024-05-11T01:14:46.341541+0000","last_fullsized":"2024-05-11T01:14:46.341541+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284213+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:14:46.284213+0000","last_peered":"2024-05-11T01:14:46.284213+0000","last_clean":"2024-05-11T01:14:46.284213+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:14:46.284213+0000","last_undegraded":"2024-05-11T01:14:46.284213+0000","last_fullsized":"2024-05-11T01:14:46.284213+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284140+0000","last_change":"2024-05-11T01:13:57.578580+0000","last_active":"2024-05-11T01:14:46.284140+0000","last_peered":"2024-05-11T01:14:46.284140+0000","last_clean":"2024-05-11T01:14:46.284140+0000","last_became_active":"2024-05-11T01:13:57.578287+0000","last_became_peered":"2024-05-11T01:13:57.578287+0000","last_unstale":"2024-05-11T01:14:46.284140+0000","last_undegraded":"2024-05-11T01:14:46.284140+0000","last_fullsized":"2024-05-11T01:14:46.284140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:39:09.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776539+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:14:46.776539+0000","last_peered":"2024-05-11T01:14:46.776539+0000","last_clean":"2024-05-11T01:14:46.776539+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:14:46.776539+0000","last_undegraded":"2024-05-11T01:14:46.776539+0000","last_fullsized":"2024-05-11T01:14:46.776539+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189336+0000","last_change":"2024-05-11T01:13:57.591245+0000","last_active":"2024-05-11T01:14:47.189336+0000","last_peered":"2024-05-11T01:14:47.189336+0000","last_clean":"2024-05-11T01:14:47.189336+0000","last_became_active":"2024-05-11T01:13:57.590734+0000","last_became_peered":"2024-05-11T01:13:57.590734+0000","last_unstale":"2024-05-11T01:14:47.189336+0000","last_undegraded":"2024-05-11T01:14:47.189336+0000","last_fullsized":"2024-05-11T01:14:47.189336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284243+0000","last_change":"2024-05-11T01:13:56.574294+0000","last_active":"2024-05-11T01:14:46.284243+0000","last_peered":"2024-05-11T01:14:46.284243+0000","last_clean":"2024-05-11T01:14:46.284243+0000","last_became_active":"2024-05-11T01:13:56.574005+0000","last_became_peered":"2024-05-11T01:13:56.574005+0000","last_unstale":"2024-05-11T01:14:46.284243+0000","last_undegraded":"2024-05-11T01:14:46.284243+0000","last_fullsized":"2024-05-11T01:14:46.284243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:10:19.793450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189029+0000","last_change":"2024-05-11T01:13:57.584809+0000","last_active":"2024-05-11T01:14:47.189029+0000","last_peered":"2024-05-11T01:14:47.189029+0000","last_clean":"2024-05-11T01:14:47.189029+0000","last_became_active":"2024-05-11T01:13:57.584406+0000","last_became_peered":"2024-05-11T01:13:57.584406+0000","last_unstale":"2024-05-11T01:14:47.189029+0000","last_undegraded":"2024-05-11T01:14:47.189029+0000","last_fullsized":"2024-05-11T01:14:47.189029+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286737+0000","last_change":"2024-05-11T01:13:56.573597+0000","last_active":"2024-05-11T01:14:46.286737+0000","last_peered":"2024-05-11T01:14:46.286737+0000","last_clean":"2024-05-11T01:14:46.286737+0000","last_became_active":"2024-05-11T01:13:56.573279+0000","last_became_peered":"2024-05-11T01:13:56.573279+0000","last_unstale":"2024-05-11T01:14:46.286737+0000","last_undegraded":"2024-05-11T01:14:46.286737+0000","last_fullsized":"2024-05-11T01:14:46.286737+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:16:43.996372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287040+0000","last_change":"2024-05-11T01:13:57.579325+0000","last_active":"2024-05-11T01:14:46.287040+0000","last_peered":"2024-05-11T01:14:46.287040+0000","last_clean":"2024-05-11T01:14:46.287040+0000","last_became_active":"2024-05-11T01:13:57.578950+0000","last_became_peered":"2024-05-11T01:13:57.578950+0000","last_unstale":"2024-05-11T01:14:46.287040+0000","last_undegraded":"2024-05-11T01:14:46.287040+0000","last_fullsized":"2024-05-11T01:14:46.287040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189121+0000","last_change":"2024-05-11T01:13:56.572658+0000","last_active":"2024-05-11T01:14:47.189121+0000","last_peered":"2024-05-11T01:14:47.189121+0000","last_clean":"2024-05-11T01:14:47.189121+0000","last_became_active":"2024-05-11T01:13:56.572329+0000","last_became_peered":"2024-05-11T01:13:56.572329+0000","last_unstale":"2024-05-11T01:14:47.189121+0000","last_undegraded":"2024-05-11T01:14:47.189121+0000","last_fullsized":"2024-05-11T01:14:47.189121+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:07:43.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284929+0000","last_change":"2024-05-11T01:13:57.590749+0000","last_active":"2024-05-11T01:14:46.284929+0000","last_peered":"2024-05-11T01:14:46.284929+0000","last_clean":"2024-05-11T01:14:46.284929+0000","last_became_active":"2024-05-11T01:13:57.590241+0000","last_became_peered":"2024-05-11T01:13:57.590241+0000","last_unstale":"2024-05-11T01:14:46.284929+0000","last_undegraded":"2024-05-11T01:14:46.284929+0000","last_fullsized":"2024-05-11T01:14:46.284929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:07:21.860466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284838+0000","last_change":"2024-05-11T01:13:56.571495+0000","last_active":"2024-05-11T01:14:46.284838+0000","last_peered":"2024-05-11T01:14:46.284838+0000","last_clean":"2024-05-11T01:14:46.284838+0000","last_became_active":"2024-05-11T01:13:56.571211+0000","last_became_peered":"2024-05-11T01:13:56.571211+0000","last_unstale":"2024-05-11T01:14:46.284838+0000","last_undegraded":"2024-05-11T01:14:46.284838+0000","last_fullsized":"2024-05-11T01:14:46.284838+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:26:54.553975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285270+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:14:46.285270+0000","last_peered":"2024-05-11T01:14:46.285270+0000","last_clean":"2024-05-11T01:14:46.285270+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:14:46.285270+0000","last_undegraded":"2024-05-11T01:14:46.285270+0000","last_fullsized":"2024-05-11T01:14:46.285270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189839+0000","last_change":"2024-05-11T01:13:56.576731+0000","last_active":"2024-05-11T01:14:47.189839+0000","last_peered":"2024-05-11T01:14:47.189839+0000","last_clean":"2024-05-11T01:14:47.189839+0000","last_became_active":"2024-05-11T01:13:56.576163+0000","last_became_peered":"2024-05-11T01:13:56.576163+0000","last_unstale":"2024-05-11T01:14:47.189839+0000","last_undegraded":"2024-05-11T01:14:47.189839+0000","last_fullsized":"2024-05-11T01:14:47.189839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:38:23.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776622+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:14:46.776622+0000","last_peered":"2024-05-11T01:14:46.776622+0000","last_clean":"2024-05-11T01:14:46.776622+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:14:46.776622+0000","last_undegraded":"2024-05-11T01:14:46.776622+0000","last_fullsized":"2024-05-11T01:14:46.776622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285139+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:14:46.285139+0000","last_peered":"2024-05-11T01:14:46.285139+0000","last_clean":"2024-05-11T01:14:46.285139+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:14:46.285139+0000","last_undegraded":"2024-05-11T01:14:46.285139+0000","last_fullsized":"2024-05-11T01:14:46.285139+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284390+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:14:46.284390+0000","last_peered":"2024-05-11T01:14:46.284390+0000","last_clean":"2024-05-11T01:14:46.284390+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:14:46.284390+0000","last_undegraded":"2024-05-11T01:14:46.284390+0000","last_fullsized":"2024-05-11T01:14:46.284390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"59'9","reported_seq":27,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284055+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:14:46.284055+0000","last_peered":"2024-05-11T01:14:46.284055+0000","last_clean":"2024-05-11T01:14:46.284055+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:14:46.284055+0000","last_undegraded":"2024-05-11T01:14:46.284055+0000","last_fullsized":"2024-05-11T01:14:46.284055+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287250+0000","last_change":"2024-05-11T01:13:57.587446+0000","last_active":"2024-05-11T01:14:46.287250+0000","last_peered":"2024-05-11T01:14:46.287250+0000","last_clean":"2024-05-11T01:14:46.287250+0000","last_became_active":"2024-05-11T01:13:57.587034+0000","last_became_peered":"2024-05-11T01:13:57.587034+0000","last_unstale":"2024-05-11T01:14:46.287250+0000","last_undegraded":"2024-05-11T01:14:46.287250+0000","last_fullsized":"2024-05-11T01:14:46.287250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:51.169562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776593+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:14:46.776593+0000","last_peered":"2024-05-11T01:14:46.776593+0000","last_clean":"2024-05-11T01:14:46.776593+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:14:46.776593+0000","last_undegraded":"2024-05-11T01:14:46.776593+0000","last_fullsized":"2024-05-11T01:14:46.776593+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189401+0000","last_change":"2024-05-11T01:13:57.589755+0000","last_active":"2024-05-11T01:14:47.189401+0000","last_peered":"2024-05-11T01:14:47.189401+0000","last_clean":"2024-05-11T01:14:47.189401+0000","last_became_active":"2024-05-11T01:13:57.589439+0000","last_became_peered":"2024-05-11T01:13:57.589439+0000","last_unstale":"2024-05-11T01:14:47.189401+0000","last_undegraded":"2024-05-11T01:14:47.189401+0000","last_fullsized":"2024-05-11T01:14:47.189401+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284299+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:14:46.284299+0000","last_peered":"2024-05-11T01:14:46.284299+0000","last_clean":"2024-05-11T01:14:46.284299+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:14:46.284299+0000","last_undegraded":"2024-05-11T01:14:46.284299+0000","last_fullsized":"2024-05-11T01:14:46.284299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776250+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:14:46.776250+0000","last_peered":"2024-05-11T01:14:46.776250+0000","last_clean":"2024-05-11T01:14:46.776250+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:14:46.776250+0000","last_undegraded":"2024-05-11T01:14:46.776250+0000","last_fullsized":"2024-05-11T01:14:46.776250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776435+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:14:46.776435+0000","last_peered":"2024-05-11T01:14:46.776435+0000","last_clean":"2024-05-11T01:14:46.776435+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:14:46.776435+0000","last_undegraded":"2024-05-11T01:14:46.776435+0000","last_fullsized":"2024-05-11T01:14:46.776435+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284175+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:14:46.284175+0000","last_peered":"2024-05-11T01:14:46.284175+0000","last_clean":"2024-05-11T01:14:46.284175+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:14:46.284175+0000","last_undegraded":"2024-05-11T01:14:46.284175+0000","last_fullsized":"2024-05-11T01:14:46.284175+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"58'8","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189203+0000","last_change":"2024-05-11T01:13:56.576267+0000","last_active":"2024-05-11T01:14:47.189203+0000","last_peered":"2024-05-11T01:14:47.189203+0000","last_clean":"2024-05-11T01:14:47.189203+0000","last_became_active":"2024-05-11T01:13:56.575422+0000","last_became_peered":"2024-05-11T01:13:56.575422+0000","last_unstale":"2024-05-11T01:14:47.189203+0000","last_undegraded":"2024-05-11T01:14:47.189203+0000","last_fullsized":"2024-05-11T01:14:47.189203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:46:03.149087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283932+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:14:46.283932+0000","last_peered":"2024-05-11T01:14:46.283932+0000","last_clean":"2024-05-11T01:14:46.283932+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:14:46.283932+0000","last_undegraded":"2024-05-11T01:14:46.283932+0000","last_fullsized":"2024-05-11T01:14:46.283932+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284004+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:14:46.284004+0000","last_peered":"2024-05-11T01:14:46.284004+0000","last_clean":"2024-05-11T01:14:46.284004+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:14:46.284004+0000","last_undegraded":"2024-05-11T01:14:46.284004+0000","last_fullsized":"2024-05-11T01:14:46.284004+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189698+0000","last_change":"2024-05-11T01:13:57.589024+0000","last_active":"2024-05-11T01:14:47.189698+0000","last_peered":"2024-05-11T01:14:47.189698+0000","last_clean":"2024-05-11T01:14:47.189698+0000","last_became_active":"2024-05-11T01:13:57.588641+0000","last_became_peered":"2024-05-11T01:13:57.588641+0000","last_unstale":"2024-05-11T01:14:47.189698+0000","last_undegraded":"2024-05-11T01:14:47.189698+0000","last_fullsized":"2024-05-11T01:14:47.189698+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285039+0000","last_change":"2024-05-11T01:13:56.571741+0000","last_active":"2024-05-11T01:14:46.285039+0000","last_peered":"2024-05-11T01:14:46.285039+0000","last_clean":"2024-05-11T01:14:46.285039+0000","last_became_active":"2024-05-11T01:13:56.571143+0000","last_became_peered":"2024-05-11T01:13:56.571143+0000","last_unstale":"2024-05-11T01:14:46.285039+0000","last_undegraded":"2024-05-11T01:14:46.285039+0000","last_fullsized":"2024-05-11T01:14:46.285039+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287406+0000","last_change":"2024-05-11T01:13:57.573076+0000","last_active":"2024-05-11T01:14:46.287406+0000","last_peered":"2024-05-11T01:14:46.287406+0000","last_clean":"2024-05-11T01:14:46.287406+0000","last_became_active":"2024-05-11T01:13:57.572777+0000","last_became_peered":"2024-05-11T01:13:57.572777+0000","last_unstale":"2024-05-11T01:14:46.287406+0000","last_undegraded":"2024-05-11T01:14:46.287406+0000","last_fullsized":"2024-05-11T01:14:46.287406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287479+0000","last_change":"2024-05-11T01:13:56.573996+0000","last_active":"2024-05-11T01:14:46.287479+0000","last_peered":"2024-05-11T01:14:46.287479+0000","last_clean":"2024-05-11T01:14:46.287479+0000","last_became_active":"2024-05-11T01:13:56.573737+0000","last_became_peered":"2024-05-11T01:13:56.573737+0000","last_unstale":"2024-05-11T01:14:46.287479+0000","last_undegraded":"2024-05-11T01:14:46.287479+0000","last_fullsized":"2024-05-11T01:14:46.287479+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287575+0000","last_change":"2024-05-11T01:13:57.577270+0000","last_active":"2024-05-11T01:14:46.287575+0000","last_peered":"2024-05-11T01:14:46.287575+0000","last_clean":"2024-05-11T01:14:46.287575+0000","last_became_active":"2024-05-11T01:13:57.576978+0000","last_became_peered":"2024-05-11T01:13:57.576978+0000","last_unstale":"2024-05-11T01:14:46.287575+0000","last_undegraded":"2024-05-11T01:14:46.287575+0000","last_fullsized":"2024-05-11T01:14:46.287575+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776654+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:14:46.776654+0000","last_peered":"2024-05-11T01:14:46.776654+0000","last_clean":"2024-05-11T01:14:46.776654+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:14:46.776654+0000","last_undegraded":"2024-05-11T01:14:46.776654+0000","last_fullsized":"2024-05-11T01:14:46.776654+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776357+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:14:46.776357+0000","last_peered":"2024-05-11T01:14:46.776357+0000","last_clean":"2024-05-11T01:14:46.776357+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:14:46.776357+0000","last_undegraded":"2024-05-11T01:14:46.776357+0000","last_fullsized":"2024-05-11T01:14:46.776357+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776758+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:14:46.776758+0000","last_peered":"2024-05-11T01:14:46.776758+0000","last_clean":"2024-05-11T01:14:46.776758+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:14:46.776758+0000","last_undegraded":"2024-05-11T01:14:46.776758+0000","last_fullsized":"2024-05-11T01:14:46.776758+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341240+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:14:46.341240+0000","last_peered":"2024-05-11T01:14:46.341240+0000","last_clean":"2024-05-11T01:14:46.341240+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:14:46.341240+0000","last_undegraded":"2024-05-11T01:14:46.341240+0000","last_fullsized":"2024-05-11T01:14:46.341240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287365+0000","last_change":"2024-05-11T01:13:56.581631+0000","last_active":"2024-05-11T01:14:46.287365+0000","last_peered":"2024-05-11T01:14:46.287365+0000","last_clean":"2024-05-11T01:14:46.287365+0000","last_became_active":"2024-05-11T01:13:56.581299+0000","last_became_peered":"2024-05-11T01:13:56.581299+0000","last_unstale":"2024-05-11T01:14:46.287365+0000","last_undegraded":"2024-05-11T01:14:46.287365+0000","last_fullsized":"2024-05-11T01:14:46.287365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:35:01.793210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283636+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:14:46.283636+0000","last_peered":"2024-05-11T01:14:46.283636+0000","last_clean":"2024-05-11T01:14:46.283636+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:14:46.283636+0000","last_undegraded":"2024-05-11T01:14:46.283636+0000","last_fullsized":"2024-05-11T01:14:46.283636+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189307+0000","last_change":"2024-05-11T01:13:56.575003+0000","last_active":"2024-05-11T01:14:47.189307+0000","last_peered":"2024-05-11T01:14:47.189307+0000","last_clean":"2024-05-11T01:14:47.189307+0000","last_became_active":"2024-05-11T01:13:56.574726+0000","last_became_peered":"2024-05-11T01:13:56.574726+0000","last_unstale":"2024-05-11T01:14:47.189307+0000","last_undegraded":"2024-05-11T01:14:47.189307+0000","last_fullsized":"2024-05-11T01:14:47.189307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:15:10.911003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189052+0000","last_change":"2024-05-11T01:13:57.576056+0000","last_active":"2024-05-11T01:14:47.189052+0000","last_peered":"2024-05-11T01:14:47.189052+0000","last_clean":"2024-05-11T01:14:47.189052+0000","last_became_active":"2024-05-11T01:13:57.575723+0000","last_became_peered":"2024-05-11T01:13:57.575723+0000","last_unstale":"2024-05-11T01:14:47.189052+0000","last_undegraded":"2024-05-11T01:14:47.189052+0000","last_fullsized":"2024-05-11T01:14:47.189052+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:23:18.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284012+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:14:46.284012+0000","last_peered":"2024-05-11T01:14:46.284012+0000","last_clean":"2024-05-11T01:14:46.284012+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:14:46.284012+0000","last_undegraded":"2024-05-11T01:14:46.284012+0000","last_fullsized":"2024-05-11T01:14:46.284012+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287843+0000","last_change":"2024-05-11T01:13:57.587557+0000","last_active":"2024-05-11T01:14:46.287843+0000","last_peered":"2024-05-11T01:14:46.287843+0000","last_clean":"2024-05-11T01:14:46.287843+0000","last_became_active":"2024-05-11T01:13:57.587255+0000","last_became_peered":"2024-05-11T01:13:57.587255+0000","last_unstale":"2024-05-11T01:14:46.287843+0000","last_undegraded":"2024-05-11T01:14:46.287843+0000","last_fullsized":"2024-05-11T01:14:46.287843+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"61'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:15:09.587711+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:15:09.587711+0000","last_peered":"2024-05-11T01:15:09.587711+0000","last_clean":"2024-05-11T01:15:09.587711+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:15:09.587711+0000","last_undegraded":"2024-05-11T01:15:09.587711+0000","last_fullsized":"2024-05-11T01:15:09.587711+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189623+0000","last_change":"2024-05-11T01:13:57.588129+0000","last_active":"2024-05-11T01:14:47.189623+0000","last_peered":"2024-05-11T01:14:47.189623+0000","last_clean":"2024-05-11T01:14:47.189623+0000","last_became_active":"2024-05-11T01:13:57.577948+0000","last_became_peered":"2024-05-11T01:13:57.577948+0000","last_unstale":"2024-05-11T01:14:47.189623+0000","last_undegraded":"2024-05-11T01:14:47.189623+0000","last_fullsized":"2024-05-11T01:14:47.189623+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285353+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:14:46.285353+0000","last_peered":"2024-05-11T01:14:46.285353+0000","last_clean":"2024-05-11T01:14:46.285353+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:14:46.285353+0000","last_undegraded":"2024-05-11T01:14:46.285353+0000","last_fullsized":"2024-05-11T01:14:46.285353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285181+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:14:46.285181+0000","last_peered":"2024-05-11T01:14:46.285181+0000","last_clean":"2024-05-11T01:14:46.285181+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:14:46.285181+0000","last_undegraded":"2024-05-11T01:14:46.285181+0000","last_fullsized":"2024-05-11T01:14:46.285181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341392+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:14:46.341392+0000","last_peered":"2024-05-11T01:14:46.341392+0000","last_clean":"2024-05-11T01:14:46.341392+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:14:46.341392+0000","last_undegraded":"2024-05-11T01:14:46.341392+0000","last_fullsized":"2024-05-11T01:14:46.341392+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776562+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:14:46.776562+0000","last_peered":"2024-05-11T01:14:46.776562+0000","last_clean":"2024-05-11T01:14:46.776562+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:14:46.776562+0000","last_undegraded":"2024-05-11T01:14:46.776562+0000","last_fullsized":"2024-05-11T01:14:46.776562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284511+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:14:46.284511+0000","last_peered":"2024-05-11T01:14:46.284511+0000","last_clean":"2024-05-11T01:14:46.284511+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:14:46.284511+0000","last_undegraded":"2024-05-11T01:14:46.284511+0000","last_fullsized":"2024-05-11T01:14:46.284511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776496+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:14:46.776496+0000","last_peered":"2024-05-11T01:14:46.776496+0000","last_clean":"2024-05-11T01:14:46.776496+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:14:46.776496+0000","last_undegraded":"2024-05-11T01:14:46.776496+0000","last_fullsized":"2024-05-11T01:14:46.776496+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284370+0000","last_change":"2024-05-11T01:13:56.573647+0000","last_active":"2024-05-11T01:14:46.284370+0000","last_peered":"2024-05-11T01:14:46.284370+0000","last_clean":"2024-05-11T01:14:46.284370+0000","last_became_active":"2024-05-11T01:13:56.573347+0000","last_became_peered":"2024-05-11T01:13:56.573347+0000","last_unstale":"2024-05-11T01:14:46.284370+0000","last_undegraded":"2024-05-11T01:14:46.284370+0000","last_fullsized":"2024-05-11T01:14:46.284370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:47:34.803535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286760+0000","last_change":"2024-05-11T01:13:57.582673+0000","last_active":"2024-05-11T01:14:46.286760+0000","last_peered":"2024-05-11T01:14:46.286760+0000","last_clean":"2024-05-11T01:14:46.286760+0000","last_became_active":"2024-05-11T01:13:57.582398+0000","last_became_peered":"2024-05-11T01:13:57.582398+0000","last_unstale":"2024-05-11T01:14:46.286760+0000","last_undegraded":"2024-05-11T01:14:46.286760+0000","last_fullsized":"2024-05-11T01:14:46.286760+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:53:00.000306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341258+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:14:46.341258+0000","last_peered":"2024-05-11T01:14:46.341258+0000","last_clean":"2024-05-11T01:14:46.341258+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:14:46.341258+0000","last_undegraded":"2024-05-11T01:14:46.341258+0000","last_fullsized":"2024-05-11T01:14:46.341258+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283991+0000","last_change":"2024-05-11T01:13:57.575506+0000","last_active":"2024-05-11T01:14:46.283991+0000","last_peered":"2024-05-11T01:14:46.283991+0000","last_clean":"2024-05-11T01:14:46.283991+0000","last_became_active":"2024-05-11T01:13:57.575239+0000","last_became_peered":"2024-05-11T01:13:57.575239+0000","last_unstale":"2024-05-11T01:14:46.283991+0000","last_undegraded":"2024-05-11T01:14:46.283991+0000","last_fullsized":"2024-05-11T01:14:46.283991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:33:02.113131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189357+0000","last_change":"2024-05-11T01:13:56.576345+0000","last_active":"2024-05-11T01:14:47.189357+0000","last_peered":"2024-05-11T01:14:47.189357+0000","last_clean":"2024-05-11T01:14:47.189357+0000","last_became_active":"2024-05-11T01:13:56.575838+0000","last_became_peered":"2024-05-11T01:13:56.575838+0000","last_unstale":"2024-05-11T01:14:47.189357+0000","last_undegraded":"2024-05-11T01:14:47.189357+0000","last_fullsized":"2024-05-11T01:14:47.189357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:51.632315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189764+0000","last_change":"2024-05-11T01:13:57.588794+0000","last_active":"2024-05-11T01:14:47.189764+0000","last_peered":"2024-05-11T01:14:47.189764+0000","last_clean":"2024-05-11T01:14:47.189764+0000","last_became_active":"2024-05-11T01:13:57.586986+0000","last_became_peered":"2024-05-11T01:13:57.586986+0000","last_unstale":"2024-05-11T01:14:47.189764+0000","last_undegraded":"2024-05-11T01:14:47.189764+0000","last_fullsized":"2024-05-11T01:14:47.189764+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:00:28.690447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287873+0000","last_change":"2024-05-11T01:13:56.579830+0000","last_active":"2024-05-11T01:14:46.287873+0000","last_peered":"2024-05-11T01:14:46.287873+0000","last_clean":"2024-05-11T01:14:46.287873+0000","last_became_active":"2024-05-11T01:13:56.579637+0000","last_became_peered":"2024-05-11T01:13:56.579637+0000","last_unstale":"2024-05-11T01:14:46.287873+0000","last_undegraded":"2024-05-11T01:14:46.287873+0000","last_fullsized":"2024-05-11T01:14:46.287873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":249,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284042+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:14:46.284042+0000","last_peered":"2024-05-11T01:14:46.284042+0000","last_clean":"2024-05-11T01:14:46.284042+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:14:46.284042+0000","last_undegraded":"2024-05-11T01:14:46.284042+0000","last_fullsized":"2024-05-11T01:14:46.284042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3653,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":932360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":342574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54112,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317728,"statfs":{"total":96636764160,"available":96581353472,"internally_reserved":0,"allocated":737280,"data_stored":344757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40224,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331616,"statfs":{"total":96636764160,"available":96595574784,"internally_reserved":0,"allocated":737280,"data_stored":342540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44384,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327456,"statfs":{"total":96636764160,"available":96591314944,"internally_reserved":0,"allocated":741376,"data_stored":344779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58264,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313576,"statfs":{"total":96636764160,"available":96577101824,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575031,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1323008,"data_stored":932304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:16:10.924 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:16:11.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.063+0000 7f9175600640 1 Processor -- start 2024-05-11T01:16:11.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.063+0000 7f9175600640 1 -- start start 2024-05-11T01:16:11.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f9175600640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917006db00 0x7f91701616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f9175600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f91700b0b00 0x7f91700b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f9175600640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91700737d0 con 0x7f917015d250 2024-05-11T01:16:11.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f9175600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f91700681c0 con 0x7f91700b0b00 2024-05-11T01:16:11.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f9175600640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f91700684a0 con 0x7f917006db00 2024-05-11T01:16:11.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f916f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f91700b0b00 0x7f91700b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f916f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f91700b0b00 0x7f91700b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60902/0 (socket says 172.21.15.16:60902) 2024-05-11T01:16:11.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f916f7fe640 1 -- 172.21.15.16:0/2166976310 learned_addr learned my addr 172.21.15.16:0/2166976310 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:11.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f91667fc640 1 --2- 172.21.15.16:0/2166976310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917006db00 0x7f91701616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f916f7fe640 1 -- 172.21.15.16:0/2166976310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917006db00 msgr2=0x7f91701616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:11.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f916f7fe640 1 --2- 172.21.15.16:0/2166976310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917006db00 0x7f91701616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f916f7fe640 1 -- 172.21.15.16:0/2166976310 >> v1:172.21.15.174:6789/0 conn(0x7f917015d250 legacy=0x7f917006d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.064+0000 7f916f7fe640 1 -- 172.21.15.16:0/2166976310 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9170068930 con 0x7f91700b0b00 2024-05-11T01:16:11.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.065+0000 7f916f7fe640 1 --2- 172.21.15.16:0/2166976310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91700b6190 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9168009e50 tx=0x7f916802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e370a7286424f4d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.065+0000 7f916e7fc640 1 -- 172.21.15.16:0/2166976310 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9168036070 con 0x7f91700b0b00 2024-05-11T01:16:11.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.065+0000 7f916e7fc640 1 -- 172.21.15.16:0/2166976310 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9168031600 con 0x7f91700b0b00 2024-05-11T01:16:11.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.065+0000 7f916e7fc640 1 -- 172.21.15.16:0/2166976310 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91680319d0 con 0x7f91700b0b00 2024-05-11T01:16:11.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.066+0000 7f9175600640 1 -- 172.21.15.16:0/2166976310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 msgr2=0x7f91700b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.066+0000 7f9175600640 1 --2- 172.21.15.16:0/2166976310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91700b6190 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9168009e50 tx=0x7f916802a710 comp rx=0 tx=0).stop 2024-05-11T01:16:11.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.066+0000 7f9175600640 1 -- 172.21.15.16:0/2166976310 shutdown_connections 2024-05-11T01:16:11.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.066+0000 7f9175600640 1 --2- 172.21.15.16:0/2166976310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91700b6190 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.066+0000 7f9175600640 1 --2- 172.21.15.16:0/2166976310 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917006db00 0x7f91701616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.066+0000 7f9175600640 1 -- 172.21.15.16:0/2166976310 >> 172.21.15.16:0/2166976310 conn(0x7f9170072a40 msgr2=0x7f9170072e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:11.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.066+0000 7f9175600640 1 -- 172.21.15.16:0/2166976310 shutdown_connections 2024-05-11T01:16:11.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.066+0000 7f9175600640 1 -- 172.21.15.16:0/2166976310 wait complete. 2024-05-11T01:16:11.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.067+0000 7f9175600640 1 Processor -- start 2024-05-11T01:16:11.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.067+0000 7f9175600640 1 -- start start 2024-05-11T01:16:11.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f9175600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f917006db00 0x7f917015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f9175600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91701e8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f9175600640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917015d250 0x7f9170158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f9175600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f91700b4b20 con 0x7f91700b0b00 2024-05-11T01:16:11.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f9175600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f91700b45a0 con 0x7f917006db00 2024-05-11T01:16:11.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f9175600640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f91700b66d0 con 0x7f917015d250 2024-05-11T01:16:11.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91701e8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91701e8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60914/0 (socket says 172.21.15.16:60914) 2024-05-11T01:16:11.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 -- 172.21.15.16:0/3774363764 learned_addr learned my addr 172.21.15.16:0/3774363764 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:11.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f916f7fe640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917015d250 0x7f9170158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f916effd640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f917006db00 0x7f917015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 -- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917015d250 msgr2=0x7f9170158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917015d250 0x7f9170158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 -- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f917006db00 msgr2=0x7f917015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f917006db00 0x7f917015ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 -- 172.21.15.16:0/3774363764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917015f5d0 con 0x7f91700b0b00 2024-05-11T01:16:11.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f916effd640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f917006db00 0x7f917015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:11.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.068+0000 7f91667fc640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91701e8790 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f915800e9b0 tx=0x7f915800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.069+0000 7f9167fff640 1 -- 172.21.15.16:0/3774363764 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158017070 con 0x7f91700b0b00 2024-05-11T01:16:11.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.069+0000 7f9167fff640 1 -- 172.21.15.16:0/3774363764 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915800c9a0 con 0x7f91700b0b00 2024-05-11T01:16:11.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.069+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917015fb60 con 0x7f91700b0b00 2024-05-11T01:16:11.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.069+0000 7f9167fff640 1 -- 172.21.15.16:0/3774363764 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915800cd90 con 0x7f91700b0b00 2024-05-11T01:16:11.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.069+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9170160120 con 0x7f91700b0b00 2024-05-11T01:16:11.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.070+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9170050860 con 0x7f91700b0b00 2024-05-11T01:16:11.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.070+0000 7f9167fff640 1 -- 172.21.15.16:0/3774363764 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f915801a070 con 0x7f91700b0b00 2024-05-11T01:16:11.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.071+0000 7f9167fff640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f91500762d0 0x7f9150078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.071+0000 7f9167fff640 1 -- 172.21.15.16:0/3774363764 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f9158097800 con 0x7f91700b0b00 2024-05-11T01:16:11.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.071+0000 7f916effd640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f91500762d0 0x7f9150078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.071+0000 7f916effd640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f91500762d0 0x7f9150078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9160007fd0 tx=0x7f9160009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.075+0000 7f9167fff640 1 -- 172.21.15.16:0/3774363764 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91580608c0 con 0x7f91700b0b00 2024-05-11T01:16:11.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.262+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9170071400 con 0x7f91500762d0 2024-05-11T01:16:11.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.269+0000 7f9167fff640 1 -- 172.21.15.16:0/3774363764 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251840 (secure 0 0 0) 0x7f9170071400 con 0x7f91500762d0 2024-05-11T01:16:11.271 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:16:11.272 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:16:11.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.271+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f91500762d0 msgr2=0x7f9150078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.271+0000 7f9175600640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f91500762d0 0x7f9150078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9160007fd0 tx=0x7f9160009040 comp rx=0 tx=0).stop 2024-05-11T01:16:11.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.271+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 msgr2=0x7f91701e8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.271+0000 7f9175600640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91701e8790 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f915800e9b0 tx=0x7f915800ee70 comp rx=0 tx=0).stop 2024-05-11T01:16:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.272+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 shutdown_connections 2024-05-11T01:16:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.272+0000 7f9175600640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f917015d250 0x7f9170158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.272+0000 7f9175600640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f91700b0b00 0x7f91701e8790 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.272+0000 7f9175600640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f91500762d0 0x7f9150078790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.272+0000 7f9175600640 1 --2- 172.21.15.16:0/3774363764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f917006db00 0x7f917015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.272+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 >> 172.21.15.16:0/3774363764 conn(0x7f9170072a40 msgr2=0x7f91700cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.272+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 shutdown_connections 2024-05-11T01:16:11.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.272+0000 7f9175600640 1 -- 172.21.15.16:0/3774363764 wait complete. 2024-05-11T01:16:11.282 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-05-11T01:16:11.190439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594162,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":179,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329880,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754644840,"statfs":{"total":773094113280,"available":772756316160,"internally_reserved":0,"allocated":7053312,"data_stored":3923540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003029"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285253+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:14:46.285253+0000","last_peered":"2024-05-11T01:14:46.285253+0000","last_clean":"2024-05-11T01:14:46.285253+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:14:46.285253+0000","last_undegraded":"2024-05-11T01:14:46.285253+0000","last_fullsized":"2024-05-11T01:14:46.285253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287984+0000","last_change":"2024-05-11T01:13:57.592028+0000","last_active":"2024-05-11T01:14:46.287984+0000","last_peered":"2024-05-11T01:14:46.287984+0000","last_clean":"2024-05-11T01:14:46.287984+0000","last_became_active":"2024-05-11T01:13:57.591749+0000","last_became_peered":"2024-05-11T01:13:57.591749+0000","last_unstale":"2024-05-11T01:14:46.287984+0000","last_undegraded":"2024-05-11T01:14:46.287984+0000","last_fullsized":"2024-05-11T01:14:46.287984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:07:26.697058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283899+0000","last_change":"2024-05-11T01:13:57.577565+0000","last_active":"2024-05-11T01:14:46.283899+0000","last_peered":"2024-05-11T01:14:46.283899+0000","last_clean":"2024-05-11T01:14:46.283899+0000","last_became_active":"2024-05-11T01:13:57.577002+0000","last_became_peered":"2024-05-11T01:13:57.577002+0000","last_unstale":"2024-05-11T01:14:46.283899+0000","last_undegraded":"2024-05-11T01:14:46.283899+0000","last_fullsized":"2024-05-11T01:14:46.283899+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:10:34.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189449+0000","last_change":"2024-05-11T01:13:57.588370+0000","last_active":"2024-05-11T01:14:47.189449+0000","last_peered":"2024-05-11T01:14:47.189449+0000","last_clean":"2024-05-11T01:14:47.189449+0000","last_became_active":"2024-05-11T01:13:57.587912+0000","last_became_peered":"2024-05-11T01:13:57.587912+0000","last_unstale":"2024-05-11T01:14:47.189449+0000","last_undegraded":"2024-05-11T01:14:47.189449+0000","last_fullsized":"2024-05-11T01:14:47.189449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286887+0000","last_change":"2024-05-11T01:13:57.589752+0000","last_active":"2024-05-11T01:14:46.286887+0000","last_peered":"2024-05-11T01:14:46.286887+0000","last_clean":"2024-05-11T01:14:46.286887+0000","last_became_active":"2024-05-11T01:13:57.589446+0000","last_became_peered":"2024-05-11T01:13:57.589446+0000","last_unstale":"2024-05-11T01:14:46.286887+0000","last_undegraded":"2024-05-11T01:14:46.286887+0000","last_fullsized":"2024-05-11T01:14:46.286887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:28:37.601407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776331+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:14:46.776331+0000","last_peered":"2024-05-11T01:14:46.776331+0000","last_clean":"2024-05-11T01:14:46.776331+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:14:46.776331+0000","last_undegraded":"2024-05-11T01:14:46.776331+0000","last_fullsized":"2024-05-11T01:14:46.776331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284108+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:14:46.284108+0000","last_peered":"2024-05-11T01:14:46.284108+0000","last_clean":"2024-05-11T01:14:46.284108+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:14:46.284108+0000","last_undegraded":"2024-05-11T01:14:46.284108+0000","last_fullsized":"2024-05-11T01:14:46.284108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.188981+0000","last_change":"2024-05-11T01:13:57.584499+0000","last_active":"2024-05-11T01:14:47.188981+0000","last_peered":"2024-05-11T01:14:47.188981+0000","last_clean":"2024-05-11T01:14:47.188981+0000","last_became_active":"2024-05-11T01:13:57.584207+0000","last_became_peered":"2024-05-11T01:13:57.584207+0000","last_unstale":"2024-05-11T01:14:47.188981+0000","last_undegraded":"2024-05-11T01:14:47.188981+0000","last_fullsized":"2024-05-11T01:14:47.188981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:32:22.587470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189594+0000","last_change":"2024-05-11T01:13:57.587045+0000","last_active":"2024-05-11T01:14:47.189594+0000","last_peered":"2024-05-11T01:14:47.189594+0000","last_clean":"2024-05-11T01:14:47.189594+0000","last_became_active":"2024-05-11T01:13:57.586787+0000","last_became_peered":"2024-05-11T01:13:57.586787+0000","last_unstale":"2024-05-11T01:14:47.189594+0000","last_undegraded":"2024-05-11T01:14:47.189594+0000","last_fullsized":"2024-05-11T01:14:47.189594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189713+0000","last_change":"2024-05-11T01:13:57.587253+0000","last_active":"2024-05-11T01:14:47.189713+0000","last_peered":"2024-05-11T01:14:47.189713+0000","last_clean":"2024-05-11T01:14:47.189713+0000","last_became_active":"2024-05-11T01:13:57.586646+0000","last_became_peered":"2024-05-11T01:13:57.586646+0000","last_unstale":"2024-05-11T01:14:47.189713+0000","last_undegraded":"2024-05-11T01:14:47.189713+0000","last_fullsized":"2024-05-11T01:14:47.189713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189903+0000","last_change":"2024-05-11T01:13:57.587659+0000","last_active":"2024-05-11T01:14:47.189903+0000","last_peered":"2024-05-11T01:14:47.189903+0000","last_clean":"2024-05-11T01:14:47.189903+0000","last_became_active":"2024-05-11T01:13:57.587368+0000","last_became_peered":"2024-05-11T01:13:57.587368+0000","last_unstale":"2024-05-11T01:14:47.189903+0000","last_undegraded":"2024-05-11T01:14:47.189903+0000","last_fullsized":"2024-05-11T01:14:47.189903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286908+0000","last_change":"2024-05-11T01:13:57.584583+0000","last_active":"2024-05-11T01:14:46.286908+0000","last_peered":"2024-05-11T01:14:46.286908+0000","last_clean":"2024-05-11T01:14:46.286908+0000","last_became_active":"2024-05-11T01:13:57.584324+0000","last_became_peered":"2024-05-11T01:13:57.584324+0000","last_unstale":"2024-05-11T01:14:46.286908+0000","last_undegraded":"2024-05-11T01:14:46.286908+0000","last_fullsized":"2024-05-11T01:14:46.286908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:39:33.068502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283756+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:14:46.283756+0000","last_peered":"2024-05-11T01:14:46.283756+0000","last_clean":"2024-05-11T01:14:46.283756+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:14:46.283756+0000","last_undegraded":"2024-05-11T01:14:46.283756+0000","last_fullsized":"2024-05-11T01:14:46.283756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.342397+0000","last_change":"2024-05-11T01:14:46.342397+0000","last_active":"2024-05-11T01:14:46.342397+0000","last_peered":"2024-05-11T01:14:46.342397+0000","last_clean":"2024-05-11T01:14:46.342397+0000","last_became_active":"2024-05-11T01:14:46.342122+0000","last_became_peered":"2024-05-11T01:14:46.342122+0000","last_unstale":"2024-05-11T01:14:46.342397+0000","last_undegraded":"2024-05-11T01:14:46.342397+0000","last_fullsized":"2024-05-11T01:14:46.342397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:01:11.288206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776260+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:14:46.776260+0000","last_peered":"2024-05-11T01:14:46.776260+0000","last_clean":"2024-05-11T01:14:46.776260+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:14:46.776260+0000","last_undegraded":"2024-05-11T01:14:46.776260+0000","last_fullsized":"2024-05-11T01:14:46.776260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286984+0000","last_change":"2024-05-11T01:13:57.587648+0000","last_active":"2024-05-11T01:14:46.286984+0000","last_peered":"2024-05-11T01:14:46.286984+0000","last_clean":"2024-05-11T01:14:46.286984+0000","last_became_active":"2024-05-11T01:13:57.587111+0000","last_became_peered":"2024-05-11T01:13:57.587111+0000","last_unstale":"2024-05-11T01:14:46.286984+0000","last_undegraded":"2024-05-11T01:14:46.286984+0000","last_fullsized":"2024-05-11T01:14:46.286984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284670+0000","last_change":"2024-05-11T01:13:57.580387+0000","last_active":"2024-05-11T01:14:46.284670+0000","last_peered":"2024-05-11T01:14:46.284670+0000","last_clean":"2024-05-11T01:14:46.284670+0000","last_became_active":"2024-05-11T01:13:57.580071+0000","last_became_peered":"2024-05-11T01:13:57.580071+0000","last_unstale":"2024-05-11T01:14:46.284670+0000","last_undegraded":"2024-05-11T01:14:46.284670+0000","last_fullsized":"2024-05-11T01:14:46.284670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:23:20.774634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284854+0000","last_change":"2024-05-11T01:13:57.591548+0000","last_active":"2024-05-11T01:14:46.284854+0000","last_peered":"2024-05-11T01:14:46.284854+0000","last_clean":"2024-05-11T01:14:46.284854+0000","last_became_active":"2024-05-11T01:13:57.591258+0000","last_became_peered":"2024-05-11T01:13:57.591258+0000","last_unstale":"2024-05-11T01:14:46.284854+0000","last_undegraded":"2024-05-11T01:14:46.284854+0000","last_fullsized":"2024-05-11T01:14:46.284854+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:35:06.829596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.289685+0000","last_change":"2024-05-11T01:14:46.289685+0000","last_active":"2024-05-11T01:14:46.289685+0000","last_peered":"2024-05-11T01:14:46.289685+0000","last_clean":"2024-05-11T01:14:46.289685+0000","last_became_active":"2024-05-11T01:14:46.289402+0000","last_became_peered":"2024-05-11T01:14:46.289402+0000","last_unstale":"2024-05-11T01:14:46.289685+0000","last_undegraded":"2024-05-11T01:14:46.289685+0000","last_fullsized":"2024-05-11T01:14:46.289685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:34:21.164320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283990+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:14:46.283990+0000","last_peered":"2024-05-11T01:14:46.283990+0000","last_clean":"2024-05-11T01:14:46.283990+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:14:46.283990+0000","last_undegraded":"2024-05-11T01:14:46.283990+0000","last_fullsized":"2024-05-11T01:14:46.283990+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776383+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:14:46.776383+0000","last_peered":"2024-05-11T01:14:46.776383+0000","last_clean":"2024-05-11T01:14:46.776383+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:14:46.776383+0000","last_undegraded":"2024-05-11T01:14:46.776383+0000","last_fullsized":"2024-05-11T01:14:46.776383+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189389+0000","last_change":"2024-05-11T01:13:57.585351+0000","last_active":"2024-05-11T01:14:47.189389+0000","last_peered":"2024-05-11T01:14:47.189389+0000","last_clean":"2024-05-11T01:14:47.189389+0000","last_became_active":"2024-05-11T01:13:57.585036+0000","last_became_peered":"2024-05-11T01:13:57.585036+0000","last_unstale":"2024-05-11T01:14:47.189389+0000","last_undegraded":"2024-05-11T01:14:47.189389+0000","last_fullsized":"2024-05-11T01:14:47.189389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287134+0000","last_change":"2024-05-11T01:13:57.579302+0000","last_active":"2024-05-11T01:14:46.287134+0000","last_peered":"2024-05-11T01:14:46.287134+0000","last_clean":"2024-05-11T01:14:46.287134+0000","last_became_active":"2024-05-11T01:13:57.578993+0000","last_became_peered":"2024-05-11T01:13:57.578993+0000","last_unstale":"2024-05-11T01:14:46.287134+0000","last_undegraded":"2024-05-11T01:14:46.287134+0000","last_fullsized":"2024-05-11T01:14:46.287134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287076+0000","last_change":"2024-05-11T01:13:57.578977+0000","last_active":"2024-05-11T01:14:46.287076+0000","last_peered":"2024-05-11T01:14:46.287076+0000","last_clean":"2024-05-11T01:14:46.287076+0000","last_became_active":"2024-05-11T01:13:57.578695+0000","last_became_peered":"2024-05-11T01:13:57.578695+0000","last_unstale":"2024-05-11T01:14:46.287076+0000","last_undegraded":"2024-05-11T01:14:46.287076+0000","last_fullsized":"2024-05-11T01:14:46.287076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287690+0000","last_change":"2024-05-11T01:13:57.577301+0000","last_active":"2024-05-11T01:14:46.287690+0000","last_peered":"2024-05-11T01:14:46.287690+0000","last_clean":"2024-05-11T01:14:46.287690+0000","last_became_active":"2024-05-11T01:13:57.576996+0000","last_became_peered":"2024-05-11T01:13:57.576996+0000","last_unstale":"2024-05-11T01:14:46.287690+0000","last_undegraded":"2024-05-11T01:14:46.287690+0000","last_fullsized":"2024-05-11T01:14:46.287690+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284000+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:14:46.284000+0000","last_peered":"2024-05-11T01:14:46.284000+0000","last_clean":"2024-05-11T01:14:46.284000+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:14:46.284000+0000","last_undegraded":"2024-05-11T01:14:46.284000+0000","last_fullsized":"2024-05-11T01:14:46.284000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284000+0000","last_change":"2024-05-11T01:13:57.577630+0000","last_active":"2024-05-11T01:14:46.284000+0000","last_peered":"2024-05-11T01:14:46.284000+0000","last_clean":"2024-05-11T01:14:46.284000+0000","last_became_active":"2024-05-11T01:13:57.577363+0000","last_became_peered":"2024-05-11T01:13:57.577363+0000","last_unstale":"2024-05-11T01:14:46.284000+0000","last_undegraded":"2024-05-11T01:14:46.284000+0000","last_fullsized":"2024-05-11T01:14:46.284000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:45:17.071449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287030+0000","last_change":"2024-05-11T01:13:57.584410+0000","last_active":"2024-05-11T01:14:46.287030+0000","last_peered":"2024-05-11T01:14:46.287030+0000","last_clean":"2024-05-11T01:14:46.287030+0000","last_became_active":"2024-05-11T01:13:57.584164+0000","last_became_peered":"2024-05-11T01:13:57.584164+0000","last_unstale":"2024-05-11T01:14:46.287030+0000","last_undegraded":"2024-05-11T01:14:46.287030+0000","last_fullsized":"2024-05-11T01:14:46.287030+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:57.382038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287343+0000","last_change":"2024-05-11T01:13:57.576284+0000","last_active":"2024-05-11T01:14:46.287343+0000","last_peered":"2024-05-11T01:14:46.287343+0000","last_clean":"2024-05-11T01:14:46.287343+0000","last_became_active":"2024-05-11T01:13:57.575987+0000","last_became_peered":"2024-05-11T01:13:57.575987+0000","last_unstale":"2024-05-11T01:14:46.287343+0000","last_undegraded":"2024-05-11T01:14:46.287343+0000","last_fullsized":"2024-05-11T01:14:46.287343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284095+0000","last_change":"2024-05-11T01:13:57.577419+0000","last_active":"2024-05-11T01:14:46.284095+0000","last_peered":"2024-05-11T01:14:46.284095+0000","last_clean":"2024-05-11T01:14:46.284095+0000","last_became_active":"2024-05-11T01:13:57.576839+0000","last_became_peered":"2024-05-11T01:13:57.576839+0000","last_unstale":"2024-05-11T01:14:46.284095+0000","last_undegraded":"2024-05-11T01:14:46.284095+0000","last_fullsized":"2024-05-11T01:14:46.284095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:40:40.812341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776393+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:14:46.776393+0000","last_peered":"2024-05-11T01:14:46.776393+0000","last_clean":"2024-05-11T01:14:46.776393+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:14:46.776393+0000","last_undegraded":"2024-05-11T01:14:46.776393+0000","last_fullsized":"2024-05-11T01:14:46.776393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283679+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:14:46.283679+0000","last_peered":"2024-05-11T01:14:46.283679+0000","last_clean":"2024-05-11T01:14:46.283679+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:14:46.283679+0000","last_undegraded":"2024-05-11T01:14:46.283679+0000","last_fullsized":"2024-05-11T01:14:46.283679+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341554+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:14:46.341554+0000","last_peered":"2024-05-11T01:14:46.341554+0000","last_clean":"2024-05-11T01:14:46.341554+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:14:46.341554+0000","last_undegraded":"2024-05-11T01:14:46.341554+0000","last_fullsized":"2024-05-11T01:14:46.341554+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776851+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:14:46.776851+0000","last_peered":"2024-05-11T01:14:46.776851+0000","last_clean":"2024-05-11T01:14:46.776851+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:14:46.776851+0000","last_undegraded":"2024-05-11T01:14:46.776851+0000","last_fullsized":"2024-05-11T01:14:46.776851+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287789+0000","last_change":"2024-05-11T01:13:57.572345+0000","last_active":"2024-05-11T01:14:46.287789+0000","last_peered":"2024-05-11T01:14:46.287789+0000","last_clean":"2024-05-11T01:14:46.287789+0000","last_became_active":"2024-05-11T01:13:57.572038+0000","last_became_peered":"2024-05-11T01:13:57.572038+0000","last_unstale":"2024-05-11T01:14:46.287789+0000","last_undegraded":"2024-05-11T01:14:46.287789+0000","last_fullsized":"2024-05-11T01:14:46.287789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285033+0000","last_change":"2024-05-11T01:13:56.576801+0000","last_active":"2024-05-11T01:14:46.285033+0000","last_peered":"2024-05-11T01:14:46.285033+0000","last_clean":"2024-05-11T01:14:46.285033+0000","last_became_active":"2024-05-11T01:13:56.576512+0000","last_became_peered":"2024-05-11T01:13:56.576512+0000","last_unstale":"2024-05-11T01:14:46.285033+0000","last_undegraded":"2024-05-11T01:14:46.285033+0000","last_fullsized":"2024-05-11T01:14:46.285033+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287076+0000","last_change":"2024-05-11T01:13:57.576538+0000","last_active":"2024-05-11T01:14:46.287076+0000","last_peered":"2024-05-11T01:14:46.287076+0000","last_clean":"2024-05-11T01:14:46.287076+0000","last_became_active":"2024-05-11T01:13:57.576234+0000","last_became_peered":"2024-05-11T01:13:57.576234+0000","last_unstale":"2024-05-11T01:14:46.287076+0000","last_undegraded":"2024-05-11T01:14:46.287076+0000","last_fullsized":"2024-05-11T01:14:46.287076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:05:14.944546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341642+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:14:46.341642+0000","last_peered":"2024-05-11T01:14:46.341642+0000","last_clean":"2024-05-11T01:14:46.341642+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:14:46.341642+0000","last_undegraded":"2024-05-11T01:14:46.341642+0000","last_fullsized":"2024-05-11T01:14:46.341642+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341541+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:14:46.341541+0000","last_peered":"2024-05-11T01:14:46.341541+0000","last_clean":"2024-05-11T01:14:46.341541+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:14:46.341541+0000","last_undegraded":"2024-05-11T01:14:46.341541+0000","last_fullsized":"2024-05-11T01:14:46.341541+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284213+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:14:46.284213+0000","last_peered":"2024-05-11T01:14:46.284213+0000","last_clean":"2024-05-11T01:14:46.284213+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:14:46.284213+0000","last_undegraded":"2024-05-11T01:14:46.284213+0000","last_fullsized":"2024-05-11T01:14:46.284213+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284140+0000","last_change":"2024-05-11T01:13:57.578580+0000","last_active":"2024-05-11T01:14:46.284140+0000","last_peered":"2024-05-11T01:14:46.284140+0000","last_clean":"2024-05-11T01:14:46.284140+0000","last_became_active":"2024-05-11T01:13:57.578287+0000","last_became_peered":"2024-05-11T01:13:57.578287+0000","last_unstale":"2024-05-11T01:14:46.284140+0000","last_undegraded":"2024-05-11T01:14:46.284140+0000","last_fullsized":"2024-05-11T01:14:46.284140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:39:09.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776539+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:14:46.776539+0000","last_peered":"2024-05-11T01:14:46.776539+0000","last_clean":"2024-05-11T01:14:46.776539+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:14:46.776539+0000","last_undegraded":"2024-05-11T01:14:46.776539+0000","last_fullsized":"2024-05-11T01:14:46.776539+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189336+0000","last_change":"2024-05-11T01:13:57.591245+0000","last_active":"2024-05-11T01:14:47.189336+0000","last_peered":"2024-05-11T01:14:47.189336+0000","last_clean":"2024-05-11T01:14:47.189336+0000","last_became_active":"2024-05-11T01:13:57.590734+0000","last_became_peered":"2024-05-11T01:13:57.590734+0000","last_unstale":"2024-05-11T01:14:47.189336+0000","last_undegraded":"2024-05-11T01:14:47.189336+0000","last_fullsized":"2024-05-11T01:14:47.189336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284243+0000","last_change":"2024-05-11T01:13:56.574294+0000","last_active":"2024-05-11T01:14:46.284243+0000","last_peered":"2024-05-11T01:14:46.284243+0000","last_clean":"2024-05-11T01:14:46.284243+0000","last_became_active":"2024-05-11T01:13:56.574005+0000","last_became_peered":"2024-05-11T01:13:56.574005+0000","last_unstale":"2024-05-11T01:14:46.284243+0000","last_undegraded":"2024-05-11T01:14:46.284243+0000","last_fullsized":"2024-05-11T01:14:46.284243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:10:19.793450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189029+0000","last_change":"2024-05-11T01:13:57.584809+0000","last_active":"2024-05-11T01:14:47.189029+0000","last_peered":"2024-05-11T01:14:47.189029+0000","last_clean":"2024-05-11T01:14:47.189029+0000","last_became_active":"2024-05-11T01:13:57.584406+0000","last_became_peered":"2024-05-11T01:13:57.584406+0000","last_unstale":"2024-05-11T01:14:47.189029+0000","last_undegraded":"2024-05-11T01:14:47.189029+0000","last_fullsized":"2024-05-11T01:14:47.189029+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286737+0000","last_change":"2024-05-11T01:13:56.573597+0000","last_active":"2024-05-11T01:14:46.286737+0000","last_peered":"2024-05-11T01:14:46.286737+0000","last_clean":"2024-05-11T01:14:46.286737+0000","last_became_active":"2024-05-11T01:13:56.573279+0000","last_became_peered":"2024-05-11T01:13:56.573279+0000","last_unstale":"2024-05-11T01:14:46.286737+0000","last_undegraded":"2024-05-11T01:14:46.286737+0000","last_fullsized":"2024-05-11T01:14:46.286737+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:16:43.996372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287040+0000","last_change":"2024-05-11T01:13:57.579325+0000","last_active":"2024-05-11T01:14:46.287040+0000","last_peered":"2024-05-11T01:14:46.287040+0000","last_clean":"2024-05-11T01:14:46.287040+0000","last_became_active":"2024-05-11T01:13:57.578950+0000","last_became_peered":"2024-05-11T01:13:57.578950+0000","last_unstale":"2024-05-11T01:14:46.287040+0000","last_undegraded":"2024-05-11T01:14:46.287040+0000","last_fullsized":"2024-05-11T01:14:46.287040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189121+0000","last_change":"2024-05-11T01:13:56.572658+0000","last_active":"2024-05-11T01:14:47.189121+0000","last_peered":"2024-05-11T01:14:47.189121+0000","last_clean":"2024-05-11T01:14:47.189121+0000","last_became_active":"2024-05-11T01:13:56.572329+0000","last_became_peered":"2024-05-11T01:13:56.572329+0000","last_unstale":"2024-05-11T01:14:47.189121+0000","last_undegraded":"2024-05-11T01:14:47.189121+0000","last_fullsized":"2024-05-11T01:14:47.189121+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:07:43.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284929+0000","last_change":"2024-05-11T01:13:57.590749+0000","last_active":"2024-05-11T01:14:46.284929+0000","last_peered":"2024-05-11T01:14:46.284929+0000","last_clean":"2024-05-11T01:14:46.284929+0000","last_became_active":"2024-05-11T01:13:57.590241+0000","last_became_peered":"2024-05-11T01:13:57.590241+0000","last_unstale":"2024-05-11T01:14:46.284929+0000","last_undegraded":"2024-05-11T01:14:46.284929+0000","last_fullsized":"2024-05-11T01:14:46.284929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:07:21.860466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284838+0000","last_change":"2024-05-11T01:13:56.571495+0000","last_active":"2024-05-11T01:14:46.284838+0000","last_peered":"2024-05-11T01:14:46.284838+0000","last_clean":"2024-05-11T01:14:46.284838+0000","last_became_active":"2024-05-11T01:13:56.571211+0000","last_became_peered":"2024-05-11T01:13:56.571211+0000","last_unstale":"2024-05-11T01:14:46.284838+0000","last_undegraded":"2024-05-11T01:14:46.284838+0000","last_fullsized":"2024-05-11T01:14:46.284838+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:26:54.553975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285270+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:14:46.285270+0000","last_peered":"2024-05-11T01:14:46.285270+0000","last_clean":"2024-05-11T01:14:46.285270+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:14:46.285270+0000","last_undegraded":"2024-05-11T01:14:46.285270+0000","last_fullsized":"2024-05-11T01:14:46.285270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189839+0000","last_change":"2024-05-11T01:13:56.576731+0000","last_active":"2024-05-11T01:14:47.189839+0000","last_peered":"2024-05-11T01:14:47.189839+0000","last_clean":"2024-05-11T01:14:47.189839+0000","last_became_active":"2024-05-11T01:13:56.576163+0000","last_became_peered":"2024-05-11T01:13:56.576163+0000","last_unstale":"2024-05-11T01:14:47.189839+0000","last_undegraded":"2024-05-11T01:14:47.189839+0000","last_fullsized":"2024-05-11T01:14:47.189839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:38:23.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776622+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:14:46.776622+0000","last_peered":"2024-05-11T01:14:46.776622+0000","last_clean":"2024-05-11T01:14:46.776622+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:14:46.776622+0000","last_undegraded":"2024-05-11T01:14:46.776622+0000","last_fullsized":"2024-05-11T01:14:46.776622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285139+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:14:46.285139+0000","last_peered":"2024-05-11T01:14:46.285139+0000","last_clean":"2024-05-11T01:14:46.285139+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:14:46.285139+0000","last_undegraded":"2024-05-11T01:14:46.285139+0000","last_fullsized":"2024-05-11T01:14:46.285139+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284390+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:14:46.284390+0000","last_peered":"2024-05-11T01:14:46.284390+0000","last_clean":"2024-05-11T01:14:46.284390+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:14:46.284390+0000","last_undegraded":"2024-05-11T01:14:46.284390+0000","last_fullsized":"2024-05-11T01:14:46.284390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'11","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:09.720950+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:16:09.720950+0000","last_peered":"2024-05-11T01:16:09.720950+0000","last_clean":"2024-05-11T01:16:09.720950+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:16:09.720950+0000","last_undegraded":"2024-05-11T01:16:09.720950+0000","last_fullsized":"2024-05-11T01:16:09.720950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287250+0000","last_change":"2024-05-11T01:13:57.587446+0000","last_active":"2024-05-11T01:14:46.287250+0000","last_peered":"2024-05-11T01:14:46.287250+0000","last_clean":"2024-05-11T01:14:46.287250+0000","last_became_active":"2024-05-11T01:13:57.587034+0000","last_became_peered":"2024-05-11T01:13:57.587034+0000","last_unstale":"2024-05-11T01:14:46.287250+0000","last_undegraded":"2024-05-11T01:14:46.287250+0000","last_fullsized":"2024-05-11T01:14:46.287250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:51.169562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776593+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:14:46.776593+0000","last_peered":"2024-05-11T01:14:46.776593+0000","last_clean":"2024-05-11T01:14:46.776593+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:14:46.776593+0000","last_undegraded":"2024-05-11T01:14:46.776593+0000","last_fullsized":"2024-05-11T01:14:46.776593+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189401+0000","last_change":"2024-05-11T01:13:57.589755+0000","last_active":"2024-05-11T01:14:47.189401+0000","last_peered":"2024-05-11T01:14:47.189401+0000","last_clean":"2024-05-11T01:14:47.189401+0000","last_became_active":"2024-05-11T01:13:57.589439+0000","last_became_peered":"2024-05-11T01:13:57.589439+0000","last_unstale":"2024-05-11T01:14:47.189401+0000","last_undegraded":"2024-05-11T01:14:47.189401+0000","last_fullsized":"2024-05-11T01:14:47.189401+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284299+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:14:46.284299+0000","last_peered":"2024-05-11T01:14:46.284299+0000","last_clean":"2024-05-11T01:14:46.284299+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:14:46.284299+0000","last_undegraded":"2024-05-11T01:14:46.284299+0000","last_fullsized":"2024-05-11T01:14:46.284299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776250+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:14:46.776250+0000","last_peered":"2024-05-11T01:14:46.776250+0000","last_clean":"2024-05-11T01:14:46.776250+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:14:46.776250+0000","last_undegraded":"2024-05-11T01:14:46.776250+0000","last_fullsized":"2024-05-11T01:14:46.776250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776435+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:14:46.776435+0000","last_peered":"2024-05-11T01:14:46.776435+0000","last_clean":"2024-05-11T01:14:46.776435+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:14:46.776435+0000","last_undegraded":"2024-05-11T01:14:46.776435+0000","last_fullsized":"2024-05-11T01:14:46.776435+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284175+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:14:46.284175+0000","last_peered":"2024-05-11T01:14:46.284175+0000","last_clean":"2024-05-11T01:14:46.284175+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:14:46.284175+0000","last_undegraded":"2024-05-11T01:14:46.284175+0000","last_fullsized":"2024-05-11T01:14:46.284175+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"58'8","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189203+0000","last_change":"2024-05-11T01:13:56.576267+0000","last_active":"2024-05-11T01:14:47.189203+0000","last_peered":"2024-05-11T01:14:47.189203+0000","last_clean":"2024-05-11T01:14:47.189203+0000","last_became_active":"2024-05-11T01:13:56.575422+0000","last_became_peered":"2024-05-11T01:13:56.575422+0000","last_unstale":"2024-05-11T01:14:47.189203+0000","last_undegraded":"2024-05-11T01:14:47.189203+0000","last_fullsized":"2024-05-11T01:14:47.189203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:46:03.149087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283932+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:14:46.283932+0000","last_peered":"2024-05-11T01:14:46.283932+0000","last_clean":"2024-05-11T01:14:46.283932+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:14:46.283932+0000","last_undegraded":"2024-05-11T01:14:46.283932+0000","last_fullsized":"2024-05-11T01:14:46.283932+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284079+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:14:46.284079+0000","last_peered":"2024-05-11T01:14:46.284079+0000","last_clean":"2024-05-11T01:14:46.284079+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:14:46.284079+0000","last_undegraded":"2024-05-11T01:14:46.284079+0000","last_fullsized":"2024-05-11T01:14:46.284079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189698+0000","last_change":"2024-05-11T01:13:57.589024+0000","last_active":"2024-05-11T01:14:47.189698+0000","last_peered":"2024-05-11T01:14:47.189698+0000","last_clean":"2024-05-11T01:14:47.189698+0000","last_became_active":"2024-05-11T01:13:57.588641+0000","last_became_peered":"2024-05-11T01:13:57.588641+0000","last_unstale":"2024-05-11T01:14:47.189698+0000","last_undegraded":"2024-05-11T01:14:47.189698+0000","last_fullsized":"2024-05-11T01:14:47.189698+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285092+0000","last_change":"2024-05-11T01:13:56.571741+0000","last_active":"2024-05-11T01:14:46.285092+0000","last_peered":"2024-05-11T01:14:46.285092+0000","last_clean":"2024-05-11T01:14:46.285092+0000","last_became_active":"2024-05-11T01:13:56.571143+0000","last_became_peered":"2024-05-11T01:13:56.571143+0000","last_unstale":"2024-05-11T01:14:46.285092+0000","last_undegraded":"2024-05-11T01:14:46.285092+0000","last_fullsized":"2024-05-11T01:14:46.285092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287406+0000","last_change":"2024-05-11T01:13:57.573076+0000","last_active":"2024-05-11T01:14:46.287406+0000","last_peered":"2024-05-11T01:14:46.287406+0000","last_clean":"2024-05-11T01:14:46.287406+0000","last_became_active":"2024-05-11T01:13:57.572777+0000","last_became_peered":"2024-05-11T01:13:57.572777+0000","last_unstale":"2024-05-11T01:14:46.287406+0000","last_undegraded":"2024-05-11T01:14:46.287406+0000","last_fullsized":"2024-05-11T01:14:46.287406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287538+0000","last_change":"2024-05-11T01:13:56.573996+0000","last_active":"2024-05-11T01:14:46.287538+0000","last_peered":"2024-05-11T01:14:46.287538+0000","last_clean":"2024-05-11T01:14:46.287538+0000","last_became_active":"2024-05-11T01:13:56.573737+0000","last_became_peered":"2024-05-11T01:13:56.573737+0000","last_unstale":"2024-05-11T01:14:46.287538+0000","last_undegraded":"2024-05-11T01:14:46.287538+0000","last_fullsized":"2024-05-11T01:14:46.287538+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287575+0000","last_change":"2024-05-11T01:13:57.577270+0000","last_active":"2024-05-11T01:14:46.287575+0000","last_peered":"2024-05-11T01:14:46.287575+0000","last_clean":"2024-05-11T01:14:46.287575+0000","last_became_active":"2024-05-11T01:13:57.576978+0000","last_became_peered":"2024-05-11T01:13:57.576978+0000","last_unstale":"2024-05-11T01:14:46.287575+0000","last_undegraded":"2024-05-11T01:14:46.287575+0000","last_fullsized":"2024-05-11T01:14:46.287575+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776756+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:14:46.776756+0000","last_peered":"2024-05-11T01:14:46.776756+0000","last_clean":"2024-05-11T01:14:46.776756+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:14:46.776756+0000","last_undegraded":"2024-05-11T01:14:46.776756+0000","last_fullsized":"2024-05-11T01:14:46.776756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776445+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:14:46.776445+0000","last_peered":"2024-05-11T01:14:46.776445+0000","last_clean":"2024-05-11T01:14:46.776445+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:14:46.776445+0000","last_undegraded":"2024-05-11T01:14:46.776445+0000","last_fullsized":"2024-05-11T01:14:46.776445+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776830+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:14:46.776830+0000","last_peered":"2024-05-11T01:14:46.776830+0000","last_clean":"2024-05-11T01:14:46.776830+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:14:46.776830+0000","last_undegraded":"2024-05-11T01:14:46.776830+0000","last_fullsized":"2024-05-11T01:14:46.776830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341240+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:14:46.341240+0000","last_peered":"2024-05-11T01:14:46.341240+0000","last_clean":"2024-05-11T01:14:46.341240+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:14:46.341240+0000","last_undegraded":"2024-05-11T01:14:46.341240+0000","last_fullsized":"2024-05-11T01:14:46.341240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287365+0000","last_change":"2024-05-11T01:13:56.581631+0000","last_active":"2024-05-11T01:14:46.287365+0000","last_peered":"2024-05-11T01:14:46.287365+0000","last_clean":"2024-05-11T01:14:46.287365+0000","last_became_active":"2024-05-11T01:13:56.581299+0000","last_became_peered":"2024-05-11T01:13:56.581299+0000","last_unstale":"2024-05-11T01:14:46.287365+0000","last_undegraded":"2024-05-11T01:14:46.287365+0000","last_fullsized":"2024-05-11T01:14:46.287365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:35:01.793210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283707+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:14:46.283707+0000","last_peered":"2024-05-11T01:14:46.283707+0000","last_clean":"2024-05-11T01:14:46.283707+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:14:46.283707+0000","last_undegraded":"2024-05-11T01:14:46.283707+0000","last_fullsized":"2024-05-11T01:14:46.283707+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189307+0000","last_change":"2024-05-11T01:13:56.575003+0000","last_active":"2024-05-11T01:14:47.189307+0000","last_peered":"2024-05-11T01:14:47.189307+0000","last_clean":"2024-05-11T01:14:47.189307+0000","last_became_active":"2024-05-11T01:13:56.574726+0000","last_became_peered":"2024-05-11T01:13:56.574726+0000","last_unstale":"2024-05-11T01:14:47.189307+0000","last_undegraded":"2024-05-11T01:14:47.189307+0000","last_fullsized":"2024-05-11T01:14:47.189307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:15:10.911003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189149+0000","last_change":"2024-05-11T01:13:57.576056+0000","last_active":"2024-05-11T01:14:47.189149+0000","last_peered":"2024-05-11T01:14:47.189149+0000","last_clean":"2024-05-11T01:14:47.189149+0000","last_became_active":"2024-05-11T01:13:57.575723+0000","last_became_peered":"2024-05-11T01:13:57.575723+0000","last_unstale":"2024-05-11T01:14:47.189149+0000","last_undegraded":"2024-05-11T01:14:47.189149+0000","last_fullsized":"2024-05-11T01:14:47.189149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:23:18.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284012+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:14:46.284012+0000","last_peered":"2024-05-11T01:14:46.284012+0000","last_clean":"2024-05-11T01:14:46.284012+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:14:46.284012+0000","last_undegraded":"2024-05-11T01:14:46.284012+0000","last_fullsized":"2024-05-11T01:14:46.284012+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287887+0000","last_change":"2024-05-11T01:13:57.587557+0000","last_active":"2024-05-11T01:14:46.287887+0000","last_peered":"2024-05-11T01:14:46.287887+0000","last_clean":"2024-05-11T01:14:46.287887+0000","last_became_active":"2024-05-11T01:13:57.587255+0000","last_became_peered":"2024-05-11T01:13:57.587255+0000","last_unstale":"2024-05-11T01:14:46.287887+0000","last_undegraded":"2024-05-11T01:14:46.287887+0000","last_fullsized":"2024-05-11T01:14:46.287887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"61'3","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:06.168128+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:16:06.168128+0000","last_peered":"2024-05-11T01:16:06.168128+0000","last_clean":"2024-05-11T01:16:06.168128+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:16:06.168128+0000","last_undegraded":"2024-05-11T01:16:06.168128+0000","last_fullsized":"2024-05-11T01:16:06.168128+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189623+0000","last_change":"2024-05-11T01:13:57.588129+0000","last_active":"2024-05-11T01:14:47.189623+0000","last_peered":"2024-05-11T01:14:47.189623+0000","last_clean":"2024-05-11T01:14:47.189623+0000","last_became_active":"2024-05-11T01:13:57.577948+0000","last_became_peered":"2024-05-11T01:13:57.577948+0000","last_unstale":"2024-05-11T01:14:47.189623+0000","last_undegraded":"2024-05-11T01:14:47.189623+0000","last_fullsized":"2024-05-11T01:14:47.189623+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285353+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:14:46.285353+0000","last_peered":"2024-05-11T01:14:46.285353+0000","last_clean":"2024-05-11T01:14:46.285353+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:14:46.285353+0000","last_undegraded":"2024-05-11T01:14:46.285353+0000","last_fullsized":"2024-05-11T01:14:46.285353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285181+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:14:46.285181+0000","last_peered":"2024-05-11T01:14:46.285181+0000","last_clean":"2024-05-11T01:14:46.285181+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:14:46.285181+0000","last_undegraded":"2024-05-11T01:14:46.285181+0000","last_fullsized":"2024-05-11T01:14:46.285181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341392+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:14:46.341392+0000","last_peered":"2024-05-11T01:14:46.341392+0000","last_clean":"2024-05-11T01:14:46.341392+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:14:46.341392+0000","last_undegraded":"2024-05-11T01:14:46.341392+0000","last_fullsized":"2024-05-11T01:14:46.341392+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776562+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:14:46.776562+0000","last_peered":"2024-05-11T01:14:46.776562+0000","last_clean":"2024-05-11T01:14:46.776562+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:14:46.776562+0000","last_undegraded":"2024-05-11T01:14:46.776562+0000","last_fullsized":"2024-05-11T01:14:46.776562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284511+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:14:46.284511+0000","last_peered":"2024-05-11T01:14:46.284511+0000","last_clean":"2024-05-11T01:14:46.284511+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:14:46.284511+0000","last_undegraded":"2024-05-11T01:14:46.284511+0000","last_fullsized":"2024-05-11T01:14:46.284511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776496+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:14:46.776496+0000","last_peered":"2024-05-11T01:14:46.776496+0000","last_clean":"2024-05-11T01:14:46.776496+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:14:46.776496+0000","last_undegraded":"2024-05-11T01:14:46.776496+0000","last_fullsized":"2024-05-11T01:14:46.776496+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284370+0000","last_change":"2024-05-11T01:13:56.573647+0000","last_active":"2024-05-11T01:14:46.284370+0000","last_peered":"2024-05-11T01:14:46.284370+0000","last_clean":"2024-05-11T01:14:46.284370+0000","last_became_active":"2024-05-11T01:13:56.573347+0000","last_became_peered":"2024-05-11T01:13:56.573347+0000","last_unstale":"2024-05-11T01:14:46.284370+0000","last_undegraded":"2024-05-11T01:14:46.284370+0000","last_fullsized":"2024-05-11T01:14:46.284370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:47:34.803535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286760+0000","last_change":"2024-05-11T01:13:57.582673+0000","last_active":"2024-05-11T01:14:46.286760+0000","last_peered":"2024-05-11T01:14:46.286760+0000","last_clean":"2024-05-11T01:14:46.286760+0000","last_became_active":"2024-05-11T01:13:57.582398+0000","last_became_peered":"2024-05-11T01:13:57.582398+0000","last_unstale":"2024-05-11T01:14:46.286760+0000","last_undegraded":"2024-05-11T01:14:46.286760+0000","last_fullsized":"2024-05-11T01:14:46.286760+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:53:00.000306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341258+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:14:46.341258+0000","last_peered":"2024-05-11T01:14:46.341258+0000","last_clean":"2024-05-11T01:14:46.341258+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:14:46.341258+0000","last_undegraded":"2024-05-11T01:14:46.341258+0000","last_fullsized":"2024-05-11T01:14:46.341258+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283991+0000","last_change":"2024-05-11T01:13:57.575506+0000","last_active":"2024-05-11T01:14:46.283991+0000","last_peered":"2024-05-11T01:14:46.283991+0000","last_clean":"2024-05-11T01:14:46.283991+0000","last_became_active":"2024-05-11T01:13:57.575239+0000","last_became_peered":"2024-05-11T01:13:57.575239+0000","last_unstale":"2024-05-11T01:14:46.283991+0000","last_undegraded":"2024-05-11T01:14:46.283991+0000","last_fullsized":"2024-05-11T01:14:46.283991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:33:02.113131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189357+0000","last_change":"2024-05-11T01:13:56.576345+0000","last_active":"2024-05-11T01:14:47.189357+0000","last_peered":"2024-05-11T01:14:47.189357+0000","last_clean":"2024-05-11T01:14:47.189357+0000","last_became_active":"2024-05-11T01:13:56.575838+0000","last_became_peered":"2024-05-11T01:13:56.575838+0000","last_unstale":"2024-05-11T01:14:47.189357+0000","last_undegraded":"2024-05-11T01:14:47.189357+0000","last_fullsized":"2024-05-11T01:14:47.189357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:51.632315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189822+0000","last_change":"2024-05-11T01:13:57.588794+0000","last_active":"2024-05-11T01:14:47.189822+0000","last_peered":"2024-05-11T01:14:47.189822+0000","last_clean":"2024-05-11T01:14:47.189822+0000","last_became_active":"2024-05-11T01:13:57.586986+0000","last_became_peered":"2024-05-11T01:13:57.586986+0000","last_unstale":"2024-05-11T01:14:47.189822+0000","last_undegraded":"2024-05-11T01:14:47.189822+0000","last_fullsized":"2024-05-11T01:14:47.189822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:00:28.690447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287873+0000","last_change":"2024-05-11T01:13:56.579830+0000","last_active":"2024-05-11T01:14:46.287873+0000","last_peered":"2024-05-11T01:14:46.287873+0000","last_clean":"2024-05-11T01:14:46.287873+0000","last_became_active":"2024-05-11T01:13:56.579637+0000","last_became_peered":"2024-05-11T01:13:56.579637+0000","last_unstale":"2024-05-11T01:14:46.287873+0000","last_undegraded":"2024-05-11T01:14:46.287873+0000","last_fullsized":"2024-05-11T01:14:46.287873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":249,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284042+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:14:46.284042+0000","last_peered":"2024-05-11T01:14:46.284042+0000","last_clean":"2024-05-11T01:14:46.284042+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:14:46.284042+0000","last_undegraded":"2024-05-11T01:14:46.284042+0000","last_fullsized":"2024-05-11T01:14:46.284042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3794,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":932360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":342574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54104,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317736,"statfs":{"total":96636764160,"available":96581361664,"internally_reserved":0,"allocated":737280,"data_stored":344898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40224,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331616,"statfs":{"total":96636764160,"available":96595574784,"internally_reserved":0,"allocated":737280,"data_stored":342540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":741376,"data_stored":344920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58264,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313576,"statfs":{"total":96636764160,"available":96577101824,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1323008,"data_stored":932304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:16:11.286 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-11T01:16:11.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:16:11.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.427+0000 7fe8efd9d640 1 Processor -- start 2024-05-11T01:16:11.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.428+0000 7fe8efd9d640 1 -- start start 2024-05-11T01:16:11.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.428+0000 7fe8efd9d640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8e81402f0 0x7fe8e80b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8efd9d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cfa80 0x7fe8e80b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8efd9d640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e8160f90 con 0x7fe8e80cdab0 2024-05-11T01:16:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8efd9d640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e80ce650 con 0x7fe8e81402f0 2024-05-11T01:16:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8efd9d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e8161270 con 0x7fe8e80cfa80 2024-05-11T01:16:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8ed338640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cfa80 0x7fe8e80b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8ed338640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cfa80 0x7fe8e80b3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:44778/0 (socket says 172.21.15.16:44778) 2024-05-11T01:16:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8ed338640 1 -- 172.21.15.16:0/1841995340 learned_addr learned my addr 172.21.15.16:0/1841995340 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8edb39640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe8e81402f0 0x7fe8e80b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8ed338640 1 -- 172.21.15.16:0/1841995340 >> v2:172.21.15.174:3300/0 conn(0x7fe8e81402f0 msgr2=0x7fe8e80b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8ed338640 1 --2- 172.21.15.16:0/1841995340 >> v2:172.21.15.174:3300/0 conn(0x7fe8e81402f0 0x7fe8e80b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8ed338640 1 -- 172.21.15.16:0/1841995340 >> v1:172.21.15.174:6789/0 conn(0x7fe8e80cdab0 legacy=0x7fe8e80cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.429+0000 7fe8ed338640 1 -- 172.21.15.16:0/1841995340 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e8161550 con 0x7fe8e80cfa80 2024-05-11T01:16:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.430+0000 7fe8ed338640 1 --2- 172.21.15.16:0/1841995340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cfa80 0x7fe8e80b3210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009870 tx=0x7fe8d802a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5642ad0b0e12143 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.430+0000 7fe8ecb37640 1 -- 172.21.15.16:0/1841995340 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8037070 con 0x7fe8e80cfa80 2024-05-11T01:16:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.430+0000 7fe8ecb37640 1 -- 172.21.15.16:0/1841995340 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d802ad60 con 0x7fe8e80cfa80 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.430+0000 7fe8ecb37640 1 -- 172.21.15.16:0/1841995340 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8032660 con 0x7fe8e80cfa80 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.431+0000 7fe8efd9d640 1 -- 172.21.15.16:0/1841995340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cfa80 msgr2=0x7fe8e80b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.431+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/1841995340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cfa80 0x7fe8e80b3210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009870 tx=0x7fe8d802a0d0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.431+0000 7fe8efd9d640 1 -- 172.21.15.16:0/1841995340 shutdown_connections 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.431+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/1841995340 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cfa80 0x7fe8e80b3210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.431+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/1841995340 >> v2:172.21.15.174:3300/0 conn(0x7fe8e81402f0 0x7fe8e80b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.431+0000 7fe8efd9d640 1 -- 172.21.15.16:0/1841995340 >> 172.21.15.16:0/1841995340 conn(0x7fe8e806fd90 msgr2=0x7fe8e806c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.431+0000 7fe8efd9d640 1 -- 172.21.15.16:0/1841995340 shutdown_connections 2024-05-11T01:16:11.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.431+0000 7fe8efd9d640 1 -- 172.21.15.16:0/1841995340 wait complete. 2024-05-11T01:16:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.432+0000 7fe8efd9d640 1 Processor -- start 2024-05-11T01:16:11.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.432+0000 7fe8efd9d640 1 -- start start 2024-05-11T01:16:11.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8efd9d640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cdab0 0x7fe8e80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8efd9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8e80cfa80 0x7fe8e8153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8efd9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8e81402f0 0x7fe8e815ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8efd9d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e815db10 con 0x7fe8e81402f0 2024-05-11T01:16:11.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8efd9d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e815d990 con 0x7fe8e80cfa80 2024-05-11T01:16:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8efd9d640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e815dc90 con 0x7fe8e80cdab0 2024-05-11T01:16:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8ee33a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8e81402f0 0x7fe8e815ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8edb39640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cdab0 0x7fe8e80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8ed338640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8e80cfa80 0x7fe8e8153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8edb39640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cdab0 0x7fe8e80cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:44786/0 (socket says 172.21.15.16:44786) 2024-05-11T01:16:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8edb39640 1 -- 172.21.15.16:0/157222692 learned_addr learned my addr 172.21.15.16:0/157222692 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8ee33a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8e81402f0 0x7fe8e815ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60918/0 (socket says 172.21.15.16:60918) 2024-05-11T01:16:11.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8edb39640 1 -- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8e80cfa80 msgr2=0x7fe8e8153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8edb39640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8e80cfa80 0x7fe8e8153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8edb39640 1 -- 172.21.15.16:0/157222692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8e81402f0 msgr2=0x7fe8e815ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8edb39640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8e81402f0 0x7fe8e815ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8edb39640 1 -- 172.21.15.16:0/157222692 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e815f770 con 0x7fe8e80cdab0 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.433+0000 7fe8ee33a640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8e81402f0 0x7fe8e815ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.434+0000 7fe8edb39640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cdab0 0x7fe8e80cd230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400e870 tx=0x7fe8e400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.434+0000 7fe8de7fc640 1 -- 172.21.15.16:0/157222692 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4017070 con 0x7fe8e80cdab0 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.434+0000 7fe8de7fc640 1 -- 172.21.15.16:0/157222692 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e400c940 con 0x7fe8e80cdab0 2024-05-11T01:16:11.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.434+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e815fa50 con 0x7fe8e80cdab0 2024-05-11T01:16:11.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.434+0000 7fe8de7fc640 1 -- 172.21.15.16:0/157222692 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400cd30 con 0x7fe8e80cdab0 2024-05-11T01:16:11.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.434+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e8154550 con 0x7fe8e80cdab0 2024-05-11T01:16:11.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.435+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e806a5b0 con 0x7fe8e80cdab0 2024-05-11T01:16:11.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.435+0000 7fe8de7fc640 1 -- 172.21.15.16:0/157222692 <== mon.2 v2:172.21.15.174:3301/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fe8e401a070 con 0x7fe8e80cdab0 2024-05-11T01:16:11.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.436+0000 7fe8de7fc640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8cc0762d0 0x7fe8cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.436+0000 7fe8de7fc640 1 -- 172.21.15.16:0/157222692 <== mon.2 v2:172.21.15.174:3301/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7fe8e4097970 con 0x7fe8e80cdab0 2024-05-11T01:16:11.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.436+0000 7fe8ed338640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8cc0762d0 0x7fe8cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.437+0000 7fe8ed338640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8cc0762d0 0x7fe8cc078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8034000 tx=0x7fe8d802e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.441+0000 7fe8de7fc640 1 -- 172.21.15.16:0/157222692 <== mon.2 v2:172.21.15.174:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe8e4060ab0 con 0x7fe8e80cdab0 2024-05-11T01:16:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.633+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8e815f520 con 0x7fe8cc0762d0 2024-05-11T01:16:11.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.640+0000 7fe8de7fc640 1 -- 172.21.15.16:0/157222692 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251840 (secure 0 0 0) 0x7fe8e815f520 con 0x7fe8cc0762d0 2024-05-11T01:16:11.642 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:16:11.644 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:16:11.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8cc0762d0 msgr2=0x7fe8cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.645 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8cc0762d0 0x7fe8cc078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8034000 tx=0x7fe8d802e000 comp rx=0 tx=0).stop 2024-05-11T01:16:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cdab0 msgr2=0x7fe8e80cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cdab0 0x7fe8e80cd230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400e870 tx=0x7fe8e400ed30 comp rx=0 tx=0).stop 2024-05-11T01:16:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 shutdown_connections 2024-05-11T01:16:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8e81402f0 0x7fe8e815ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.646 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fe8cc0762d0 0x7fe8cc078790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8e80cfa80 0x7fe8e8153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 --2- 172.21.15.16:0/157222692 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fe8e80cdab0 0x7fe8e80cd230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 >> 172.21.15.16:0/157222692 conn(0x7fe8e806fd90 msgr2=0x7fe8e80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 shutdown_connections 2024-05-11T01:16:11.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.643+0000 7fe8efd9d640 1 -- 172.21.15.16:0/157222692 wait complete. 2024-05-11T01:16:11.654 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-05-11T01:16:11.190439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594162,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":179,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329880,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754644840,"statfs":{"total":773094113280,"available":772756316160,"internally_reserved":0,"allocated":7053312,"data_stored":3923540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003029"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285253+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:14:46.285253+0000","last_peered":"2024-05-11T01:14:46.285253+0000","last_clean":"2024-05-11T01:14:46.285253+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:14:46.285253+0000","last_undegraded":"2024-05-11T01:14:46.285253+0000","last_fullsized":"2024-05-11T01:14:46.285253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287984+0000","last_change":"2024-05-11T01:13:57.592028+0000","last_active":"2024-05-11T01:14:46.287984+0000","last_peered":"2024-05-11T01:14:46.287984+0000","last_clean":"2024-05-11T01:14:46.287984+0000","last_became_active":"2024-05-11T01:13:57.591749+0000","last_became_peered":"2024-05-11T01:13:57.591749+0000","last_unstale":"2024-05-11T01:14:46.287984+0000","last_undegraded":"2024-05-11T01:14:46.287984+0000","last_fullsized":"2024-05-11T01:14:46.287984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:07:26.697058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283899+0000","last_change":"2024-05-11T01:13:57.577565+0000","last_active":"2024-05-11T01:14:46.283899+0000","last_peered":"2024-05-11T01:14:46.283899+0000","last_clean":"2024-05-11T01:14:46.283899+0000","last_became_active":"2024-05-11T01:13:57.577002+0000","last_became_peered":"2024-05-11T01:13:57.577002+0000","last_unstale":"2024-05-11T01:14:46.283899+0000","last_undegraded":"2024-05-11T01:14:46.283899+0000","last_fullsized":"2024-05-11T01:14:46.283899+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:10:34.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189449+0000","last_change":"2024-05-11T01:13:57.588370+0000","last_active":"2024-05-11T01:14:47.189449+0000","last_peered":"2024-05-11T01:14:47.189449+0000","last_clean":"2024-05-11T01:14:47.189449+0000","last_became_active":"2024-05-11T01:13:57.587912+0000","last_became_peered":"2024-05-11T01:13:57.587912+0000","last_unstale":"2024-05-11T01:14:47.189449+0000","last_undegraded":"2024-05-11T01:14:47.189449+0000","last_fullsized":"2024-05-11T01:14:47.189449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286887+0000","last_change":"2024-05-11T01:13:57.589752+0000","last_active":"2024-05-11T01:14:46.286887+0000","last_peered":"2024-05-11T01:14:46.286887+0000","last_clean":"2024-05-11T01:14:46.286887+0000","last_became_active":"2024-05-11T01:13:57.589446+0000","last_became_peered":"2024-05-11T01:13:57.589446+0000","last_unstale":"2024-05-11T01:14:46.286887+0000","last_undegraded":"2024-05-11T01:14:46.286887+0000","last_fullsized":"2024-05-11T01:14:46.286887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:28:37.601407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776331+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:14:46.776331+0000","last_peered":"2024-05-11T01:14:46.776331+0000","last_clean":"2024-05-11T01:14:46.776331+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:14:46.776331+0000","last_undegraded":"2024-05-11T01:14:46.776331+0000","last_fullsized":"2024-05-11T01:14:46.776331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284108+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:14:46.284108+0000","last_peered":"2024-05-11T01:14:46.284108+0000","last_clean":"2024-05-11T01:14:46.284108+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:14:46.284108+0000","last_undegraded":"2024-05-11T01:14:46.284108+0000","last_fullsized":"2024-05-11T01:14:46.284108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.188981+0000","last_change":"2024-05-11T01:13:57.584499+0000","last_active":"2024-05-11T01:14:47.188981+0000","last_peered":"2024-05-11T01:14:47.188981+0000","last_clean":"2024-05-11T01:14:47.188981+0000","last_became_active":"2024-05-11T01:13:57.584207+0000","last_became_peered":"2024-05-11T01:13:57.584207+0000","last_unstale":"2024-05-11T01:14:47.188981+0000","last_undegraded":"2024-05-11T01:14:47.188981+0000","last_fullsized":"2024-05-11T01:14:47.188981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:32:22.587470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189594+0000","last_change":"2024-05-11T01:13:57.587045+0000","last_active":"2024-05-11T01:14:47.189594+0000","last_peered":"2024-05-11T01:14:47.189594+0000","last_clean":"2024-05-11T01:14:47.189594+0000","last_became_active":"2024-05-11T01:13:57.586787+0000","last_became_peered":"2024-05-11T01:13:57.586787+0000","last_unstale":"2024-05-11T01:14:47.189594+0000","last_undegraded":"2024-05-11T01:14:47.189594+0000","last_fullsized":"2024-05-11T01:14:47.189594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189713+0000","last_change":"2024-05-11T01:13:57.587253+0000","last_active":"2024-05-11T01:14:47.189713+0000","last_peered":"2024-05-11T01:14:47.189713+0000","last_clean":"2024-05-11T01:14:47.189713+0000","last_became_active":"2024-05-11T01:13:57.586646+0000","last_became_peered":"2024-05-11T01:13:57.586646+0000","last_unstale":"2024-05-11T01:14:47.189713+0000","last_undegraded":"2024-05-11T01:14:47.189713+0000","last_fullsized":"2024-05-11T01:14:47.189713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189903+0000","last_change":"2024-05-11T01:13:57.587659+0000","last_active":"2024-05-11T01:14:47.189903+0000","last_peered":"2024-05-11T01:14:47.189903+0000","last_clean":"2024-05-11T01:14:47.189903+0000","last_became_active":"2024-05-11T01:13:57.587368+0000","last_became_peered":"2024-05-11T01:13:57.587368+0000","last_unstale":"2024-05-11T01:14:47.189903+0000","last_undegraded":"2024-05-11T01:14:47.189903+0000","last_fullsized":"2024-05-11T01:14:47.189903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286908+0000","last_change":"2024-05-11T01:13:57.584583+0000","last_active":"2024-05-11T01:14:46.286908+0000","last_peered":"2024-05-11T01:14:46.286908+0000","last_clean":"2024-05-11T01:14:46.286908+0000","last_became_active":"2024-05-11T01:13:57.584324+0000","last_became_peered":"2024-05-11T01:13:57.584324+0000","last_unstale":"2024-05-11T01:14:46.286908+0000","last_undegraded":"2024-05-11T01:14:46.286908+0000","last_fullsized":"2024-05-11T01:14:46.286908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:39:33.068502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283756+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:14:46.283756+0000","last_peered":"2024-05-11T01:14:46.283756+0000","last_clean":"2024-05-11T01:14:46.283756+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:14:46.283756+0000","last_undegraded":"2024-05-11T01:14:46.283756+0000","last_fullsized":"2024-05-11T01:14:46.283756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.342397+0000","last_change":"2024-05-11T01:14:46.342397+0000","last_active":"2024-05-11T01:14:46.342397+0000","last_peered":"2024-05-11T01:14:46.342397+0000","last_clean":"2024-05-11T01:14:46.342397+0000","last_became_active":"2024-05-11T01:14:46.342122+0000","last_became_peered":"2024-05-11T01:14:46.342122+0000","last_unstale":"2024-05-11T01:14:46.342397+0000","last_undegraded":"2024-05-11T01:14:46.342397+0000","last_fullsized":"2024-05-11T01:14:46.342397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:01:11.288206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776260+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:14:46.776260+0000","last_peered":"2024-05-11T01:14:46.776260+0000","last_clean":"2024-05-11T01:14:46.776260+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:14:46.776260+0000","last_undegraded":"2024-05-11T01:14:46.776260+0000","last_fullsized":"2024-05-11T01:14:46.776260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286984+0000","last_change":"2024-05-11T01:13:57.587648+0000","last_active":"2024-05-11T01:14:46.286984+0000","last_peered":"2024-05-11T01:14:46.286984+0000","last_clean":"2024-05-11T01:14:46.286984+0000","last_became_active":"2024-05-11T01:13:57.587111+0000","last_became_peered":"2024-05-11T01:13:57.587111+0000","last_unstale":"2024-05-11T01:14:46.286984+0000","last_undegraded":"2024-05-11T01:14:46.286984+0000","last_fullsized":"2024-05-11T01:14:46.286984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284670+0000","last_change":"2024-05-11T01:13:57.580387+0000","last_active":"2024-05-11T01:14:46.284670+0000","last_peered":"2024-05-11T01:14:46.284670+0000","last_clean":"2024-05-11T01:14:46.284670+0000","last_became_active":"2024-05-11T01:13:57.580071+0000","last_became_peered":"2024-05-11T01:13:57.580071+0000","last_unstale":"2024-05-11T01:14:46.284670+0000","last_undegraded":"2024-05-11T01:14:46.284670+0000","last_fullsized":"2024-05-11T01:14:46.284670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:23:20.774634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284854+0000","last_change":"2024-05-11T01:13:57.591548+0000","last_active":"2024-05-11T01:14:46.284854+0000","last_peered":"2024-05-11T01:14:46.284854+0000","last_clean":"2024-05-11T01:14:46.284854+0000","last_became_active":"2024-05-11T01:13:57.591258+0000","last_became_peered":"2024-05-11T01:13:57.591258+0000","last_unstale":"2024-05-11T01:14:46.284854+0000","last_undegraded":"2024-05-11T01:14:46.284854+0000","last_fullsized":"2024-05-11T01:14:46.284854+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:35:06.829596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.289685+0000","last_change":"2024-05-11T01:14:46.289685+0000","last_active":"2024-05-11T01:14:46.289685+0000","last_peered":"2024-05-11T01:14:46.289685+0000","last_clean":"2024-05-11T01:14:46.289685+0000","last_became_active":"2024-05-11T01:14:46.289402+0000","last_became_peered":"2024-05-11T01:14:46.289402+0000","last_unstale":"2024-05-11T01:14:46.289685+0000","last_undegraded":"2024-05-11T01:14:46.289685+0000","last_fullsized":"2024-05-11T01:14:46.289685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:34:21.164320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283990+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:14:46.283990+0000","last_peered":"2024-05-11T01:14:46.283990+0000","last_clean":"2024-05-11T01:14:46.283990+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:14:46.283990+0000","last_undegraded":"2024-05-11T01:14:46.283990+0000","last_fullsized":"2024-05-11T01:14:46.283990+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776383+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:14:46.776383+0000","last_peered":"2024-05-11T01:14:46.776383+0000","last_clean":"2024-05-11T01:14:46.776383+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:14:46.776383+0000","last_undegraded":"2024-05-11T01:14:46.776383+0000","last_fullsized":"2024-05-11T01:14:46.776383+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189389+0000","last_change":"2024-05-11T01:13:57.585351+0000","last_active":"2024-05-11T01:14:47.189389+0000","last_peered":"2024-05-11T01:14:47.189389+0000","last_clean":"2024-05-11T01:14:47.189389+0000","last_became_active":"2024-05-11T01:13:57.585036+0000","last_became_peered":"2024-05-11T01:13:57.585036+0000","last_unstale":"2024-05-11T01:14:47.189389+0000","last_undegraded":"2024-05-11T01:14:47.189389+0000","last_fullsized":"2024-05-11T01:14:47.189389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287134+0000","last_change":"2024-05-11T01:13:57.579302+0000","last_active":"2024-05-11T01:14:46.287134+0000","last_peered":"2024-05-11T01:14:46.287134+0000","last_clean":"2024-05-11T01:14:46.287134+0000","last_became_active":"2024-05-11T01:13:57.578993+0000","last_became_peered":"2024-05-11T01:13:57.578993+0000","last_unstale":"2024-05-11T01:14:46.287134+0000","last_undegraded":"2024-05-11T01:14:46.287134+0000","last_fullsized":"2024-05-11T01:14:46.287134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287076+0000","last_change":"2024-05-11T01:13:57.578977+0000","last_active":"2024-05-11T01:14:46.287076+0000","last_peered":"2024-05-11T01:14:46.287076+0000","last_clean":"2024-05-11T01:14:46.287076+0000","last_became_active":"2024-05-11T01:13:57.578695+0000","last_became_peered":"2024-05-11T01:13:57.578695+0000","last_unstale":"2024-05-11T01:14:46.287076+0000","last_undegraded":"2024-05-11T01:14:46.287076+0000","last_fullsized":"2024-05-11T01:14:46.287076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287690+0000","last_change":"2024-05-11T01:13:57.577301+0000","last_active":"2024-05-11T01:14:46.287690+0000","last_peered":"2024-05-11T01:14:46.287690+0000","last_clean":"2024-05-11T01:14:46.287690+0000","last_became_active":"2024-05-11T01:13:57.576996+0000","last_became_peered":"2024-05-11T01:13:57.576996+0000","last_unstale":"2024-05-11T01:14:46.287690+0000","last_undegraded":"2024-05-11T01:14:46.287690+0000","last_fullsized":"2024-05-11T01:14:46.287690+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284000+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:14:46.284000+0000","last_peered":"2024-05-11T01:14:46.284000+0000","last_clean":"2024-05-11T01:14:46.284000+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:14:46.284000+0000","last_undegraded":"2024-05-11T01:14:46.284000+0000","last_fullsized":"2024-05-11T01:14:46.284000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284000+0000","last_change":"2024-05-11T01:13:57.577630+0000","last_active":"2024-05-11T01:14:46.284000+0000","last_peered":"2024-05-11T01:14:46.284000+0000","last_clean":"2024-05-11T01:14:46.284000+0000","last_became_active":"2024-05-11T01:13:57.577363+0000","last_became_peered":"2024-05-11T01:13:57.577363+0000","last_unstale":"2024-05-11T01:14:46.284000+0000","last_undegraded":"2024-05-11T01:14:46.284000+0000","last_fullsized":"2024-05-11T01:14:46.284000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:45:17.071449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287030+0000","last_change":"2024-05-11T01:13:57.584410+0000","last_active":"2024-05-11T01:14:46.287030+0000","last_peered":"2024-05-11T01:14:46.287030+0000","last_clean":"2024-05-11T01:14:46.287030+0000","last_became_active":"2024-05-11T01:13:57.584164+0000","last_became_peered":"2024-05-11T01:13:57.584164+0000","last_unstale":"2024-05-11T01:14:46.287030+0000","last_undegraded":"2024-05-11T01:14:46.287030+0000","last_fullsized":"2024-05-11T01:14:46.287030+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:57.382038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287343+0000","last_change":"2024-05-11T01:13:57.576284+0000","last_active":"2024-05-11T01:14:46.287343+0000","last_peered":"2024-05-11T01:14:46.287343+0000","last_clean":"2024-05-11T01:14:46.287343+0000","last_became_active":"2024-05-11T01:13:57.575987+0000","last_became_peered":"2024-05-11T01:13:57.575987+0000","last_unstale":"2024-05-11T01:14:46.287343+0000","last_undegraded":"2024-05-11T01:14:46.287343+0000","last_fullsized":"2024-05-11T01:14:46.287343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284095+0000","last_change":"2024-05-11T01:13:57.577419+0000","last_active":"2024-05-11T01:14:46.284095+0000","last_peered":"2024-05-11T01:14:46.284095+0000","last_clean":"2024-05-11T01:14:46.284095+0000","last_became_active":"2024-05-11T01:13:57.576839+0000","last_became_peered":"2024-05-11T01:13:57.576839+0000","last_unstale":"2024-05-11T01:14:46.284095+0000","last_undegraded":"2024-05-11T01:14:46.284095+0000","last_fullsized":"2024-05-11T01:14:46.284095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:40:40.812341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776393+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:14:46.776393+0000","last_peered":"2024-05-11T01:14:46.776393+0000","last_clean":"2024-05-11T01:14:46.776393+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:14:46.776393+0000","last_undegraded":"2024-05-11T01:14:46.776393+0000","last_fullsized":"2024-05-11T01:14:46.776393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283679+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:14:46.283679+0000","last_peered":"2024-05-11T01:14:46.283679+0000","last_clean":"2024-05-11T01:14:46.283679+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:14:46.283679+0000","last_undegraded":"2024-05-11T01:14:46.283679+0000","last_fullsized":"2024-05-11T01:14:46.283679+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341554+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:14:46.341554+0000","last_peered":"2024-05-11T01:14:46.341554+0000","last_clean":"2024-05-11T01:14:46.341554+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:14:46.341554+0000","last_undegraded":"2024-05-11T01:14:46.341554+0000","last_fullsized":"2024-05-11T01:14:46.341554+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776851+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:14:46.776851+0000","last_peered":"2024-05-11T01:14:46.776851+0000","last_clean":"2024-05-11T01:14:46.776851+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:14:46.776851+0000","last_undegraded":"2024-05-11T01:14:46.776851+0000","last_fullsized":"2024-05-11T01:14:46.776851+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287789+0000","last_change":"2024-05-11T01:13:57.572345+0000","last_active":"2024-05-11T01:14:46.287789+0000","last_peered":"2024-05-11T01:14:46.287789+0000","last_clean":"2024-05-11T01:14:46.287789+0000","last_became_active":"2024-05-11T01:13:57.572038+0000","last_became_peered":"2024-05-11T01:13:57.572038+0000","last_unstale":"2024-05-11T01:14:46.287789+0000","last_undegraded":"2024-05-11T01:14:46.287789+0000","last_fullsized":"2024-05-11T01:14:46.287789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285033+0000","last_change":"2024-05-11T01:13:56.576801+0000","last_active":"2024-05-11T01:14:46.285033+0000","last_peered":"2024-05-11T01:14:46.285033+0000","last_clean":"2024-05-11T01:14:46.285033+0000","last_became_active":"2024-05-11T01:13:56.576512+0000","last_became_peered":"2024-05-11T01:13:56.576512+0000","last_unstale":"2024-05-11T01:14:46.285033+0000","last_undegraded":"2024-05-11T01:14:46.285033+0000","last_fullsized":"2024-05-11T01:14:46.285033+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287076+0000","last_change":"2024-05-11T01:13:57.576538+0000","last_active":"2024-05-11T01:14:46.287076+0000","last_peered":"2024-05-11T01:14:46.287076+0000","last_clean":"2024-05-11T01:14:46.287076+0000","last_became_active":"2024-05-11T01:13:57.576234+0000","last_became_peered":"2024-05-11T01:13:57.576234+0000","last_unstale":"2024-05-11T01:14:46.287076+0000","last_undegraded":"2024-05-11T01:14:46.287076+0000","last_fullsized":"2024-05-11T01:14:46.287076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:05:14.944546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341642+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:14:46.341642+0000","last_peered":"2024-05-11T01:14:46.341642+0000","last_clean":"2024-05-11T01:14:46.341642+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:14:46.341642+0000","last_undegraded":"2024-05-11T01:14:46.341642+0000","last_fullsized":"2024-05-11T01:14:46.341642+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341541+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:14:46.341541+0000","last_peered":"2024-05-11T01:14:46.341541+0000","last_clean":"2024-05-11T01:14:46.341541+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:14:46.341541+0000","last_undegraded":"2024-05-11T01:14:46.341541+0000","last_fullsized":"2024-05-11T01:14:46.341541+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284213+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:14:46.284213+0000","last_peered":"2024-05-11T01:14:46.284213+0000","last_clean":"2024-05-11T01:14:46.284213+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:14:46.284213+0000","last_undegraded":"2024-05-11T01:14:46.284213+0000","last_fullsized":"2024-05-11T01:14:46.284213+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284140+0000","last_change":"2024-05-11T01:13:57.578580+0000","last_active":"2024-05-11T01:14:46.284140+0000","last_peered":"2024-05-11T01:14:46.284140+0000","last_clean":"2024-05-11T01:14:46.284140+0000","last_became_active":"2024-05-11T01:13:57.578287+0000","last_became_peered":"2024-05-11T01:13:57.578287+0000","last_unstale":"2024-05-11T01:14:46.284140+0000","last_undegraded":"2024-05-11T01:14:46.284140+0000","last_fullsized":"2024-05-11T01:14:46.284140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:39:09.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776539+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:14:46.776539+0000","last_peered":"2024-05-11T01:14:46.776539+0000","last_clean":"2024-05-11T01:14:46.776539+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:14:46.776539+0000","last_undegraded":"2024-05-11T01:14:46.776539+0000","last_fullsized":"2024-05-11T01:14:46.776539+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189336+0000","last_change":"2024-05-11T01:13:57.591245+0000","last_active":"2024-05-11T01:14:47.189336+0000","last_peered":"2024-05-11T01:14:47.189336+0000","last_clean":"2024-05-11T01:14:47.189336+0000","last_became_active":"2024-05-11T01:13:57.590734+0000","last_became_peered":"2024-05-11T01:13:57.590734+0000","last_unstale":"2024-05-11T01:14:47.189336+0000","last_undegraded":"2024-05-11T01:14:47.189336+0000","last_fullsized":"2024-05-11T01:14:47.189336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284243+0000","last_change":"2024-05-11T01:13:56.574294+0000","last_active":"2024-05-11T01:14:46.284243+0000","last_peered":"2024-05-11T01:14:46.284243+0000","last_clean":"2024-05-11T01:14:46.284243+0000","last_became_active":"2024-05-11T01:13:56.574005+0000","last_became_peered":"2024-05-11T01:13:56.574005+0000","last_unstale":"2024-05-11T01:14:46.284243+0000","last_undegraded":"2024-05-11T01:14:46.284243+0000","last_fullsized":"2024-05-11T01:14:46.284243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:10:19.793450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189029+0000","last_change":"2024-05-11T01:13:57.584809+0000","last_active":"2024-05-11T01:14:47.189029+0000","last_peered":"2024-05-11T01:14:47.189029+0000","last_clean":"2024-05-11T01:14:47.189029+0000","last_became_active":"2024-05-11T01:13:57.584406+0000","last_became_peered":"2024-05-11T01:13:57.584406+0000","last_unstale":"2024-05-11T01:14:47.189029+0000","last_undegraded":"2024-05-11T01:14:47.189029+0000","last_fullsized":"2024-05-11T01:14:47.189029+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286737+0000","last_change":"2024-05-11T01:13:56.573597+0000","last_active":"2024-05-11T01:14:46.286737+0000","last_peered":"2024-05-11T01:14:46.286737+0000","last_clean":"2024-05-11T01:14:46.286737+0000","last_became_active":"2024-05-11T01:13:56.573279+0000","last_became_peered":"2024-05-11T01:13:56.573279+0000","last_unstale":"2024-05-11T01:14:46.286737+0000","last_undegraded":"2024-05-11T01:14:46.286737+0000","last_fullsized":"2024-05-11T01:14:46.286737+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:16:43.996372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287040+0000","last_change":"2024-05-11T01:13:57.579325+0000","last_active":"2024-05-11T01:14:46.287040+0000","last_peered":"2024-05-11T01:14:46.287040+0000","last_clean":"2024-05-11T01:14:46.287040+0000","last_became_active":"2024-05-11T01:13:57.578950+0000","last_became_peered":"2024-05-11T01:13:57.578950+0000","last_unstale":"2024-05-11T01:14:46.287040+0000","last_undegraded":"2024-05-11T01:14:46.287040+0000","last_fullsized":"2024-05-11T01:14:46.287040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189121+0000","last_change":"2024-05-11T01:13:56.572658+0000","last_active":"2024-05-11T01:14:47.189121+0000","last_peered":"2024-05-11T01:14:47.189121+0000","last_clean":"2024-05-11T01:14:47.189121+0000","last_became_active":"2024-05-11T01:13:56.572329+0000","last_became_peered":"2024-05-11T01:13:56.572329+0000","last_unstale":"2024-05-11T01:14:47.189121+0000","last_undegraded":"2024-05-11T01:14:47.189121+0000","last_fullsized":"2024-05-11T01:14:47.189121+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:07:43.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284929+0000","last_change":"2024-05-11T01:13:57.590749+0000","last_active":"2024-05-11T01:14:46.284929+0000","last_peered":"2024-05-11T01:14:46.284929+0000","last_clean":"2024-05-11T01:14:46.284929+0000","last_became_active":"2024-05-11T01:13:57.590241+0000","last_became_peered":"2024-05-11T01:13:57.590241+0000","last_unstale":"2024-05-11T01:14:46.284929+0000","last_undegraded":"2024-05-11T01:14:46.284929+0000","last_fullsized":"2024-05-11T01:14:46.284929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:07:21.860466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284838+0000","last_change":"2024-05-11T01:13:56.571495+0000","last_active":"2024-05-11T01:14:46.284838+0000","last_peered":"2024-05-11T01:14:46.284838+0000","last_clean":"2024-05-11T01:14:46.284838+0000","last_became_active":"2024-05-11T01:13:56.571211+0000","last_became_peered":"2024-05-11T01:13:56.571211+0000","last_unstale":"2024-05-11T01:14:46.284838+0000","last_undegraded":"2024-05-11T01:14:46.284838+0000","last_fullsized":"2024-05-11T01:14:46.284838+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:26:54.553975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285270+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:14:46.285270+0000","last_peered":"2024-05-11T01:14:46.285270+0000","last_clean":"2024-05-11T01:14:46.285270+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:14:46.285270+0000","last_undegraded":"2024-05-11T01:14:46.285270+0000","last_fullsized":"2024-05-11T01:14:46.285270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189839+0000","last_change":"2024-05-11T01:13:56.576731+0000","last_active":"2024-05-11T01:14:47.189839+0000","last_peered":"2024-05-11T01:14:47.189839+0000","last_clean":"2024-05-11T01:14:47.189839+0000","last_became_active":"2024-05-11T01:13:56.576163+0000","last_became_peered":"2024-05-11T01:13:56.576163+0000","last_unstale":"2024-05-11T01:14:47.189839+0000","last_undegraded":"2024-05-11T01:14:47.189839+0000","last_fullsized":"2024-05-11T01:14:47.189839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:38:23.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776622+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:14:46.776622+0000","last_peered":"2024-05-11T01:14:46.776622+0000","last_clean":"2024-05-11T01:14:46.776622+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:14:46.776622+0000","last_undegraded":"2024-05-11T01:14:46.776622+0000","last_fullsized":"2024-05-11T01:14:46.776622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285139+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:14:46.285139+0000","last_peered":"2024-05-11T01:14:46.285139+0000","last_clean":"2024-05-11T01:14:46.285139+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:14:46.285139+0000","last_undegraded":"2024-05-11T01:14:46.285139+0000","last_fullsized":"2024-05-11T01:14:46.285139+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284390+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:14:46.284390+0000","last_peered":"2024-05-11T01:14:46.284390+0000","last_clean":"2024-05-11T01:14:46.284390+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:14:46.284390+0000","last_undegraded":"2024-05-11T01:14:46.284390+0000","last_fullsized":"2024-05-11T01:14:46.284390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'11","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:09.720950+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:16:09.720950+0000","last_peered":"2024-05-11T01:16:09.720950+0000","last_clean":"2024-05-11T01:16:09.720950+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:16:09.720950+0000","last_undegraded":"2024-05-11T01:16:09.720950+0000","last_fullsized":"2024-05-11T01:16:09.720950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287250+0000","last_change":"2024-05-11T01:13:57.587446+0000","last_active":"2024-05-11T01:14:46.287250+0000","last_peered":"2024-05-11T01:14:46.287250+0000","last_clean":"2024-05-11T01:14:46.287250+0000","last_became_active":"2024-05-11T01:13:57.587034+0000","last_became_peered":"2024-05-11T01:13:57.587034+0000","last_unstale":"2024-05-11T01:14:46.287250+0000","last_undegraded":"2024-05-11T01:14:46.287250+0000","last_fullsized":"2024-05-11T01:14:46.287250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:51.169562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776593+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:14:46.776593+0000","last_peered":"2024-05-11T01:14:46.776593+0000","last_clean":"2024-05-11T01:14:46.776593+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:14:46.776593+0000","last_undegraded":"2024-05-11T01:14:46.776593+0000","last_fullsized":"2024-05-11T01:14:46.776593+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189401+0000","last_change":"2024-05-11T01:13:57.589755+0000","last_active":"2024-05-11T01:14:47.189401+0000","last_peered":"2024-05-11T01:14:47.189401+0000","last_clean":"2024-05-11T01:14:47.189401+0000","last_became_active":"2024-05-11T01:13:57.589439+0000","last_became_peered":"2024-05-11T01:13:57.589439+0000","last_unstale":"2024-05-11T01:14:47.189401+0000","last_undegraded":"2024-05-11T01:14:47.189401+0000","last_fullsized":"2024-05-11T01:14:47.189401+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284299+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:14:46.284299+0000","last_peered":"2024-05-11T01:14:46.284299+0000","last_clean":"2024-05-11T01:14:46.284299+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:14:46.284299+0000","last_undegraded":"2024-05-11T01:14:46.284299+0000","last_fullsized":"2024-05-11T01:14:46.284299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776250+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:14:46.776250+0000","last_peered":"2024-05-11T01:14:46.776250+0000","last_clean":"2024-05-11T01:14:46.776250+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:14:46.776250+0000","last_undegraded":"2024-05-11T01:14:46.776250+0000","last_fullsized":"2024-05-11T01:14:46.776250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776435+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:14:46.776435+0000","last_peered":"2024-05-11T01:14:46.776435+0000","last_clean":"2024-05-11T01:14:46.776435+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:14:46.776435+0000","last_undegraded":"2024-05-11T01:14:46.776435+0000","last_fullsized":"2024-05-11T01:14:46.776435+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284175+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:14:46.284175+0000","last_peered":"2024-05-11T01:14:46.284175+0000","last_clean":"2024-05-11T01:14:46.284175+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:14:46.284175+0000","last_undegraded":"2024-05-11T01:14:46.284175+0000","last_fullsized":"2024-05-11T01:14:46.284175+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"58'8","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189203+0000","last_change":"2024-05-11T01:13:56.576267+0000","last_active":"2024-05-11T01:14:47.189203+0000","last_peered":"2024-05-11T01:14:47.189203+0000","last_clean":"2024-05-11T01:14:47.189203+0000","last_became_active":"2024-05-11T01:13:56.575422+0000","last_became_peered":"2024-05-11T01:13:56.575422+0000","last_unstale":"2024-05-11T01:14:47.189203+0000","last_undegraded":"2024-05-11T01:14:47.189203+0000","last_fullsized":"2024-05-11T01:14:47.189203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:46:03.149087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283932+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:14:46.283932+0000","last_peered":"2024-05-11T01:14:46.283932+0000","last_clean":"2024-05-11T01:14:46.283932+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:14:46.283932+0000","last_undegraded":"2024-05-11T01:14:46.283932+0000","last_fullsized":"2024-05-11T01:14:46.283932+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284079+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:14:46.284079+0000","last_peered":"2024-05-11T01:14:46.284079+0000","last_clean":"2024-05-11T01:14:46.284079+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:14:46.284079+0000","last_undegraded":"2024-05-11T01:14:46.284079+0000","last_fullsized":"2024-05-11T01:14:46.284079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189698+0000","last_change":"2024-05-11T01:13:57.589024+0000","last_active":"2024-05-11T01:14:47.189698+0000","last_peered":"2024-05-11T01:14:47.189698+0000","last_clean":"2024-05-11T01:14:47.189698+0000","last_became_active":"2024-05-11T01:13:57.588641+0000","last_became_peered":"2024-05-11T01:13:57.588641+0000","last_unstale":"2024-05-11T01:14:47.189698+0000","last_undegraded":"2024-05-11T01:14:47.189698+0000","last_fullsized":"2024-05-11T01:14:47.189698+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285092+0000","last_change":"2024-05-11T01:13:56.571741+0000","last_active":"2024-05-11T01:14:46.285092+0000","last_peered":"2024-05-11T01:14:46.285092+0000","last_clean":"2024-05-11T01:14:46.285092+0000","last_became_active":"2024-05-11T01:13:56.571143+0000","last_became_peered":"2024-05-11T01:13:56.571143+0000","last_unstale":"2024-05-11T01:14:46.285092+0000","last_undegraded":"2024-05-11T01:14:46.285092+0000","last_fullsized":"2024-05-11T01:14:46.285092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287406+0000","last_change":"2024-05-11T01:13:57.573076+0000","last_active":"2024-05-11T01:14:46.287406+0000","last_peered":"2024-05-11T01:14:46.287406+0000","last_clean":"2024-05-11T01:14:46.287406+0000","last_became_active":"2024-05-11T01:13:57.572777+0000","last_became_peered":"2024-05-11T01:13:57.572777+0000","last_unstale":"2024-05-11T01:14:46.287406+0000","last_undegraded":"2024-05-11T01:14:46.287406+0000","last_fullsized":"2024-05-11T01:14:46.287406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287538+0000","last_change":"2024-05-11T01:13:56.573996+0000","last_active":"2024-05-11T01:14:46.287538+0000","last_peered":"2024-05-11T01:14:46.287538+0000","last_clean":"2024-05-11T01:14:46.287538+0000","last_became_active":"2024-05-11T01:13:56.573737+0000","last_became_peered":"2024-05-11T01:13:56.573737+0000","last_unstale":"2024-05-11T01:14:46.287538+0000","last_undegraded":"2024-05-11T01:14:46.287538+0000","last_fullsized":"2024-05-11T01:14:46.287538+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287575+0000","last_change":"2024-05-11T01:13:57.577270+0000","last_active":"2024-05-11T01:14:46.287575+0000","last_peered":"2024-05-11T01:14:46.287575+0000","last_clean":"2024-05-11T01:14:46.287575+0000","last_became_active":"2024-05-11T01:13:57.576978+0000","last_became_peered":"2024-05-11T01:13:57.576978+0000","last_unstale":"2024-05-11T01:14:46.287575+0000","last_undegraded":"2024-05-11T01:14:46.287575+0000","last_fullsized":"2024-05-11T01:14:46.287575+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776756+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:14:46.776756+0000","last_peered":"2024-05-11T01:14:46.776756+0000","last_clean":"2024-05-11T01:14:46.776756+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:14:46.776756+0000","last_undegraded":"2024-05-11T01:14:46.776756+0000","last_fullsized":"2024-05-11T01:14:46.776756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776445+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:14:46.776445+0000","last_peered":"2024-05-11T01:14:46.776445+0000","last_clean":"2024-05-11T01:14:46.776445+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:14:46.776445+0000","last_undegraded":"2024-05-11T01:14:46.776445+0000","last_fullsized":"2024-05-11T01:14:46.776445+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776830+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:14:46.776830+0000","last_peered":"2024-05-11T01:14:46.776830+0000","last_clean":"2024-05-11T01:14:46.776830+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:14:46.776830+0000","last_undegraded":"2024-05-11T01:14:46.776830+0000","last_fullsized":"2024-05-11T01:14:46.776830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341240+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:14:46.341240+0000","last_peered":"2024-05-11T01:14:46.341240+0000","last_clean":"2024-05-11T01:14:46.341240+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:14:46.341240+0000","last_undegraded":"2024-05-11T01:14:46.341240+0000","last_fullsized":"2024-05-11T01:14:46.341240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287365+0000","last_change":"2024-05-11T01:13:56.581631+0000","last_active":"2024-05-11T01:14:46.287365+0000","last_peered":"2024-05-11T01:14:46.287365+0000","last_clean":"2024-05-11T01:14:46.287365+0000","last_became_active":"2024-05-11T01:13:56.581299+0000","last_became_peered":"2024-05-11T01:13:56.581299+0000","last_unstale":"2024-05-11T01:14:46.287365+0000","last_undegraded":"2024-05-11T01:14:46.287365+0000","last_fullsized":"2024-05-11T01:14:46.287365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:35:01.793210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283707+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:14:46.283707+0000","last_peered":"2024-05-11T01:14:46.283707+0000","last_clean":"2024-05-11T01:14:46.283707+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:14:46.283707+0000","last_undegraded":"2024-05-11T01:14:46.283707+0000","last_fullsized":"2024-05-11T01:14:46.283707+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189307+0000","last_change":"2024-05-11T01:13:56.575003+0000","last_active":"2024-05-11T01:14:47.189307+0000","last_peered":"2024-05-11T01:14:47.189307+0000","last_clean":"2024-05-11T01:14:47.189307+0000","last_became_active":"2024-05-11T01:13:56.574726+0000","last_became_peered":"2024-05-11T01:13:56.574726+0000","last_unstale":"2024-05-11T01:14:47.189307+0000","last_undegraded":"2024-05-11T01:14:47.189307+0000","last_fullsized":"2024-05-11T01:14:47.189307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:15:10.911003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189149+0000","last_change":"2024-05-11T01:13:57.576056+0000","last_active":"2024-05-11T01:14:47.189149+0000","last_peered":"2024-05-11T01:14:47.189149+0000","last_clean":"2024-05-11T01:14:47.189149+0000","last_became_active":"2024-05-11T01:13:57.575723+0000","last_became_peered":"2024-05-11T01:13:57.575723+0000","last_unstale":"2024-05-11T01:14:47.189149+0000","last_undegraded":"2024-05-11T01:14:47.189149+0000","last_fullsized":"2024-05-11T01:14:47.189149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:23:18.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284012+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:14:46.284012+0000","last_peered":"2024-05-11T01:14:46.284012+0000","last_clean":"2024-05-11T01:14:46.284012+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:14:46.284012+0000","last_undegraded":"2024-05-11T01:14:46.284012+0000","last_fullsized":"2024-05-11T01:14:46.284012+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287887+0000","last_change":"2024-05-11T01:13:57.587557+0000","last_active":"2024-05-11T01:14:46.287887+0000","last_peered":"2024-05-11T01:14:46.287887+0000","last_clean":"2024-05-11T01:14:46.287887+0000","last_became_active":"2024-05-11T01:13:57.587255+0000","last_became_peered":"2024-05-11T01:13:57.587255+0000","last_unstale":"2024-05-11T01:14:46.287887+0000","last_undegraded":"2024-05-11T01:14:46.287887+0000","last_fullsized":"2024-05-11T01:14:46.287887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"61'3","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:06.168128+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:16:06.168128+0000","last_peered":"2024-05-11T01:16:06.168128+0000","last_clean":"2024-05-11T01:16:06.168128+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:16:06.168128+0000","last_undegraded":"2024-05-11T01:16:06.168128+0000","last_fullsized":"2024-05-11T01:16:06.168128+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189623+0000","last_change":"2024-05-11T01:13:57.588129+0000","last_active":"2024-05-11T01:14:47.189623+0000","last_peered":"2024-05-11T01:14:47.189623+0000","last_clean":"2024-05-11T01:14:47.189623+0000","last_became_active":"2024-05-11T01:13:57.577948+0000","last_became_peered":"2024-05-11T01:13:57.577948+0000","last_unstale":"2024-05-11T01:14:47.189623+0000","last_undegraded":"2024-05-11T01:14:47.189623+0000","last_fullsized":"2024-05-11T01:14:47.189623+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285353+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:14:46.285353+0000","last_peered":"2024-05-11T01:14:46.285353+0000","last_clean":"2024-05-11T01:14:46.285353+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:14:46.285353+0000","last_undegraded":"2024-05-11T01:14:46.285353+0000","last_fullsized":"2024-05-11T01:14:46.285353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285181+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:14:46.285181+0000","last_peered":"2024-05-11T01:14:46.285181+0000","last_clean":"2024-05-11T01:14:46.285181+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:14:46.285181+0000","last_undegraded":"2024-05-11T01:14:46.285181+0000","last_fullsized":"2024-05-11T01:14:46.285181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341392+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:14:46.341392+0000","last_peered":"2024-05-11T01:14:46.341392+0000","last_clean":"2024-05-11T01:14:46.341392+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:14:46.341392+0000","last_undegraded":"2024-05-11T01:14:46.341392+0000","last_fullsized":"2024-05-11T01:14:46.341392+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776562+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:14:46.776562+0000","last_peered":"2024-05-11T01:14:46.776562+0000","last_clean":"2024-05-11T01:14:46.776562+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:14:46.776562+0000","last_undegraded":"2024-05-11T01:14:46.776562+0000","last_fullsized":"2024-05-11T01:14:46.776562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284511+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:14:46.284511+0000","last_peered":"2024-05-11T01:14:46.284511+0000","last_clean":"2024-05-11T01:14:46.284511+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:14:46.284511+0000","last_undegraded":"2024-05-11T01:14:46.284511+0000","last_fullsized":"2024-05-11T01:14:46.284511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776496+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:14:46.776496+0000","last_peered":"2024-05-11T01:14:46.776496+0000","last_clean":"2024-05-11T01:14:46.776496+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:14:46.776496+0000","last_undegraded":"2024-05-11T01:14:46.776496+0000","last_fullsized":"2024-05-11T01:14:46.776496+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284370+0000","last_change":"2024-05-11T01:13:56.573647+0000","last_active":"2024-05-11T01:14:46.284370+0000","last_peered":"2024-05-11T01:14:46.284370+0000","last_clean":"2024-05-11T01:14:46.284370+0000","last_became_active":"2024-05-11T01:13:56.573347+0000","last_became_peered":"2024-05-11T01:13:56.573347+0000","last_unstale":"2024-05-11T01:14:46.284370+0000","last_undegraded":"2024-05-11T01:14:46.284370+0000","last_fullsized":"2024-05-11T01:14:46.284370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:47:34.803535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286760+0000","last_change":"2024-05-11T01:13:57.582673+0000","last_active":"2024-05-11T01:14:46.286760+0000","last_peered":"2024-05-11T01:14:46.286760+0000","last_clean":"2024-05-11T01:14:46.286760+0000","last_became_active":"2024-05-11T01:13:57.582398+0000","last_became_peered":"2024-05-11T01:13:57.582398+0000","last_unstale":"2024-05-11T01:14:46.286760+0000","last_undegraded":"2024-05-11T01:14:46.286760+0000","last_fullsized":"2024-05-11T01:14:46.286760+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:53:00.000306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341258+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:14:46.341258+0000","last_peered":"2024-05-11T01:14:46.341258+0000","last_clean":"2024-05-11T01:14:46.341258+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:14:46.341258+0000","last_undegraded":"2024-05-11T01:14:46.341258+0000","last_fullsized":"2024-05-11T01:14:46.341258+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283991+0000","last_change":"2024-05-11T01:13:57.575506+0000","last_active":"2024-05-11T01:14:46.283991+0000","last_peered":"2024-05-11T01:14:46.283991+0000","last_clean":"2024-05-11T01:14:46.283991+0000","last_became_active":"2024-05-11T01:13:57.575239+0000","last_became_peered":"2024-05-11T01:13:57.575239+0000","last_unstale":"2024-05-11T01:14:46.283991+0000","last_undegraded":"2024-05-11T01:14:46.283991+0000","last_fullsized":"2024-05-11T01:14:46.283991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:33:02.113131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189357+0000","last_change":"2024-05-11T01:13:56.576345+0000","last_active":"2024-05-11T01:14:47.189357+0000","last_peered":"2024-05-11T01:14:47.189357+0000","last_clean":"2024-05-11T01:14:47.189357+0000","last_became_active":"2024-05-11T01:13:56.575838+0000","last_became_peered":"2024-05-11T01:13:56.575838+0000","last_unstale":"2024-05-11T01:14:47.189357+0000","last_undegraded":"2024-05-11T01:14:47.189357+0000","last_fullsized":"2024-05-11T01:14:47.189357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:51.632315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189822+0000","last_change":"2024-05-11T01:13:57.588794+0000","last_active":"2024-05-11T01:14:47.189822+0000","last_peered":"2024-05-11T01:14:47.189822+0000","last_clean":"2024-05-11T01:14:47.189822+0000","last_became_active":"2024-05-11T01:13:57.586986+0000","last_became_peered":"2024-05-11T01:13:57.586986+0000","last_unstale":"2024-05-11T01:14:47.189822+0000","last_undegraded":"2024-05-11T01:14:47.189822+0000","last_fullsized":"2024-05-11T01:14:47.189822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:00:28.690447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287873+0000","last_change":"2024-05-11T01:13:56.579830+0000","last_active":"2024-05-11T01:14:46.287873+0000","last_peered":"2024-05-11T01:14:46.287873+0000","last_clean":"2024-05-11T01:14:46.287873+0000","last_became_active":"2024-05-11T01:13:56.579637+0000","last_became_peered":"2024-05-11T01:13:56.579637+0000","last_unstale":"2024-05-11T01:14:46.287873+0000","last_undegraded":"2024-05-11T01:14:46.287873+0000","last_fullsized":"2024-05-11T01:14:46.287873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":249,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284042+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:14:46.284042+0000","last_peered":"2024-05-11T01:14:46.284042+0000","last_clean":"2024-05-11T01:14:46.284042+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:14:46.284042+0000","last_undegraded":"2024-05-11T01:14:46.284042+0000","last_fullsized":"2024-05-11T01:14:46.284042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3794,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":932360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":342574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54104,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317736,"statfs":{"total":96636764160,"available":96581361664,"internally_reserved":0,"allocated":737280,"data_stored":344898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40224,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331616,"statfs":{"total":96636764160,"available":96595574784,"internally_reserved":0,"allocated":737280,"data_stored":342540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":741376,"data_stored":344920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58264,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313576,"statfs":{"total":96636764160,"available":96577101824,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1323008,"data_stored":932304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:16:11.659 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-11T01:16:11.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.799+0000 7f48f499e640 1 Processor -- start 2024-05-11T01:16:11.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.799+0000 7f48f499e640 1 -- start start 2024-05-11T01:16:11.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.800+0000 7f48f499e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f00b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.800+0000 7f48f499e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f48f006c840 0x7f48f00739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.800+0000 7f48f499e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f00d01a0 con 0x7f48f006c3e0 2024-05-11T01:16:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.800+0000 7f48f499e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f48f00d0db0 con 0x7f48f006c840 2024-05-11T01:16:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.800+0000 7f48f499e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f48f00d0480 con 0x7f48f0145a90 2024-05-11T01:16:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.800+0000 7f48effff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f48f006c840 0x7f48f00739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.801+0000 7f48effff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f48f006c840 0x7f48f00739f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60932/0 (socket says 172.21.15.16:60932) 2024-05-11T01:16:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.801+0000 7f48effff640 1 -- 172.21.15.16:0/4080803431 learned_addr learned my addr 172.21.15.16:0/4080803431 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.801+0000 7f48ef7fe640 1 --2- 172.21.15.16:0/4080803431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f00b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.801+0000 7f48effff640 1 -- 172.21.15.16:0/4080803431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 msgr2=0x7f48f00b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.801+0000 7f48effff640 1 --2- 172.21.15.16:0/4080803431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f00b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.801+0000 7f48effff640 1 -- 172.21.15.16:0/4080803431 >> v1:172.21.15.174:6789/0 conn(0x7f48f006c3e0 legacy=0x7f48f00732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.801+0000 7f48effff640 1 -- 172.21.15.16:0/4080803431 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f00d0760 con 0x7f48f006c840 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.801+0000 7f48effff640 1 --2- 172.21.15.16:0/4080803431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f00739f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009e50 tx=0x7f48e802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6a2bc52118d07e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48ee7fc640 1 -- 172.21.15.16:0/4080803431 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8036070 con 0x7f48f006c840 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48ee7fc640 1 -- 172.21.15.16:0/4080803431 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e8031600 con 0x7f48f006c840 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48ee7fc640 1 -- 172.21.15.16:0/4080803431 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e80319d0 con 0x7f48f006c840 2024-05-11T01:16:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48f499e640 1 -- 172.21.15.16:0/4080803431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 msgr2=0x7f48f00739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48f499e640 1 --2- 172.21.15.16:0/4080803431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f00739f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009e50 tx=0x7f48e802a5f0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48f499e640 1 -- 172.21.15.16:0/4080803431 shutdown_connections 2024-05-11T01:16:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48f499e640 1 --2- 172.21.15.16:0/4080803431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f00739f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48f499e640 1 --2- 172.21.15.16:0/4080803431 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f00b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48f499e640 1 -- 172.21.15.16:0/4080803431 >> 172.21.15.16:0/4080803431 conn(0x7f48f006e0a0 msgr2=0x7f48f00b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48f499e640 1 -- 172.21.15.16:0/4080803431 shutdown_connections 2024-05-11T01:16:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.802+0000 7f48f499e640 1 -- 172.21.15.16:0/4080803431 wait complete. 2024-05-11T01:16:11.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.804+0000 7f48f499e640 1 Processor -- start 2024-05-11T01:16:11.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.804+0000 7f48f499e640 1 -- start start 2024-05-11T01:16:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.804+0000 7f48f499e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48f006c3e0 0x7f48f01f9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48f499e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f0147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48f499e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f0139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48f499e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f48f00d1240 con 0x7f48f006c840 2024-05-11T01:16:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48f499e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f48f006ccd0 con 0x7f48f006c3e0 2024-05-11T01:16:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48f499e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f48f00cfdc0 con 0x7f48f0145a90 2024-05-11T01:16:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f0147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f0147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60948/0 (socket says 172.21.15.16:60948) 2024-05-11T01:16:11.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 -- 172.21.15.16:0/2160615059 learned_addr learned my addr 172.21.15.16:0/2160615059 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:11.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48effff640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f0139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 -- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 msgr2=0x7f48f0139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48ef7fe640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48f006c3e0 0x7f48f01f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f0139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 -- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48f006c3e0 msgr2=0x7f48f01f9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:11.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48f006c3e0 0x7f48f01f9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 -- 172.21.15.16:0/2160615059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f0147ff0 con 0x7f48f006c840 2024-05-11T01:16:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48effff640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f0139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48ef7fe640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48f006c3e0 0x7f48f01f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48eeffd640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f0147ab0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f48e400b3f0 tx=0x7f48e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48d7fff640 1 -- 172.21.15.16:0/2160615059 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4015020 con 0x7f48f006c840 2024-05-11T01:16:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48d7fff640 1 -- 172.21.15.16:0/2160615059 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e4011830 con 0x7f48f006c840 2024-05-11T01:16:11.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f013ae20 con 0x7f48f006c840 2024-05-11T01:16:11.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48d7fff640 1 -- 172.21.15.16:0/2160615059 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4011c20 con 0x7f48f006c840 2024-05-11T01:16:11.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.805+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f013b3e0 con 0x7f48f006c840 2024-05-11T01:16:11.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.807+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f0050860 con 0x7f48f006c840 2024-05-11T01:16:11.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.807+0000 7f48d7fff640 1 -- 172.21.15.16:0/2160615059 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f48e4018020 con 0x7f48f006c840 2024-05-11T01:16:11.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.808+0000 7f48d7fff640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f48dc0762d0 0x7f48dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:11.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.808+0000 7f48d7fff640 1 -- 172.21.15.16:0/2160615059 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f48e40976c0 con 0x7f48f006c840 2024-05-11T01:16:11.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.808+0000 7f48ef7fe640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f48dc0762d0 0x7f48dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:11.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.809+0000 7f48ef7fe640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f48dc0762d0 0x7f48dc078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48e0006fd0 tx=0x7f48e0008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:11.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:11.812+0000 7f48d7fff640 1 -- 172.21.15.16:0/2160615059 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f48e401f020 con 0x7f48f006c840 2024-05-11T01:16:12.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.003+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48f01392f0 con 0x7f48f006c840 2024-05-11T01:16:12.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.004+0000 7f48d7fff640 1 -- 172.21.15.16:0/2160615059 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+17291 (secure 0 0 0) 0x7f48e4060e70 con 0x7f48f006c840 2024-05-11T01:16:12.005 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:16:12.005 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":61,"fsid":"3d939707-6559-4ce1-a2ce-e98842b2ed86","created":"2024-05-11T01:00:53.345600+0000","modified":"2024-05-11T01:14:46.275555+0000","last_up_change":"2024-05-11T01:01:03.236853+0000","last_in_change":"2024-05-11T01:00:55.459284+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-11T01:01:03.770695+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-11T01:13:54.615049+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-11T01:13:55.893718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e40b2639-d7e1-4bc8-9115-b276895b56f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6801","nonce":126374263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6803","nonce":126374263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6807","nonce":126374263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":126374263},{"type":"v1","addr":"172.21.15.16:6805","nonce":126374263}]},"public_addr":"172.21.15.16:6801/126374263","cluster_addr":"172.21.15.16:6803/126374263","heartbeat_back_addr":"172.21.15.16:6807/126374263","heartbeat_front_addr":"172.21.15.16:6805/126374263","state":["exists","up"]},{"osd":1,"uuid":"bfd1b7f9-a497-4471-9f41-59f2fb72c5dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6809","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6811","nonce":3113723574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6813","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6815","nonce":3113723574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6823","nonce":3113723574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":3113723574},{"type":"v1","addr":"172.21.15.16:6820","nonce":3113723574}]},"public_addr":"172.21.15.16:6811/3113723574","cluster_addr":"172.21.15.16:6815/3113723574","heartbeat_back_addr":"172.21.15.16:6823/3113723574","heartbeat_front_addr":"172.21.15.16:6820/3113723574","state":["exists","up"]},{"osd":2,"uuid":"ae6f74d1-24a5-4d01-b129-506294a1f3f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6810","nonce":800114890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6814","nonce":800114890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6819","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6821","nonce":800114890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":800114890},{"type":"v1","addr":"172.21.15.16:6817","nonce":800114890}]},"public_addr":"172.21.15.16:6810/800114890","cluster_addr":"172.21.15.16:6814/800114890","heartbeat_back_addr":"172.21.15.16:6821/800114890","heartbeat_front_addr":"172.21.15.16:6817/800114890","state":["exists","up"]},{"osd":3,"uuid":"f59e2557-65f7-4200-824f-cf1ed0ff82e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6825","nonce":142472944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6827","nonce":142472944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6831","nonce":142472944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":142472944},{"type":"v1","addr":"172.21.15.16:6829","nonce":142472944}]},"public_addr":"172.21.15.16:6825/142472944","cluster_addr":"172.21.15.16:6827/142472944","heartbeat_back_addr":"172.21.15.16:6831/142472944","heartbeat_front_addr":"172.21.15.16:6829/142472944","state":["exists","up"]},{"osd":4,"uuid":"46528224-8949-4fc0-a3c0-9565a7c9c0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6801","nonce":1586428458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6803","nonce":1586428458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6807","nonce":1586428458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1586428458},{"type":"v1","addr":"172.21.15.174:6805","nonce":1586428458}]},"public_addr":"172.21.15.174:6801/1586428458","cluster_addr":"172.21.15.174:6803/1586428458","heartbeat_back_addr":"172.21.15.174:6807/1586428458","heartbeat_front_addr":"172.21.15.174:6805/1586428458","state":["exists","up"]},{"osd":5,"uuid":"3d198061-6fd7-4758-a603-dd75b3a24413","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6819","nonce":3546567206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6823","nonce":3546567206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6829","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6831","nonce":3546567206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6825","nonce":3546567206},{"type":"v1","addr":"172.21.15.174:6827","nonce":3546567206}]},"public_addr":"172.21.15.174:6819/3546567206","cluster_addr":"172.21.15.174:6823/3546567206","heartbeat_back_addr":"172.21.15.174:6831/3546567206","heartbeat_front_addr":"172.21.15.174:6827/3546567206","state":["exists","up"]},{"osd":6,"uuid":"d2f43fb1-aae7-4d8d-ac1e-f9d803c0bd33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6818","nonce":3065840134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6822","nonce":3065840134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6830","nonce":3065840134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3065840134},{"type":"v1","addr":"172.21.15.174:6826","nonce":3065840134}]},"public_addr":"172.21.15.174:6818/3065840134","cluster_addr":"172.21.15.174:6822/3065840134","heartbeat_back_addr":"172.21.15.174:6830/3065840134","heartbeat_front_addr":"172.21.15.174:6826/3065840134","state":["exists","up"]},{"osd":7,"uuid":"4bcf96b7-7cb6-4962-bffc-1705430867a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6809","nonce":3689065409}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6811","nonce":3689065409}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6815","nonce":3689065409}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3689065409},{"type":"v1","addr":"172.21.15.174:6813","nonce":3689065409}]},"public_addr":"172.21.15.174:6809/3689065409","cluster_addr":"172.21.15.174:6811/3689065409","heartbeat_back_addr":"172.21.15.174:6815/3689065409","heartbeat_front_addr":"172.21.15.174:6813/3689065409","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.527431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.658968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.611099+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.673809+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.666305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.608241+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.639860+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-11T01:01:00.645232+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":7,"length":1},{"begin":12,"length":1},{"begin":17,"length":1},{"begin":23,"length":1},{"begin":28,"length":1},{"begin":34,"length":1},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":49,"length":2},{"begin":55,"length":1},{"begin":60,"length":3},{"begin":66,"length":1},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":81,"length":3},{"begin":87,"length":1},{"begin":93,"length":2},{"begin":98,"length":1},{"begin":103,"length":2},{"begin":108,"length":1},{"begin":193,"length":29}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-11T01:16:12.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f48dc0762d0 msgr2=0x7f48dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:12.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f48dc0762d0 0x7f48dc078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48e0006fd0 tx=0x7f48e0008040 comp rx=0 tx=0).stop 2024-05-11T01:16:12.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 msgr2=0x7f48f0147ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:12.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f0147ab0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f48e400b3f0 tx=0x7f48e400b8b0 comp rx=0 tx=0).stop 2024-05-11T01:16:12.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 shutdown_connections 2024-05-11T01:16:12.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f48f0145a90 0x7f48f0139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:12.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48f006c840 0x7f48f0147ab0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:12.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f48dc0762d0 0x7f48dc078790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:12.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 --2- 172.21.15.16:0/2160615059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48f006c3e0 0x7f48f01f9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:12.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.006+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 >> 172.21.15.16:0/2160615059 conn(0x7f48f006e0a0 msgr2=0x7f48f00732e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:12.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.007+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 shutdown_connections 2024-05-11T01:16:12.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:12.007+0000 7f48f499e640 1 -- 172.21.15.16:0/2160615059 wait complete. 2024-05-11T01:16:13.018 INFO:tasks.ceph:Scrubbing osd.0 2024-05-11T01:16:13.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-11T01:16:13.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.143+0000 7f0ea25a4640 1 Processor -- start 2024-05-11T01:16:13.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.143+0000 7f0ea25a4640 1 -- start start 2024-05-11T01:16:13.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.144+0000 7f0ea25a4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0e9c144f80 0x7f0e9c0b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.144+0000 7f0ea25a4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e9c0ce7f0 0x7f0e9c15fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.144+0000 7f0ea25a4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9c0b3f60 con 0x7f0e9c0b2ea0 2024-05-11T01:16:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.144+0000 7f0ea25a4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f0e9c0cec50 con 0x7f0e9c144f80 2024-05-11T01:16:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.144+0000 7f0ea25a4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c160520 con 0x7f0e9c0ce7f0 2024-05-11T01:16:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.144+0000 7f0ea0b41640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0e9c0b2ea0 0x7f0e9c0b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57060/0 (socket says 172.21.15.16:57060) 2024-05-11T01:16:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.144+0000 7f0ea0b41640 1 -- 172.21.15.16:0/3361743205 learned_addr learned my addr 172.21.15.16:0/3361743205 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e93fff640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e9c0ce7f0 0x7f0e9c15fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9bfff640 1 --2- 172.21.15.16:0/3361743205 >> v2:172.21.15.174:3300/0 conn(0x7f0e9c144f80 0x7f0e9c0b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529245824 0 0) 0x7f0e9c0b3f60 con 0x7f0e9c0b2ea0 2024-05-11T01:16:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e88003520 con 0x7f0e9c0b2ea0 2024-05-11T01:16:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4056696766 0 0) 0x7f0e88003520 con 0x7f0e9c0b2ea0 2024-05-11T01:16:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e9c0ce7f0 msgr2=0x7f0e9c15fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e9c0ce7f0 0x7f0e9c15fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 >> v2:172.21.15.174:3300/0 conn(0x7f0e9c144f80 msgr2=0x7f0e9c0b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 --2- 172.21.15.16:0/3361743205 >> v2:172.21.15.174:3300/0 conn(0x7f0e9c144f80 0x7f0e9c0b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c160800 con 0x7f0e9c0b2ea0 2024-05-11T01:16:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f0e94001a70 con 0x7f0e9c0b2ea0 2024-05-11T01:16:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 >> v1:172.21.15.16:6789/0 conn(0x7f0e9c0b2ea0 legacy=0x7f0e9c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88003a00 0x7f0e88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e88004800 0x7f0e88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e880051c0 0x7f0e8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0cec50 con 0x7f0e88004800 2024-05-11T01:16:13.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c160520 con 0x7f0e880051c0 2024-05-11T01:16:13.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0e8800bf50 con 0x7f0e88003a00 2024-05-11T01:16:13.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e93fff640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e9c0ce7f0 0x7f0e9c15fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:16:13.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9bfff640 1 --2- 172.21.15.16:0/3361743205 >> v2:172.21.15.174:3300/0 conn(0x7f0e9c144f80 0x7f0e9c0b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e93fff640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e88004800 0x7f0e88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0ea0b41640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e880051c0 0x7f0e8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.145+0000 7f0e9bfff640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88003a00 0x7f0e88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.146+0000 7f0e93fff640 1 -- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88003a00 msgr2=0x7f0e88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.146+0000 7f0e93fff640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88003a00 0x7f0e88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.146+0000 7f0e93fff640 1 -- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e880051c0 msgr2=0x7f0e8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.146+0000 7f0e93fff640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e880051c0 0x7f0e8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.146+0000 7f0e93fff640 1 -- 172.21.15.16:0/3361743205 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e88003520 con 0x7f0e88004800 2024-05-11T01:16:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.146+0000 7f0e93fff640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e88004800 0x7f0e88004c80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400bda0 tx=0x7f0e88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab4816f566c456f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84039070 con 0x7f0e88004800 2024-05-11T01:16:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e84004230 con 0x7f0e88004800 2024-05-11T01:16:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0e9b7fe640 1 -- 172.21.15.16:0/3361743205 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400ba70 con 0x7f0e88004800 2024-05-11T01:16:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0ea25a4640 1 -- 172.21.15.16:0/3361743205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e88004800 msgr2=0x7f0e88004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0ea25a4640 1 --2- 172.21.15.16:0/3361743205 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e88004800 0x7f0e88004c80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400bda0 tx=0x7f0e88005830 comp rx=0 tx=0).stop 2024-05-11T01:16:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0ea0b41640 1 -- 172.21.15.16:0/3361743205 reap_dead start 2024-05-11T01:16:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0ea25a4640 1 -- 172.21.15.16:0/3361743205 shutdown_connections 2024-05-11T01:16:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0ea25a4640 1 -- 172.21.15.16:0/3361743205 >> 172.21.15.16:0/3361743205 conn(0x7f0e9c06c5c0 msgr2=0x7f0e9c06c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0ea25a4640 1 -- 172.21.15.16:0/3361743205 shutdown_connections 2024-05-11T01:16:13.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.147+0000 7f0ea25a4640 1 -- 172.21.15.16:0/3361743205 wait complete. 2024-05-11T01:16:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.148+0000 7f0ea25a4640 1 Processor -- start 2024-05-11T01:16:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0ea25a4640 1 -- start start 2024-05-11T01:16:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0ea25a4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88004800 0x7f0e9c0ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0ea25a4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e9c1432e0 0x7f0e9c143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0ea25a4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9c140350 0x7f0e9c1407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0ea25a4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b3330 con 0x7f0e9c1432e0 2024-05-11T01:16:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0ea25a4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b4200 con 0x7f0e9c140350 2024-05-11T01:16:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0ea25a4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c0b34b0 con 0x7f0e88004800 2024-05-11T01:16:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0e93fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e9c1432e0 0x7f0e9c143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0e93fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e9c1432e0 0x7f0e9c143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34828/0 (socket says 172.21.15.16:34828) 2024-05-11T01:16:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.149+0000 7f0e93fff640 1 -- 172.21.15.16:0/562106825 learned_addr learned my addr 172.21.15.16:0/562106825 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:13.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e9bfff640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88004800 0x7f0e9c0ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0ea0b41640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9c140350 0x7f0e9c1407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e93fff640 1 -- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88004800 msgr2=0x7f0e9c0ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e93fff640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88004800 0x7f0e9c0ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e93fff640 1 -- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9c140350 msgr2=0x7f0e9c1407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e93fff640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0e9c140350 0x7f0e9c1407d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e93fff640 1 -- 172.21.15.16:0/562106825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c143ca0 con 0x7f0e9c1432e0 2024-05-11T01:16:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e9bfff640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f0e88004800 0x7f0e9c0ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:13.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e93fff640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e9c1432e0 0x7f0e9c143760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400bda0 tx=0x7f0e84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84043020 con 0x7f0e9c1432e0 2024-05-11T01:16:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8403a040 con 0x7f0e9c1432e0 2024-05-11T01:16:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9c140d10 con 0x7f0e9c1432e0 2024-05-11T01:16:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84039030 con 0x7f0e9c1432e0 2024-05-11T01:16:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.150+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9c144210 con 0x7f0e9c1432e0 2024-05-11T01:16:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.151+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e9c06a5b0 con 0x7f0e9c1432e0 2024-05-11T01:16:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.152+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f0e84046020 con 0x7f0e9c1432e0 2024-05-11T01:16:13.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.152+0000 7f0e997fa640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f0e7c0762d0 0x7f0e7c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.152+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f0e840babc0 con 0x7f0e9c1432e0 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.153+0000 7f0e997fa640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f0e7c07e930 0x7f0e7c080d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.153+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 --> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e8404ae50 con 0x7f0e7c07e930 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.153+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f0e840c1020 con 0x7f0e9c1432e0 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.153+0000 7f0ea0b41640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f0e7c07e930 0x7f0e7c080d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.153+0000 7f0e9bfff640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f0e7c0762d0 0x7f0e7c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.153+0000 7f0ea0b41640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f0e7c07e930 0x7f0e7c080d40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.153+0000 7f0e9bfff640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f0e7c0762d0 0x7f0e7c078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c14f3f0 tx=0x7f0e8c008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.154+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 <== osd.0 v2:172.21.15.16:6800/126374263 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e8404ae50 con 0x7f0e7c07e930 2024-05-11T01:16:13.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.167+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 --> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0e9c073f20 con 0x7f0e7c07e930 2024-05-11T01:16:13.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.167+0000 7f0e997fa640 1 -- 172.21.15.16:0/562106825 <== osd.0 v2:172.21.15.16:6800/126374263 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0e9c073f20 con 0x7f0e7c07e930 2024-05-11T01:16:13.167 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:16:13.168 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-11T01:16:13.168 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:16:13.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f0e7c07e930 msgr2=0x7f0e7c080d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.16:6800/126374263,v1:172.21.15.16:6801/126374263] conn(0x7f0e7c07e930 0x7f0e7c080d40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f0e7c0762d0 msgr2=0x7f0e7c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f0e7c0762d0 0x7f0e7c078790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c14f3f0 tx=0x7f0e8c008040 comp rx=0 tx=0).stop 2024-05-11T01:16:13.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e9c1432e0 msgr2=0x7f0e9c143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 --2- 172.21.15.16:0/562106825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e9c1432e0 0x7f0e9c143760 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400bda0 tx=0x7f0e84004730 comp rx=0 tx=0).stop 2024-05-11T01:16:13.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea0b41640 1 -- 172.21.15.16:0/562106825 reap_dead start 2024-05-11T01:16:13.169 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 shutdown_connections 2024-05-11T01:16:13.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 >> 172.21.15.16:0/562106825 conn(0x7f0e9c06c5c0 msgr2=0x7f0e9c072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:13.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 shutdown_connections 2024-05-11T01:16:13.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.168+0000 7f0ea25a4640 1 -- 172.21.15.16:0/562106825 wait complete. 2024-05-11T01:16:13.178 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-11T01:16:13.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.284+0000 7f3b69c59640 1 Processor -- start 2024-05-11T01:16:13.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.284+0000 7f3b69c59640 1 -- start start 2024-05-11T01:16:13.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b69c59640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3b640b5380 0x7f3b640b5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b69c59640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3b64070890 0x7f3b64070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b69c59640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6415fc20 con 0x7f3b6415d1f0 2024-05-11T01:16:13.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b69c59640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3b64160510 con 0x7f3b64070890 2024-05-11T01:16:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b69c59640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f3b640b19d0 con 0x7f3b640b5380 2024-05-11T01:16:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b63fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3b64070890 0x7f3b64070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b63fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3b64070890 0x7f3b64070cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34838/0 (socket says 172.21.15.16:34838) 2024-05-11T01:16:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b63fff640 1 -- 172.21.15.16:0/1380165186 learned_addr learned my addr 172.21.15.16:0/1380165186 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b62ffd640 1 --2- 172.21.15.16:0/1380165186 >> v2:172.21.15.174:3300/0 conn(0x7f3b640b5380 0x7f3b640b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b63fff640 1 -- 172.21.15.16:0/1380165186 >> v2:172.21.15.174:3300/0 conn(0x7f3b640b5380 msgr2=0x7f3b640b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b63fff640 1 --2- 172.21.15.16:0/1380165186 >> v2:172.21.15.174:3300/0 conn(0x7f3b640b5380 0x7f3b640b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b63fff640 1 -- 172.21.15.16:0/1380165186 >> v1:172.21.15.174:6789/0 conn(0x7f3b6415d1f0 legacy=0x7f3b640b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b63fff640 1 -- 172.21.15.16:0/1380165186 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6415fec0 con 0x7f3b64070890 2024-05-11T01:16:13.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.285+0000 7f3b62ffd640 1 --2- 172.21.15.16:0/1380165186 >> v2:172.21.15.174:3300/0 conn(0x7f3b640b5380 0x7f3b640b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.286+0000 7f3b63fff640 1 --2- 172.21.15.16:0/1380165186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b64070890 0x7f3b64070cc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3b640ce2e0 tx=0x7f3b5c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c7cc8d517109b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.286+0000 7f3b627fc640 1 -- 172.21.15.16:0/1380165186 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c036070 con 0x7f3b64070890 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.286+0000 7f3b627fc640 1 -- 172.21.15.16:0/1380165186 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c031600 con 0x7f3b64070890 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.286+0000 7f3b627fc640 1 -- 172.21.15.16:0/1380165186 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0319d0 con 0x7f3b64070890 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.287+0000 7f3b69c59640 1 -- 172.21.15.16:0/1380165186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b64070890 msgr2=0x7f3b64070cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.287+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1380165186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b64070890 0x7f3b64070cc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3b640ce2e0 tx=0x7f3b5c02a6a0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.287+0000 7f3b69c59640 1 -- 172.21.15.16:0/1380165186 shutdown_connections 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.287+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1380165186 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b64070890 0x7f3b64070cc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.287+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1380165186 >> v2:172.21.15.174:3300/0 conn(0x7f3b640b5380 0x7f3b640b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.287+0000 7f3b69c59640 1 -- 172.21.15.16:0/1380165186 >> 172.21.15.16:0/1380165186 conn(0x7f3b640d2060 msgr2=0x7f3b640d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:13.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.287+0000 7f3b69c59640 1 -- 172.21.15.16:0/1380165186 shutdown_connections 2024-05-11T01:16:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.287+0000 7f3b69c59640 1 -- 172.21.15.16:0/1380165186 wait complete. 2024-05-11T01:16:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.288+0000 7f3b69c59640 1 Processor -- start 2024-05-11T01:16:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.288+0000 7f3b69c59640 1 -- start start 2024-05-11T01:16:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b69c59640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b64070890 0x7f3b6414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b69c59640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b640b5380 0x7f3b6415ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b69c59640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b6415d1f0 0x7f3b6415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b69c59640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6406d230 con 0x7f3b6415d1f0 2024-05-11T01:16:13.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b69c59640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641609a0 con 0x7f3b64070890 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b69c59640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3b640b1660 con 0x7f3b640b5380 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b6415d1f0 0x7f3b6415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b6415d1f0 0x7f3b6415b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34844/0 (socket says 172.21.15.16:34844) 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 -- 172.21.15.16:0/1633506435 learned_addr learned my addr 172.21.15.16:0/1633506435 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b62ffd640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b640b5380 0x7f3b6415ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b637fe640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b64070890 0x7f3b6414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 -- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b640b5380 msgr2=0x7f3b6415ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b640b5380 0x7f3b6415ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 -- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b64070890 msgr2=0x7f3b6414fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b64070890 0x7f3b6414fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 -- 172.21.15.16:0/1633506435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6415ba00 con 0x7f3b6415d1f0 2024-05-11T01:16:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b62ffd640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b640b5380 0x7f3b6415ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.289+0000 7f3b63fff640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b6415d1f0 0x7f3b6415b1c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c02ac90 tx=0x7f3b5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.290+0000 7f3b4bfff640 1 -- 172.21.15.16:0/1633506435 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c036050 con 0x7f3b6415d1f0 2024-05-11T01:16:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.290+0000 7f3b4bfff640 1 -- 172.21.15.16:0/1633506435 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c042070 con 0x7f3b6415d1f0 2024-05-11T01:16:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.290+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6415bce0 con 0x7f3b6415d1f0 2024-05-11T01:16:13.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.290+0000 7f3b4bfff640 1 -- 172.21.15.16:0/1633506435 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c009510 con 0x7f3b6415d1f0 2024-05-11T01:16:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.290+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6415b700 con 0x7f3b6415d1f0 2024-05-11T01:16:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.291+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6406a5b0 con 0x7f3b6415d1f0 2024-05-11T01:16:13.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.291+0000 7f3b4bfff640 1 -- 172.21.15.16:0/1633506435 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f3b5c007bd0 con 0x7f3b6415d1f0 2024-05-11T01:16:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.292+0000 7f3b4bfff640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3b50076300 0x7f3b500787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.292+0000 7f3b4bfff640 1 -- 172.21.15.16:0/1633506435 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f3b5c0b87d0 con 0x7f3b6415d1f0 2024-05-11T01:16:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.292+0000 7f3b637fe640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3b50076300 0x7f3b500787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.293+0000 7f3b637fe640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3b50076300 0x7f3b500787c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b54006fd0 tx=0x7f3b54008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.296+0000 7f3b4bfff640 1 -- 172.21.15.16:0/1633506435 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3b5c081ee0 con 0x7f3b6415d1f0 2024-05-11T01:16:13.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.490+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f3b640d28c0 con 0x7f3b50076300 2024-05-11T01:16:13.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.490+0000 7f3b4bfff640 1 -- 172.21.15.16:0/1633506435 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3b640d28c0 con 0x7f3b50076300 2024-05-11T01:16:13.491 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-05-11T01:16:13.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3b50076300 msgr2=0x7f3b500787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3b50076300 0x7f3b500787c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b54006fd0 tx=0x7f3b54008040 comp rx=0 tx=0).stop 2024-05-11T01:16:13.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b6415d1f0 msgr2=0x7f3b6415b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b6415d1f0 0x7f3b6415b1c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c02ac90 tx=0x7f3b5c004a40 comp rx=0 tx=0).stop 2024-05-11T01:16:13.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 shutdown_connections 2024-05-11T01:16:13.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b6415d1f0 0x7f3b6415b1c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b640b5380 0x7f3b6415ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3b50076300 0x7f3b500787c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 --2- 172.21.15.16:0/1633506435 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b64070890 0x7f3b6414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 >> 172.21.15.16:0/1633506435 conn(0x7f3b640d2060 msgr2=0x7f3b64070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:13.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 shutdown_connections 2024-05-11T01:16:13.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.493+0000 7f3b69c59640 1 -- 172.21.15.16:0/1633506435 wait complete. 2024-05-11T01:16:13.504 INFO:tasks.ceph:Scrubbing osd.1 2024-05-11T01:16:13.504 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-11T01:16:13.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.614+0000 7fc8af580640 1 Processor -- start 2024-05-11T01:16:13.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.614+0000 7fc8af580640 1 -- start start 2024-05-11T01:16:13.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.615+0000 7fc8af580640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc8a80d29d0 0x7fc8a816a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.615+0000 7fc8af580640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a815fa70 con 0x7fc8a815f690 2024-05-11T01:16:13.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.615+0000 7fc8af580640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a80d50e0 con 0x7fc8a80bacf0 2024-05-11T01:16:13.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.615+0000 7fc8af580640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a80d4040 con 0x7fc8a80d29d0 2024-05-11T01:16:13.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.615+0000 7fc8ad31c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc8a815f690 0x7fc8a80d3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57066/0 (socket says 172.21.15.16:57066) 2024-05-11T01:16:13.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.615+0000 7fc8ad31c640 1 -- 172.21.15.16:0/224820931 learned_addr learned my addr 172.21.15.16:0/224820931 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:13.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8adb1d640 1 --2- 172.21.15.16:0/224820931 >> v2:172.21.15.174:3300/0 conn(0x7fc8a80d29d0 0x7fc8a816a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212986366 0 0) 0x7fc8a815fa70 con 0x7fc8a815f690 2024-05-11T01:16:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc890003520 con 0x7fc8a815f690 2024-05-11T01:16:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2313699295 0 0) 0x7fc890003520 con 0x7fc8a815f690 2024-05-11T01:16:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 >> v2:172.21.15.174:3300/0 conn(0x7fc8a80d29d0 msgr2=0x7fc8a816a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 --2- 172.21.15.16:0/224820931 >> v2:172.21.15.174:3300/0 conn(0x7fc8a80d29d0 0x7fc8a816a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 >> v1:172.21.15.174:6789/0 conn(0x7fc8a80bacf0 legacy=0x7fc8a80d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a80d4320 con 0x7fc8a815f690 2024-05-11T01:16:13.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7fc8a00016f0 con 0x7fc8a815f690 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 >> v1:172.21.15.16:6789/0 conn(0x7fc8a815f690 legacy=0x7fc8a80d3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc890003a50 0x7fc890003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc890004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8900052e0 0x7fc89000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a80d4040 con 0x7fc890004800 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc89000c1b0 con 0x7fc8900052e0 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc89000c3b0 con 0x7fc890003a50 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8acb1b640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc890004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8ad31c640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc890003a50 0x7fc890003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8adb1d640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8900052e0 0x7fc89000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8acb1b640 1 -- 172.21.15.16:0/224820931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc890003a50 msgr2=0x7fc890003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8acb1b640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc890003a50 0x7fc890003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8acb1b640 1 -- 172.21.15.16:0/224820931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8900052e0 msgr2=0x7fc89000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8acb1b640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8900052e0 0x7fc89000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8acb1b640 1 -- 172.21.15.16:0/224820931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc890003520 con 0x7fc890004800 2024-05-11T01:16:13.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.616+0000 7fc8adb1d640 1 -- 172.21.15.16:0/224820931 reap_dead start 2024-05-11T01:16:13.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.617+0000 7fc8acb1b640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc890004c80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80bb130 tx=0x7fc890005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e105f9111ce8a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.617+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c0013b0 con 0x7fc890004800 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.617+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0052d0 con 0x7fc890004800 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.617+0000 7fc8a7fff640 1 -- 172.21.15.16:0/224820931 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c02aa20 con 0x7fc890004800 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.618+0000 7fc8af580640 1 -- 172.21.15.16:0/224820931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 msgr2=0x7fc890004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.618+0000 7fc8af580640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc890004c80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80bb130 tx=0x7fc890005830 comp rx=0 tx=0).stop 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.618+0000 7fc8af580640 1 -- 172.21.15.16:0/224820931 shutdown_connections 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.618+0000 7fc8af580640 1 --2- 172.21.15.16:0/224820931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc890004c80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.618+0000 7fc8af580640 1 -- 172.21.15.16:0/224820931 >> 172.21.15.16:0/224820931 conn(0x7fc8a8073f60 msgr2=0x7fc8a8074370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:13.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.618+0000 7fc8af580640 1 -- 172.21.15.16:0/224820931 shutdown_connections 2024-05-11T01:16:13.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.618+0000 7fc8af580640 1 -- 172.21.15.16:0/224820931 wait complete. 2024-05-11T01:16:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.619+0000 7fc8af580640 1 Processor -- start 2024-05-11T01:16:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.619+0000 7fc8af580640 1 -- start start 2024-05-11T01:16:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8af580640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc8a80cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8af580640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8a815fae0 0x7fc8a814c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8af580640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8a80ca240 0x7fc8a80ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8af580640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a80d4bc0 con 0x7fc890004800 2024-05-11T01:16:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8af580640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a80d48e0 con 0x7fc8a815fae0 2024-05-11T01:16:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8af580640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a80d22c0 con 0x7fc8a80ca240 2024-05-11T01:16:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc8a80cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc8a80cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34864/0 (socket says 172.21.15.16:34864) 2024-05-11T01:16:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 -- 172.21.15.16:0/389925369 learned_addr learned my addr 172.21.15.16:0/389925369 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8acb1b640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8a815fae0 0x7fc8a814c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8adb1d640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8a80ca240 0x7fc8a80ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 -- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8a80ca240 msgr2=0x7fc8a80ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc8a80ca240 0x7fc8a80ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 -- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8a815fae0 msgr2=0x7fc8a814c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8a815fae0 0x7fc8a814c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 -- 172.21.15.16:0/389925369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a80ce2c0 con 0x7fc890004800 2024-05-11T01:16:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8acb1b640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8a815fae0 0x7fc8a814c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8ad31c640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc8a80cd6e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0004ef0 tx=0x7fc8a0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.620+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000f7b0 con 0x7fc890004800 2024-05-11T01:16:13.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.621+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a0018070 con 0x7fc890004800 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.621+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a80ce5a0 con 0x7fc890004800 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.621+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000fb90 con 0x7fc890004800 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.621+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a80ceb60 con 0x7fc890004800 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.622+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8a80ce070 con 0x7fc890004800 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.622+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fc8a000fd30 con 0x7fc890004800 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.623+0000 7fc8a5ffb640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc894076300 0x7fc8940787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.623+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7fc8a0097690 con 0x7fc890004800 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.623+0000 7fc8a5ffb640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7fc89407e960 0x7fc894080d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.623+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 --> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8940813a0 con 0x7fc89407e960 2024-05-11T01:16:13.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.623+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fc8a009e050 con 0x7fc890004800 2024-05-11T01:16:13.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.623+0000 7fc8acb1b640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc894076300 0x7fc8940787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.623+0000 7fc8adb1d640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7fc89407e960 0x7fc894080d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.623+0000 7fc8adb1d640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7fc89407e960 0x7fc894080d70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.624+0000 7fc8acb1b640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc894076300 0x7fc8940787c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc89c032000 tx=0x7fc89c02e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.624+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 <== osd.1 v2:172.21.15.16:6809/3113723574 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8940813a0 con 0x7fc89407e960 2024-05-11T01:16:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.637+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 --> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc8a806a5b0 con 0x7fc89407e960 2024-05-11T01:16:13.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.637+0000 7fc8a5ffb640 1 -- 172.21.15.16:0/389925369 <== osd.1 v2:172.21.15.16:6809/3113723574 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc8a806a5b0 con 0x7fc89407e960 2024-05-11T01:16:13.639 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:16:13.639 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-11T01:16:13.639 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:16:13.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7fc89407e960 msgr2=0x7fc894080d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.16:6809/3113723574,v1:172.21.15.16:6811/3113723574] conn(0x7fc89407e960 0x7fc894080d70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc894076300 msgr2=0x7fc8940787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc894076300 0x7fc8940787c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc89c032000 tx=0x7fc89c02e000 comp rx=0 tx=0).stop 2024-05-11T01:16:13.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 msgr2=0x7fc8a80cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 --2- 172.21.15.16:0/389925369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc890004800 0x7fc8a80cd6e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0004ef0 tx=0x7fc8a0007430 comp rx=0 tx=0).stop 2024-05-11T01:16:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8adb1d640 1 -- 172.21.15.16:0/389925369 reap_dead start 2024-05-11T01:16:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 shutdown_connections 2024-05-11T01:16:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 >> 172.21.15.16:0/389925369 conn(0x7fc8a8073f60 msgr2=0x7fc8a80b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 shutdown_connections 2024-05-11T01:16:13.641 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.638+0000 7fc8af580640 1 -- 172.21.15.16:0/389925369 wait complete. 2024-05-11T01:16:13.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-11T01:16:13.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.753+0000 7fc2d7b71640 1 Processor -- start 2024-05-11T01:16:13.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.753+0000 7fc2d7b71640 1 -- start start 2024-05-11T01:16:13.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d7b71640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d006f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d7b71640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc2d00d2a20 0x7fc2d00cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d7b71640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2d00d3090 0x7fc2d00d3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d7b71640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d0163ea0 con 0x7fc2d00d2a20 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d7b71640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d00cdc90 con 0x7fc2d00d3090 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d7b71640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d00d2e80 con 0x7fc2d015f530 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d510c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc2d00d2a20 0x7fc2d00cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d510c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc2d00d2a20 0x7fc2d00cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34866/0 (socket says 172.21.15.16:34866) 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.754+0000 7fc2d510c640 1 -- 172.21.15.16:0/2188599601 learned_addr learned my addr 172.21.15.16:0/2188599601 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d610e640 1 --2- 172.21.15.16:0/2188599601 >> v2:172.21.15.174:3300/0 conn(0x7fc2d00d3090 0x7fc2d00d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d590d640 1 --2- 172.21.15.16:0/2188599601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d006f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d510c640 1 -- 172.21.15.16:0/2188599601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 msgr2=0x7fc2d006f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d510c640 1 --2- 172.21.15.16:0/2188599601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d006f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d510c640 1 -- 172.21.15.16:0/2188599601 >> v2:172.21.15.174:3300/0 conn(0x7fc2d00d3090 msgr2=0x7fc2d00d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d510c640 1 --2- 172.21.15.16:0/2188599601 >> v2:172.21.15.174:3300/0 conn(0x7fc2d00d3090 0x7fc2d00d3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d510c640 1 -- 172.21.15.16:0/2188599601 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d0162fb0 con 0x7fc2d00d2a20 2024-05-11T01:16:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d610e640 1 --2- 172.21.15.16:0/2188599601 >> v2:172.21.15.174:3300/0 conn(0x7fc2d00d3090 0x7fc2d00d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d590d640 1 --2- 172.21.15.16:0/2188599601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d006f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:13.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.755+0000 7fc2d510c640 1 --2- 172.21.15.16:0/2188599601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d2a20 0x7fc2d00cd750 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00c6b10 tx=0x7fc2c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534fb7775fee8b19 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d490b640 1 -- 172.21.15.16:0/2188599601 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4037070 con 0x7fc2d00d2a20 2024-05-11T01:16:13.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d490b640 1 -- 172.21.15.16:0/2188599601 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c4032440 con 0x7fc2d00d2a20 2024-05-11T01:16:13.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d490b640 1 -- 172.21.15.16:0/2188599601 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4032810 con 0x7fc2d00d2a20 2024-05-11T01:16:13.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 -- 172.21.15.16:0/2188599601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d2a20 msgr2=0x7fc2d00cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/2188599601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d2a20 0x7fc2d00cd750 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00c6b10 tx=0x7fc2c402a1e0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 -- 172.21.15.16:0/2188599601 shutdown_connections 2024-05-11T01:16:13.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/2188599601 >> v2:172.21.15.174:3300/0 conn(0x7fc2d00d3090 0x7fc2d00d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/2188599601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d2a20 0x7fc2d00cd750 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/2188599601 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d006f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 -- 172.21.15.16:0/2188599601 >> 172.21.15.16:0/2188599601 conn(0x7fc2d00681c0 msgr2=0x7fc2d00685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 -- 172.21.15.16:0/2188599601 shutdown_connections 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.756+0000 7fc2d7b71640 1 -- 172.21.15.16:0/2188599601 wait complete. 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.758+0000 7fc2d7b71640 1 Processor -- start 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.758+0000 7fc2d7b71640 1 -- start start 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.758+0000 7fc2d7b71640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d00d2a20 0x7fc2d00c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.758+0000 7fc2d7b71640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d3090 0x7fc2d015f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d7b71640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d7b71640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0163850 con 0x7fc2d00d3090 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d7b71640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d0163570 con 0x7fc2d00d2a20 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d7b71640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d0163b30 con 0x7fc2d015f530 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d3090 0x7fc2d015f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d3090 0x7fc2d015f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34880/0 (socket says 172.21.15.16:34880) 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 -- 172.21.15.16:0/720365515 learned_addr learned my addr 172.21.15.16:0/720365515 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d610e640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d590d640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d00d2a20 0x7fc2d00c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 -- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 msgr2=0x7fc2d0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 -- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d00d2a20 msgr2=0x7fc2d00c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d00d2a20 0x7fc2d00c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 -- 172.21.15.16:0/720365515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d0160040 con 0x7fc2d00d3090 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d510c640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d3090 0x7fc2d015f910 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4000c00 tx=0x7fc2c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2ce7fc640 1 -- 172.21.15.16:0/720365515 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4041070 con 0x7fc2d00d3090 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2ce7fc640 1 -- 172.21.15.16:0/720365515 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c403c870 con 0x7fc2d00d3090 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d0160320 con 0x7fc2d00d3090 2024-05-11T01:16:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2ce7fc640 1 -- 172.21.15.16:0/720365515 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4037040 con 0x7fc2d00d3090 2024-05-11T01:16:13.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.759+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d01608e0 con 0x7fc2d00d3090 2024-05-11T01:16:13.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.760+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d0160dd0 con 0x7fc2d00d3090 2024-05-11T01:16:13.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.761+0000 7fc2ce7fc640 1 -- 172.21.15.16:0/720365515 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fc2c4044070 con 0x7fc2d00d3090 2024-05-11T01:16:13.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.762+0000 7fc2ce7fc640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc2bc0762d0 0x7fc2bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:13.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.762+0000 7fc2ce7fc640 1 -- 172.21.15.16:0/720365515 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7fc2c40b8280 con 0x7fc2d00d3090 2024-05-11T01:16:13.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.762+0000 7fc2d590d640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc2bc0762d0 0x7fc2bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:13.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.762+0000 7fc2d590d640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc2bc0762d0 0x7fc2bc078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800aa40 tx=0x7fc2c8008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:13.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.766+0000 7fc2ce7fc640 1 -- 172.21.15.16:0/720365515 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc2c4081470 con 0x7fc2d00d3090 2024-05-11T01:16:13.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.957+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fc2d01f59f0 con 0x7fc2bc0762d0 2024-05-11T01:16:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.957+0000 7fc2ce7fc640 1 -- 172.21.15.16:0/720365515 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc2c800f980 con 0x7fc2bc0762d0 2024-05-11T01:16:13.958 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc2bc0762d0 msgr2=0x7fc2bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc2bc0762d0 0x7fc2bc078790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800aa40 tx=0x7fc2c8008040 comp rx=0 tx=0).stop 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d3090 msgr2=0x7fc2d015f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d3090 0x7fc2d015f910 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4000c00 tx=0x7fc2c40046c0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 shutdown_connections 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fc2d015f530 0x7fc2d0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2d00d3090 0x7fc2d015f910 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fc2bc0762d0 0x7fc2bc078790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 --2- 172.21.15.16:0/720365515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2d00d2a20 0x7fc2d00c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 >> 172.21.15.16:0/720365515 conn(0x7fc2d00681c0 msgr2=0x7fc2d00d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 shutdown_connections 2024-05-11T01:16:13.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:13.959+0000 7fc2d7b71640 1 -- 172.21.15.16:0/720365515 wait complete. 2024-05-11T01:16:13.970 INFO:tasks.ceph:Scrubbing osd.2 2024-05-11T01:16:13.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-11T01:16:14.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.078+0000 7f245b883640 1 Processor -- start 2024-05-11T01:16:14.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.078+0000 7f245b883640 1 -- start start 2024-05-11T01:16:14.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f245b883640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24540b7490 0x7f24540baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f245b883640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24540b92d0 con 0x7f24540d4eb0 2024-05-11T01:16:14.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f245b883640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24540d3e10 con 0x7f245415f6a0 2024-05-11T01:16:14.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f245b883640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f24540d40f0 con 0x7f24540b7490 2024-05-11T01:16:14.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2458e1e640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f24540d4eb0 0x7f24540b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57080/0 (socket says 172.21.15.16:57080) 2024-05-11T01:16:14.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2458e1e640 1 -- 172.21.15.16:0/1562652925 learned_addr learned my addr 172.21.15.16:0/1562652925 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:14.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2459e20640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24540b7490 0x7f24540baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 917601887 0 0) 0x7f24540b92d0 con 0x7f24540d4eb0 2024-05-11T01:16:14.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2440003520 con 0x7f24540d4eb0 2024-05-11T01:16:14.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2950883396 0 0) 0x7f2440003520 con 0x7f24540d4eb0 2024-05-11T01:16:14.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24540b7490 msgr2=0x7f24540baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:14.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24540b7490 0x7f24540baf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 >> v1:172.21.15.174:6789/0 conn(0x7f245415f6a0 legacy=0x7f24540d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24540d43d0 con 0x7f24540d4eb0 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2301589767 0 0) 0x7f24500016f0 con 0x7f24540d4eb0 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 >> v1:172.21.15.16:6789/0 conn(0x7f24540d4eb0 legacy=0x7f24540b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.079+0000 7f2447fff640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2440003a30 0x7f2440003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f2447fff640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24540b7490 0x7f2440004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f2447fff640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440004d40 0x7f24400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24540d40f0 con 0x7f2440003a30 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f244000bbb0 con 0x7f2440004d40 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f244000bdb0 con 0x7f24540b7490 2024-05-11T01:16:14.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f245961f640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2440003a30 0x7f2440003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f2458e1e640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24540b7490 0x7f2440004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f2459e20640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440004d40 0x7f24400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f245961f640 1 -- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24540b7490 msgr2=0x7f2440004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f245961f640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f24540b7490 0x7f2440004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f245961f640 1 -- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440004d40 msgr2=0x7f24400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f245961f640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440004d40 0x7f24400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f245961f640 1 -- 172.21.15.16:0/1562652925 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2440003520 con 0x7f2440003a30 2024-05-11T01:16:14.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.080+0000 7f2459e20640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440004d40 0x7f24400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:14.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f245961f640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2440003a30 0x7f2440003e50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2448001790 tx=0x7f2440005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0893c7321c4c3a server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24480013b0 con 0x7f2440003a30 2024-05-11T01:16:14.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24480052d0 con 0x7f2440003a30 2024-05-11T01:16:14.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f2447fff640 1 -- 172.21.15.16:0/1562652925 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244802aa20 con 0x7f2440003a30 2024-05-11T01:16:14.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f245b883640 1 -- 172.21.15.16:0/1562652925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2440003a30 msgr2=0x7f2440003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f245b883640 1 --2- 172.21.15.16:0/1562652925 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2440003a30 0x7f2440003e50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2448001790 tx=0x7f2440005830 comp rx=0 tx=0).stop 2024-05-11T01:16:14.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f2459e20640 1 -- 172.21.15.16:0/1562652925 reap_dead start 2024-05-11T01:16:14.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f245b883640 1 -- 172.21.15.16:0/1562652925 shutdown_connections 2024-05-11T01:16:14.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.081+0000 7f245b883640 1 -- 172.21.15.16:0/1562652925 >> 172.21.15.16:0/1562652925 conn(0x7f2454074140 msgr2=0x7f24540d1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:14.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.082+0000 7f245b883640 1 -- 172.21.15.16:0/1562652925 shutdown_connections 2024-05-11T01:16:14.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.082+0000 7f245b883640 1 -- 172.21.15.16:0/1562652925 wait complete. 2024-05-11T01:16:14.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.083+0000 7f245b883640 1 Processor -- start 2024-05-11T01:16:14.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.083+0000 7f245b883640 1 -- start start 2024-05-11T01:16:14.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.083+0000 7f245b883640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440003a30 0x7f2454148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.083+0000 7f245b883640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2454155290 0x7f2454155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.083+0000 7f245b883640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2454157430 0x7f24541578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.083+0000 7f245b883640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f24540baf00 con 0x7f2454155290 2024-05-11T01:16:14.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.083+0000 7f245b883640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f24540d4990 con 0x7f2440003a30 2024-05-11T01:16:14.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.083+0000 7f245b883640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f24540bb080 con 0x7f2454157430 2024-05-11T01:16:14.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2454155290 0x7f2454155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2454155290 0x7f2454155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34894/0 (socket says 172.21.15.16:34894) 2024-05-11T01:16:14.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 -- 172.21.15.16:0/2765945951 learned_addr learned my addr 172.21.15.16:0/2765945951 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:14.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f245961f640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440003a30 0x7f2454148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2459e20640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2454157430 0x7f24541578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 -- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2454157430 msgr2=0x7f24541578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2454157430 0x7f24541578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 -- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440003a30 msgr2=0x7f2454148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2440003a30 0x7f2454148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 -- 172.21.15.16:0/2765945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2454158160 con 0x7f2454155290 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2458e1e640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2454155290 0x7f2454155710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f24500072c0 tx=0x7f2450007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450001720 con 0x7f2454155290 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2450018070 con 0x7f2454155290 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245000fc00 con 0x7f2454155290 2024-05-11T01:16:14.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2454158440 con 0x7f2454155290 2024-05-11T01:16:14.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.084+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2454160fc0 con 0x7f2454155290 2024-05-11T01:16:14.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.085+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f24541485d0 con 0x7f2454155290 2024-05-11T01:16:14.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.086+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f245001d460 con 0x7f2454155290 2024-05-11T01:16:14.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.086+0000 7f2445ffb640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2438076470 0x7f2438078930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.086+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f2450097800 con 0x7f2454155290 2024-05-11T01:16:14.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.087+0000 7f2445ffb640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f243807eac0 0x7f2438080ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.087+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 --> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2450001720 con 0x7f243807eac0 2024-05-11T01:16:14.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.087+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f245009c2c0 con 0x7f2454155290 2024-05-11T01:16:14.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.087+0000 7f245961f640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2438076470 0x7f2438078930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.087+0000 7f2459e20640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f243807eac0 0x7f2438080ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.087+0000 7f2459e20640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f243807eac0 0x7f2438080ed0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.087+0000 7f245961f640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2438076470 0x7f2438078930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2448032000 tx=0x7f244802e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.088+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 <== osd.2 v2:172.21.15.16:6808/800114890 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2450001720 con 0x7f243807eac0 2024-05-11T01:16:14.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.101+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 --> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2454158610 con 0x7f243807eac0 2024-05-11T01:16:14.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.101+0000 7f2445ffb640 1 -- 172.21.15.16:0/2765945951 <== osd.2 v2:172.21.15.16:6808/800114890 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2454158610 con 0x7f243807eac0 2024-05-11T01:16:14.102 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:16:14.102 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-11T01:16:14.102 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:16:14.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f243807eac0 msgr2=0x7f2438080ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.16:6808/800114890,v1:172.21.15.16:6810/800114890] conn(0x7f243807eac0 0x7f2438080ed0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2438076470 msgr2=0x7f2438078930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2438076470 0x7f2438078930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2448032000 tx=0x7f244802e000 comp rx=0 tx=0).stop 2024-05-11T01:16:14.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2454155290 msgr2=0x7f2454155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 --2- 172.21.15.16:0/2765945951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2454155290 0x7f2454155710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f24500072c0 tx=0x7f2450007780 comp rx=0 tx=0).stop 2024-05-11T01:16:14.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f2459e20640 1 -- 172.21.15.16:0/2765945951 reap_dead start 2024-05-11T01:16:14.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 shutdown_connections 2024-05-11T01:16:14.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 >> 172.21.15.16:0/2765945951 conn(0x7f2454074140 msgr2=0x7f245415e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:14.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 shutdown_connections 2024-05-11T01:16:14.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.102+0000 7f245b883640 1 -- 172.21.15.16:0/2765945951 wait complete. 2024-05-11T01:16:14.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-11T01:16:14.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.217+0000 7f2bf9f91640 1 Processor -- start 2024-05-11T01:16:14.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.217+0000 7f2bf9f91640 1 -- start start 2024-05-11T01:16:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf9f91640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2bf40b2f40 0x7f2bf4142440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf9f91640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf413f850 0x7f2bf413fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf9f91640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf4160470 con 0x7f2bf40b3320 2024-05-11T01:16:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf9f91640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf4160750 con 0x7f2bf40b2f40 2024-05-11T01:16:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf9f91640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf4160a30 con 0x7f2bf413f850 2024-05-11T01:16:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2bf40b2f40 0x7f2bf4142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2bf40b2f40 0x7f2bf4142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34898/0 (socket says 172.21.15.16:34898) 2024-05-11T01:16:14.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf37fe640 1 -- 172.21.15.16:0/1300143299 learned_addr learned my addr 172.21.15.16:0/1300143299 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:14.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.218+0000 7f2bf3fff640 1 --2- 172.21.15.16:0/1300143299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf413f850 0x7f2bf413fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.219+0000 7f2bf37fe640 1 -- 172.21.15.16:0/1300143299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf413f850 msgr2=0x7f2bf413fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:14.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.219+0000 7f2bf37fe640 1 --2- 172.21.15.16:0/1300143299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf413f850 0x7f2bf413fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.219+0000 7f2bf37fe640 1 -- 172.21.15.16:0/1300143299 >> v1:172.21.15.174:6789/0 conn(0x7f2bf40b3320 legacy=0x7f2bf415fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.219+0000 7f2bf37fe640 1 -- 172.21.15.16:0/1300143299 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf40738b0 con 0x7f2bf40b2f40 2024-05-11T01:16:14.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.219+0000 7f2bf37fe640 1 --2- 172.21.15.16:0/1300143299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf40b2f40 0x7f2bf4142440 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009870 tx=0x7f2be402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e750b71dab0cc66f server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.219+0000 7f2bf27fc640 1 -- 172.21.15.16:0/1300143299 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4037070 con 0x7f2bf40b2f40 2024-05-11T01:16:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf27fc640 1 -- 172.21.15.16:0/1300143299 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be4032440 con 0x7f2bf40b2f40 2024-05-11T01:16:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf27fc640 1 -- 172.21.15.16:0/1300143299 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4032810 con 0x7f2bf40b2f40 2024-05-11T01:16:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1300143299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf40b2f40 msgr2=0x7f2bf4142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1300143299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf40b2f40 0x7f2bf4142440 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009870 tx=0x7f2be402a270 comp rx=0 tx=0).stop 2024-05-11T01:16:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1300143299 shutdown_connections 2024-05-11T01:16:14.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1300143299 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf413f850 0x7f2bf413fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1300143299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf40b2f40 0x7f2bf4142440 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1300143299 >> 172.21.15.16:0/1300143299 conn(0x7f2bf406fd90 msgr2=0x7f2bf406c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:14.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1300143299 shutdown_connections 2024-05-11T01:16:14.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.220+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1300143299 wait complete. 2024-05-11T01:16:14.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.221+0000 7f2bf9f91640 1 Processor -- start 2024-05-11T01:16:14.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf9f91640 1 -- start start 2024-05-11T01:16:14.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf9f91640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf40b2f40 0x7f2bf41e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf9f91640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf40b3320 0x7f2bf413e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf9f91640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf413f850 0x7f2bf406e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf9f91640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4074160 con 0x7f2bf413f850 2024-05-11T01:16:14.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf9f91640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4073fe0 con 0x7f2bf40b3320 2024-05-11T01:16:14.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf9f91640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf40742e0 con 0x7f2bf40b2f40 2024-05-11T01:16:14.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf413f850 0x7f2bf406e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf413f850 0x7f2bf406e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34902/0 (socket says 172.21.15.16:34902) 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.222+0000 7f2bf3fff640 1 -- 172.21.15.16:0/1732968818 learned_addr learned my addr 172.21.15.16:0/1732968818 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf37fe640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf40b2f40 0x7f2bf41e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf2ffd640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf40b3320 0x7f2bf413e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf3fff640 1 -- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf40b2f40 msgr2=0x7f2bf41e5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf3fff640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf40b2f40 0x7f2bf41e5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf3fff640 1 -- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf40b3320 msgr2=0x7f2bf413e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf3fff640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf40b3320 0x7f2bf413e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf3fff640 1 -- 172.21.15.16:0/1732968818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf41f9820 con 0x7f2bf413f850 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf3fff640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf413f850 0x7f2bf406e2b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00efc0 tx=0x7f2bec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bdbfff640 1 -- 172.21.15.16:0/1732968818 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec018020 con 0x7f2bf413f850 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bdbfff640 1 -- 172.21.15.16:0/1732968818 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec014480 con 0x7f2bf413f850 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf413ee90 con 0x7f2bf413f850 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bdbfff640 1 -- 172.21.15.16:0/1732968818 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec014870 con 0x7f2bf413f850 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.223+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf41f8f80 con 0x7f2bf413f850 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.224+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf406a5b0 con 0x7f2bf413f850 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.225+0000 7f2bdbfff640 1 -- 172.21.15.16:0/1732968818 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f2bec005d10 con 0x7f2bf413f850 2024-05-11T01:16:14.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.225+0000 7f2bdbfff640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2be00762d0 0x7f2be0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.225+0000 7f2bdbfff640 1 -- 172.21.15.16:0/1732968818 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f2bec098380 con 0x7f2bf413f850 2024-05-11T01:16:14.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.225+0000 7f2bf37fe640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2be00762d0 0x7f2be0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.226+0000 7f2bf37fe640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2be00762d0 0x7f2be0078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2be4034000 tx=0x7f2be402e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.229+0000 7f2bdbfff640 1 -- 172.21.15.16:0/1732968818 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2bec022030 con 0x7f2bf413f850 2024-05-11T01:16:14.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.418+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2bf4073480 con 0x7f2be00762d0 2024-05-11T01:16:14.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.418+0000 7f2bdbfff640 1 -- 172.21.15.16:0/1732968818 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2bf4073480 con 0x7f2be00762d0 2024-05-11T01:16:14.419 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-05-11T01:16:14.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.420+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2be00762d0 msgr2=0x7f2be0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.420+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2be00762d0 0x7f2be0078790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2be4034000 tx=0x7f2be402e000 comp rx=0 tx=0).stop 2024-05-11T01:16:14.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.420+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf413f850 msgr2=0x7f2bf406e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.420+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf413f850 0x7f2bf406e2b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00efc0 tx=0x7f2bec00c490 comp rx=0 tx=0).stop 2024-05-11T01:16:14.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.421+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 shutdown_connections 2024-05-11T01:16:14.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.421+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bf413f850 0x7f2bf406e2b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.421+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f2be00762d0 0x7f2be0078790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.421+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf40b3320 0x7f2bf413e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.421+0000 7f2bf9f91640 1 --2- 172.21.15.16:0/1732968818 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f2bf40b2f40 0x7f2bf41e5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.421+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 >> 172.21.15.16:0/1732968818 conn(0x7f2bf406fd90 msgr2=0x7f2bf40d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:14.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.421+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 shutdown_connections 2024-05-11T01:16:14.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.421+0000 7f2bf9f91640 1 -- 172.21.15.16:0/1732968818 wait complete. 2024-05-11T01:16:14.432 INFO:tasks.ceph:Scrubbing osd.3 2024-05-11T01:16:14.432 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-11T01:16:14.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.539+0000 7f7c4646b640 1 Processor -- start 2024-05-11T01:16:14.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.539+0000 7f7c4646b640 1 -- start start 2024-05-11T01:16:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.540+0000 7f7c4646b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c4015f690 0x7f7c400d3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.540+0000 7f7c4646b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c400d29d0 0x7f7c400b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.540+0000 7f7c4646b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4015fa70 con 0x7f7c400bacf0 2024-05-11T01:16:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.540+0000 7f7c4646b640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f7c400d50e0 con 0x7f7c400d29d0 2024-05-11T01:16:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.540+0000 7f7c4646b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7c400d4040 con 0x7f7c4015f690 2024-05-11T01:16:14.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c4015f690 0x7f7c400d3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c44a08640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7c400d29d0 0x7f7c400b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c4015f690 0x7f7c400d3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3301/0 says I am v2:172.21.15.16:44870/0 (socket says 172.21.15.16:44870) 2024-05-11T01:16:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c3ffff640 1 -- 172.21.15.16:0/4148391455 learned_addr learned my addr 172.21.15.16:0/4148391455 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:14.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c37fff640 1 --1- 172.21.15.16:0/4148391455 >> v1:172.21.15.174:6789/0 conn(0x7f7c400bacf0 0x7f7c400d22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.16:54254/0 (socket says 172.21.15.16:54254) 2024-05-11T01:16:14.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c3ffff640 1 -- 172.21.15.16:0/4148391455 >> v2:172.21.15.174:3300/0 conn(0x7f7c400d29d0 msgr2=0x7f7c400b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:14.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c3ffff640 1 --2- 172.21.15.16:0/4148391455 >> v2:172.21.15.174:3300/0 conn(0x7f7c400d29d0 0x7f7c400b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c3ffff640 1 -- 172.21.15.16:0/4148391455 >> v1:172.21.15.174:6789/0 conn(0x7f7c400bacf0 legacy=0x7f7c400d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c3ffff640 1 -- 172.21.15.16:0/4148391455 --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c400d4320 con 0x7f7c4015f690 2024-05-11T01:16:14.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.541+0000 7f7c44a08640 1 --2- 172.21.15.16:0/4148391455 >> v2:172.21.15.174:3300/0 conn(0x7f7c400d29d0 0x7f7c400b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.542+0000 7f7c3ffff640 1 --2- 172.21.15.16:0/4148391455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c4015f690 0x7f7c400d3740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009870 tx=0x7f7c3002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab0dbba7793c6b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.542+0000 7f7c3f7fe640 1 -- 172.21.15.16:0/4148391455 <== mon.2 v2:172.21.15.174:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30037070 con 0x7f7c4015f690 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.542+0000 7f7c3f7fe640 1 -- 172.21.15.16:0/4148391455 <== mon.2 v2:172.21.15.174:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c30032440 con 0x7f7c4015f690 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.542+0000 7f7c3f7fe640 1 -- 172.21.15.16:0/4148391455 <== mon.2 v2:172.21.15.174:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30032810 con 0x7f7c4015f690 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.543+0000 7f7c4646b640 1 -- 172.21.15.16:0/4148391455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c4015f690 msgr2=0x7f7c400d3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.543+0000 7f7c4646b640 1 --2- 172.21.15.16:0/4148391455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c4015f690 0x7f7c400d3740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009870 tx=0x7f7c3002a1c0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.543+0000 7f7c4646b640 1 -- 172.21.15.16:0/4148391455 shutdown_connections 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.543+0000 7f7c4646b640 1 --2- 172.21.15.16:0/4148391455 >> v2:172.21.15.174:3300/0 conn(0x7f7c400d29d0 0x7f7c400b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.543+0000 7f7c4646b640 1 --2- 172.21.15.16:0/4148391455 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c4015f690 0x7f7c400d3740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.543+0000 7f7c4646b640 1 -- 172.21.15.16:0/4148391455 >> 172.21.15.16:0/4148391455 conn(0x7f7c40073f60 msgr2=0x7f7c40074370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.543+0000 7f7c4646b640 1 -- 172.21.15.16:0/4148391455 shutdown_connections 2024-05-11T01:16:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.543+0000 7f7c4646b640 1 -- 172.21.15.16:0/4148391455 wait complete. 2024-05-11T01:16:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.544+0000 7f7c4646b640 1 Processor -- start 2024-05-11T01:16:14.546 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.544+0000 7f7c4646b640 1 -- start start 2024-05-11T01:16:14.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c4646b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c400bacf0 0x7f7c400abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c4646b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c400d29d0 0x7f7c401f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c4646b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4015f690 0x7f7c401f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c4646b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7c400d4bc0 con 0x7f7c400d29d0 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c4646b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7c400d48e0 con 0x7f7c4015f690 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c4646b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7c400d3c80 con 0x7f7c400bacf0 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c37fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c400d29d0 0x7f7c401f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c37fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c400d29d0 0x7f7c401f83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34908/0 (socket says 172.21.15.16:34908) 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c3ffff640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c400bacf0 0x7f7c400abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c37fff640 1 -- 172.21.15.16:0/1936074861 learned_addr learned my addr 172.21.15.16:0/1936074861 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c44a08640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4015f690 0x7f7c401f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c37fff640 1 -- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c400bacf0 msgr2=0x7f7c400abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.551 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c37fff640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7c400bacf0 0x7f7c400abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c37fff640 1 -- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4015f690 msgr2=0x7f7c401f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c37fff640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c4015f690 0x7f7c401f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.545+0000 7f7c37fff640 1 -- 172.21.15.16:0/1936074861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c400ce240 con 0x7f7c400d29d0 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.546+0000 7f7c37fff640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c400d29d0 0x7f7c401f83b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c450 tx=0x7f7c2800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.546+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c280074e0 con 0x7f7c400d29d0 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.546+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c28007680 con 0x7f7c400d29d0 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.546+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c400ce520 con 0x7f7c400d29d0 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.546+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c280049e0 con 0x7f7c400d29d0 2024-05-11T01:16:14.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.546+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c400cdd70 con 0x7f7c400d29d0 2024-05-11T01:16:14.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.546+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c400ce910 con 0x7f7c400d29d0 2024-05-11T01:16:14.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.547+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f7c2801a020 con 0x7f7c400d29d0 2024-05-11T01:16:14.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.548+0000 7f7c3d7fa640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f7c200762d0 0x7f7c20078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.548+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f7c280978f0 con 0x7f7c400d29d0 2024-05-11T01:16:14.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.548+0000 7f7c3d7fa640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7f7c2007e920 0x7f7c20080d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.548+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 --> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c20081360 con 0x7f7c2007e920 2024-05-11T01:16:14.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.548+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f7c28097d80 con 0x7f7c400d29d0 2024-05-11T01:16:14.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.548+0000 7f7c3ffff640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f7c200762d0 0x7f7c20078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.548+0000 7f7c44a08640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7f7c2007e920 0x7f7c20080d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.549+0000 7f7c44a08640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7f7c2007e920 0x7f7c20080d30 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.549+0000 7f7c3ffff640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f7c200762d0 0x7f7c20078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c30034000 tx=0x7f7c3002e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.549+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 <== osd.3 v2:172.21.15.16:6824/142472944 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c20081360 con 0x7f7c2007e920 2024-05-11T01:16:14.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.562+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 --> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7c400ac500 con 0x7f7c2007e920 2024-05-11T01:16:14.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c3d7fa640 1 -- 172.21.15.16:0/1936074861 <== osd.3 v2:172.21.15.16:6824/142472944 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7c400ac500 con 0x7f7c2007e920 2024-05-11T01:16:14.563 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:16:14.563 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-11T01:16:14.563 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:16:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7f7c2007e920 msgr2=0x7f7c20080d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.16:6824/142472944,v1:172.21.15.16:6825/142472944] conn(0x7f7c2007e920 0x7f7c20080d30 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f7c200762d0 msgr2=0x7f7c20078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f7c200762d0 0x7f7c20078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c30034000 tx=0x7f7c3002e000 comp rx=0 tx=0).stop 2024-05-11T01:16:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c400d29d0 msgr2=0x7f7c401f83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 --2- 172.21.15.16:0/1936074861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c400d29d0 0x7f7c401f83b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800c450 tx=0x7f7c2800c850 comp rx=0 tx=0).stop 2024-05-11T01:16:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c44a08640 1 -- 172.21.15.16:0/1936074861 reap_dead start 2024-05-11T01:16:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 shutdown_connections 2024-05-11T01:16:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 >> 172.21.15.16:0/1936074861 conn(0x7f7c40073f60 msgr2=0x7f7c40160450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 shutdown_connections 2024-05-11T01:16:14.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.563+0000 7f7c4646b640 1 -- 172.21.15.16:0/1936074861 wait complete. 2024-05-11T01:16:14.574 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-11T01:16:14.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.678+0000 7f3b1947e640 1 Processor -- start 2024-05-11T01:16:14.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.678+0000 7f3b1947e640 1 -- start start 2024-05-11T01:16:14.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.679+0000 7f3b1947e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3b141402f0 0x7f3b140b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.679+0000 7f3b1947e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b14160f90 con 0x7f3b140cfa80 2024-05-11T01:16:14.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.679+0000 7f3b1947e640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b14161270 con 0x7f3b140b3210 2024-05-11T01:16:14.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.679+0000 7f3b1947e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3b14161550 con 0x7f3b141402f0 2024-05-11T01:16:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.679+0000 7f3b12ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3b141402f0 0x7f3b140b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.679+0000 7f3b127fc640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3b140cfa80 0x7f3b140cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57084/0 (socket says 172.21.15.16:57084) 2024-05-11T01:16:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.679+0000 7f3b127fc640 1 -- 172.21.15.16:0/1443093093 learned_addr learned my addr 172.21.15.16:0/1443093093 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.679+0000 7f3b12ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3b141402f0 0x7f3b140b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34918/0 (socket says 172.21.15.16:34918) 2024-05-11T01:16:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.680+0000 7f3b12ffd640 1 -- 172.21.15.16:0/1443093093 >> v1:172.21.15.174:6789/0 conn(0x7f3b140b3210 legacy=0x7f3b1415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.680+0000 7f3b12ffd640 1 -- 172.21.15.16:0/1443093093 >> v1:172.21.15.16:6789/0 conn(0x7f3b140cfa80 legacy=0x7f3b140cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.680+0000 7f3b12ffd640 1 -- 172.21.15.16:0/1443093093 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b14161830 con 0x7f3b141402f0 2024-05-11T01:16:14.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.680+0000 7f3b11ffb640 1 -- 172.21.15.16:0/1443093093 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829427809 0 0) 0x7f3b14160f90 con 0x7f3b140cfa80 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.680+0000 7f3b12ffd640 1 --2- 172.21.15.16:0/1443093093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b141402f0 0x7f3b140b2cd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0097a0 tx=0x7f3b0c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508d459c13764c51 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.680+0000 7f3b11ffb640 1 -- 172.21.15.16:0/1443093093 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c037070 con 0x7f3b141402f0 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.680+0000 7f3b11ffb640 1 -- 172.21.15.16:0/1443093093 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0c02ae50 con 0x7f3b141402f0 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.681+0000 7f3b11ffb640 1 -- 172.21.15.16:0/1443093093 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c032660 con 0x7f3b141402f0 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.681+0000 7f3b1947e640 1 -- 172.21.15.16:0/1443093093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b141402f0 msgr2=0x7f3b140b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.681+0000 7f3b1947e640 1 --2- 172.21.15.16:0/1443093093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b141402f0 0x7f3b140b2cd0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0097a0 tx=0x7f3b0c02a100 comp rx=0 tx=0).stop 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.681+0000 7f3b1947e640 1 -- 172.21.15.16:0/1443093093 shutdown_connections 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.681+0000 7f3b1947e640 1 --2- 172.21.15.16:0/1443093093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b141402f0 0x7f3b140b2cd0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.681+0000 7f3b1947e640 1 -- 172.21.15.16:0/1443093093 >> 172.21.15.16:0/1443093093 conn(0x7f3b1406fd90 msgr2=0x7f3b1406c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:14.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.681+0000 7f3b1947e640 1 -- 172.21.15.16:0/1443093093 shutdown_connections 2024-05-11T01:16:14.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.681+0000 7f3b1947e640 1 -- 172.21.15.16:0/1443093093 wait complete. 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.682+0000 7f3b1947e640 1 Processor -- start 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.682+0000 7f3b1947e640 1 -- start start 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b1947e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b140b3210 0x7f3b140723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b1947e640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140cfa80 0x7f3b140aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b1947e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b141402f0 0x7f3b1413db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b1947e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3b140ce550 con 0x7f3b140b3210 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b1947e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3b140ce3d0 con 0x7f3b141402f0 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b1947e640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1415e0a0 con 0x7f3b140cfa80 2024-05-11T01:16:14.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b12ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b140b3210 0x7f3b140723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b12ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b140b3210 0x7f3b140723a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34924/0 (socket says 172.21.15.16:34924) 2024-05-11T01:16:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.683+0000 7f3b12ffd640 1 -- 172.21.15.16:0/1488730489 learned_addr learned my addr 172.21.15.16:0/1488730489 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b127fc640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140cfa80 0x7f3b140aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b137fe640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b141402f0 0x7f3b1413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b12ffd640 1 -- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140cfa80 msgr2=0x7f3b140aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b12ffd640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140cfa80 0x7f3b140aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b12ffd640 1 -- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b141402f0 msgr2=0x7f3b1413db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b12ffd640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b141402f0 0x7f3b1413db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b12ffd640 1 -- 172.21.15.16:0/1488730489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1415a5a0 con 0x7f3b140b3210 2024-05-11T01:16:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b12ffd640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b140b3210 0x7f3b140723a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c000c00 tx=0x7f3b0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b0b7fe640 1 -- 172.21.15.16:0/1488730489 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c037040 con 0x7f3b140b3210 2024-05-11T01:16:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b0b7fe640 1 -- 172.21.15.16:0/1488730489 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0c004030 con 0x7f3b140b3210 2024-05-11T01:16:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b0b7fe640 1 -- 172.21.15.16:0/1488730489 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c006e10 con 0x7f3b140b3210 2024-05-11T01:16:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1415a880 con 0x7f3b140b3210 2024-05-11T01:16:14.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.684+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1415ae40 con 0x7f3b140b3210 2024-05-11T01:16:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.685+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1406a5b0 con 0x7f3b140b3210 2024-05-11T01:16:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.686+0000 7f3b0b7fe640 1 -- 172.21.15.16:0/1488730489 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f3b0c03d650 con 0x7f3b140b3210 2024-05-11T01:16:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.686+0000 7f3b0b7fe640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3af40762d0 0x7f3af4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.686+0000 7f3b0b7fe640 1 -- 172.21.15.16:0/1488730489 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f3b0c0b7d80 con 0x7f3b140b3210 2024-05-11T01:16:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.686+0000 7f3b127fc640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3af40762d0 0x7f3af4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:14.690 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.687+0000 7f3b127fc640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3af40762d0 0x7f3af4078790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b140afea0 tx=0x7f3afc007b10 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:14.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.690+0000 7f3b0b7fe640 1 -- 172.21.15.16:0/1488730489 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3b0c042020 con 0x7f3b140b3210 2024-05-11T01:16:14.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.884+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3b1406d0b0 con 0x7f3af40762d0 2024-05-11T01:16:14.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.885+0000 7f3b0b7fe640 1 -- 172.21.15.16:0/1488730489 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3b1406d0b0 con 0x7f3af40762d0 2024-05-11T01:16:14.885 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-05-11T01:16:14.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3af40762d0 msgr2=0x7f3af4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3af40762d0 0x7f3af4078790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b140afea0 tx=0x7f3afc007b10 comp rx=0 tx=0).stop 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b140b3210 msgr2=0x7f3b140723a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b140b3210 0x7f3b140723a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c000c00 tx=0x7f3b0c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 shutdown_connections 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f3af40762d0 0x7f3af4078790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3b141402f0 0x7f3b1413db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f3b140cfa80 0x7f3b140aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 --2- 172.21.15.16:0/1488730489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b140b3210 0x7f3b140723a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:14.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 >> 172.21.15.16:0/1488730489 conn(0x7f3b1406fd90 msgr2=0x7f3b14075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:14.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 shutdown_connections 2024-05-11T01:16:14.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:14.887+0000 7f3b1947e640 1 -- 172.21.15.16:0/1488730489 wait complete. 2024-05-11T01:16:14.898 INFO:tasks.ceph:Scrubbing osd.4 2024-05-11T01:16:14.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-11T01:16:15.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.006+0000 7f6826c7b640 1 Processor -- start 2024-05-11T01:16:15.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.006+0000 7f6826c7b640 1 -- start start 2024-05-11T01:16:15.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6826c7b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 0x7f68200d3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6826c7b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68200d29d0 0x7f68200b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6826c7b640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f682015fa70 con 0x7f68200bacf0 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6826c7b640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f68200d50e0 con 0x7f68200d29d0 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6826c7b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f68200d4040 con 0x7f682015f690 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6825218640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68200d29d0 0x7f68200b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6825218640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68200d29d0 0x7f68200b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34938/0 (socket says 172.21.15.16:34938) 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6825218640 1 -- 172.21.15.16:0/1360813820 learned_addr learned my addr 172.21.15.16:0/1360813820 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6824a17640 1 --2- 172.21.15.16:0/1360813820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 0x7f68200d3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6825218640 1 -- 172.21.15.16:0/1360813820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 msgr2=0x7f68200d3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.007+0000 7f6825218640 1 --2- 172.21.15.16:0/1360813820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 0x7f68200d3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.008+0000 7f6825218640 1 -- 172.21.15.16:0/1360813820 >> v1:172.21.15.174:6789/0 conn(0x7f68200bacf0 legacy=0x7f68200d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:15.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.008+0000 7f6825218640 1 -- 172.21.15.16:0/1360813820 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68200d4320 con 0x7f68200d29d0 2024-05-11T01:16:15.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.008+0000 7f6825218640 1 --2- 172.21.15.16:0/1360813820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 0x7f68200b8490 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6818009e50 tx=0x7f681802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb06347cbcaaf6c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.008+0000 7f681f7fe640 1 -- 172.21.15.16:0/1360813820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6818036070 con 0x7f68200d29d0 2024-05-11T01:16:15.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.008+0000 7f681f7fe640 1 -- 172.21.15.16:0/1360813820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6818031600 con 0x7f68200d29d0 2024-05-11T01:16:15.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.008+0000 7f681f7fe640 1 -- 172.21.15.16:0/1360813820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68180319d0 con 0x7f68200d29d0 2024-05-11T01:16:15.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.009+0000 7f6826c7b640 1 -- 172.21.15.16:0/1360813820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 msgr2=0x7f68200b8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.009+0000 7f6826c7b640 1 --2- 172.21.15.16:0/1360813820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 0x7f68200b8490 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6818009e50 tx=0x7f681802a680 comp rx=0 tx=0).stop 2024-05-11T01:16:15.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.009+0000 7f6826c7b640 1 -- 172.21.15.16:0/1360813820 shutdown_connections 2024-05-11T01:16:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.009+0000 7f6826c7b640 1 --2- 172.21.15.16:0/1360813820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 0x7f68200b8490 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.009+0000 7f6826c7b640 1 --2- 172.21.15.16:0/1360813820 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 0x7f68200d3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.009+0000 7f6826c7b640 1 -- 172.21.15.16:0/1360813820 >> 172.21.15.16:0/1360813820 conn(0x7f6820073f60 msgr2=0x7f6820074370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.009+0000 7f6826c7b640 1 -- 172.21.15.16:0/1360813820 shutdown_connections 2024-05-11T01:16:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.009+0000 7f6826c7b640 1 -- 172.21.15.16:0/1360813820 wait complete. 2024-05-11T01:16:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.010+0000 7f6826c7b640 1 Processor -- start 2024-05-11T01:16:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.010+0000 7f6826c7b640 1 -- start start 2024-05-11T01:16:15.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f6826c7b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68200bacf0 0x7f682014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f6826c7b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 0x7f68200ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f6826c7b640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 0x7f68200cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f6826c7b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f68200d4bc0 con 0x7f68200d29d0 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f6826c7b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f68200d48e0 con 0x7f68200bacf0 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f6826c7b640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f68200d3c80 con 0x7f682015f690 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f681ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 0x7f68200ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f681ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 0x7f68200ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34940/0 (socket says 172.21.15.16:34940) 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f681ffff640 1 -- 172.21.15.16:0/3381157428 learned_addr learned my addr 172.21.15.16:0/3381157428 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f6825218640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 0x7f68200cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.011+0000 7f6824a17640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68200bacf0 0x7f682014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681ffff640 1 -- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 msgr2=0x7f68200cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681ffff640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f682015f690 0x7f68200cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681ffff640 1 -- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68200bacf0 msgr2=0x7f682014b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681ffff640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68200bacf0 0x7f682014b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681ffff640 1 -- 172.21.15.16:0/3381157428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6820155580 con 0x7f68200d29d0 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681ffff640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 0x7f68200ce940 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f681400c450 tx=0x7f681400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68140052d0 con 0x7f68200d29d0 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6814005470 con 0x7f68200d29d0 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814012870 con 0x7f68200d29d0 2024-05-11T01:16:15.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6820155840 con 0x7f68200d29d0 2024-05-11T01:16:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.012+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68200b4ab0 con 0x7f68200d29d0 2024-05-11T01:16:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.013+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f682006a5b0 con 0x7f68200d29d0 2024-05-11T01:16:15.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.014+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f6814012a10 con 0x7f68200d29d0 2024-05-11T01:16:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.014+0000 7f681d7fa640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f680c0762d0 0x7f680c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.014+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f6814097220 con 0x7f68200d29d0 2024-05-11T01:16:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.014+0000 7f681d7fa640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7f680c07e930 0x7f680c080d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.014+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 --> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f681401de70 con 0x7f680c07e930 2024-05-11T01:16:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.014+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f681409e050 con 0x7f68200d29d0 2024-05-11T01:16:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.014+0000 7f6824a17640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f680c0762d0 0x7f680c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.015+0000 7f6825218640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7f680c07e930 0x7f680c080d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.015+0000 7f6824a17640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f680c0762d0 0x7f680c078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68100079a0 tx=0x7f6810008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.015+0000 7f6825218640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7f680c07e930 0x7f680c080d40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.016+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 <== osd.4 v2:172.21.15.174:6800/1586428458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f681401de70 con 0x7f680c07e930 2024-05-11T01:16:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.029+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 --> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f68200b4110 con 0x7f680c07e930 2024-05-11T01:16:15.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.029+0000 7f681d7fa640 1 -- 172.21.15.16:0/3381157428 <== osd.4 v2:172.21.15.174:6800/1586428458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f68200b4110 con 0x7f680c07e930 2024-05-11T01:16:15.030 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:16:15.030 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-11T01:16:15.030 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:16:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7f680c07e930 msgr2=0x7f680c080d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6800/1586428458,v1:172.21.15.174:6801/1586428458] conn(0x7f680c07e930 0x7f680c080d40 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f680c0762d0 msgr2=0x7f680c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f680c0762d0 0x7f680c078790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68100079a0 tx=0x7f6810008040 comp rx=0 tx=0).stop 2024-05-11T01:16:15.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 msgr2=0x7f68200ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 --2- 172.21.15.16:0/3381157428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68200d29d0 0x7f68200ce940 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f681400c450 tx=0x7f681400c910 comp rx=0 tx=0).stop 2024-05-11T01:16:15.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6825218640 1 -- 172.21.15.16:0/3381157428 reap_dead start 2024-05-11T01:16:15.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 shutdown_connections 2024-05-11T01:16:15.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 >> 172.21.15.16:0/3381157428 conn(0x7f6820073f60 msgr2=0x7f6820160040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 shutdown_connections 2024-05-11T01:16:15.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.030+0000 7f6826c7b640 1 -- 172.21.15.16:0/3381157428 wait complete. 2024-05-11T01:16:15.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-11T01:16:15.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.146+0000 7f283adf9640 1 Processor -- start 2024-05-11T01:16:15.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.146+0000 7f283adf9640 1 -- start start 2024-05-11T01:16:15.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.147+0000 7f283adf9640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f283415dc50 0x7f283415e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.147+0000 7f283adf9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2834164e10 0x7f2834167200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.147+0000 7f283adf9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28340b6850 con 0x7f283415d870 2024-05-11T01:16:15.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.147+0000 7f283adf9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f28340ce730 con 0x7f2834164e10 2024-05-11T01:16:15.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.147+0000 7f283adf9640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f28340cdb20 con 0x7f283415dc50 2024-05-11T01:16:15.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.147+0000 7f2839396640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2834164e10 0x7f2834167200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.147+0000 7f2838b95640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f283415d870 0x7f28340b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57096/0 (socket says 172.21.15.16:57096) 2024-05-11T01:16:15.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.147+0000 7f2838b95640 1 -- 172.21.15.16:0/1677674770 learned_addr learned my addr 172.21.15.16:0/1677674770 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:15.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.148+0000 7f2833fff640 1 --2- 172.21.15.16:0/1677674770 >> v2:172.21.15.174:3300/0 conn(0x7f283415dc50 0x7f283415e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.148+0000 7f2839396640 1 -- 172.21.15.16:0/1677674770 >> v2:172.21.15.174:3300/0 conn(0x7f283415dc50 msgr2=0x7f283415e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:15.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.148+0000 7f2839396640 1 --2- 172.21.15.16:0/1677674770 >> v2:172.21.15.174:3300/0 conn(0x7f283415dc50 0x7f283415e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.148+0000 7f2839396640 1 -- 172.21.15.16:0/1677674770 >> v1:172.21.15.16:6789/0 conn(0x7f283415d870 legacy=0x7f28340b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.148+0000 7f28337fe640 1 -- 172.21.15.16:0/1677674770 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350065705 0 0) 0x7f28340b6850 con 0x7f283415d870 2024-05-11T01:16:15.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.148+0000 7f2839396640 1 -- 172.21.15.16:0/1677674770 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28340cde00 con 0x7f2834164e10 2024-05-11T01:16:15.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.148+0000 7f2833fff640 1 --2- 172.21.15.16:0/1677674770 >> v2:172.21.15.174:3300/0 conn(0x7f283415dc50 0x7f283415e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:15.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.148+0000 7f2839396640 1 --2- 172.21.15.16:0/1677674770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2834164e10 0x7f2834167200 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f283406e6b0 tx=0x7f282c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f033098f8f5fee server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f28337fe640 1 -- 172.21.15.16:0/1677674770 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c037070 con 0x7f2834164e10 2024-05-11T01:16:15.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f28337fe640 1 -- 172.21.15.16:0/1677674770 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c032440 con 0x7f2834164e10 2024-05-11T01:16:15.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f28337fe640 1 -- 172.21.15.16:0/1677674770 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c032810 con 0x7f2834164e10 2024-05-11T01:16:15.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f283adf9640 1 -- 172.21.15.16:0/1677674770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2834164e10 msgr2=0x7f2834167200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f283adf9640 1 --2- 172.21.15.16:0/1677674770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2834164e10 0x7f2834167200 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f283406e6b0 tx=0x7f282c02a1a0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f283adf9640 1 -- 172.21.15.16:0/1677674770 shutdown_connections 2024-05-11T01:16:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f283adf9640 1 --2- 172.21.15.16:0/1677674770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2834164e10 0x7f2834167200 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f283adf9640 1 --2- 172.21.15.16:0/1677674770 >> v2:172.21.15.174:3300/0 conn(0x7f283415dc50 0x7f283415e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f283adf9640 1 -- 172.21.15.16:0/1677674770 >> 172.21.15.16:0/1677674770 conn(0x7f28340d17a0 msgr2=0x7f28340d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f283adf9640 1 -- 172.21.15.16:0/1677674770 shutdown_connections 2024-05-11T01:16:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.149+0000 7f283adf9640 1 -- 172.21.15.16:0/1677674770 wait complete. 2024-05-11T01:16:15.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.150+0000 7f283adf9640 1 Processor -- start 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.150+0000 7f283adf9640 1 -- start start 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f283adf9640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f283415d870 0x7f28341447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f283adf9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f283415dc50 0x7f2834145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f283adf9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2834164e10 0x7f283415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f283adf9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f283415e610 con 0x7f283415dc50 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f283adf9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f28340ce3c0 con 0x7f2834164e10 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f283adf9640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f28340b5bc0 con 0x7f283415d870 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f2833fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f283415dc50 0x7f2834145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f2833fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f283415dc50 0x7f2834145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34960/0 (socket says 172.21.15.16:34960) 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.151+0000 7f2833fff640 1 -- 172.21.15.16:0/1841493651 learned_addr learned my addr 172.21.15.16:0/1841493651 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f2838b95640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f283415d870 0x7f28341447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f2839396640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2834164e10 0x7f283415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f2833fff640 1 -- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f283415d870 msgr2=0x7f28341447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f2833fff640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f283415d870 0x7f28341447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f2833fff640 1 -- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2834164e10 msgr2=0x7f283415f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f2833fff640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2834164e10 0x7f283415f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f2833fff640 1 -- 172.21.15.16:0/1841493651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283414e440 con 0x7f283415dc50 2024-05-11T01:16:15.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f2833fff640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f283415dc50 0x7f2834145110 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f281c00d7d0 tx=0x7f281c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f28317fa640 1 -- 172.21.15.16:0/1841493651 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c004030 con 0x7f283415dc50 2024-05-11T01:16:15.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f28317fa640 1 -- 172.21.15.16:0/1841493651 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c0041d0 con 0x7f283415dc50 2024-05-11T01:16:15.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283414e720 con 0x7f283415dc50 2024-05-11T01:16:15.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f28317fa640 1 -- 172.21.15.16:0/1841493651 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c00b6c0 con 0x7f283415dc50 2024-05-11T01:16:15.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.152+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2834144cf0 con 0x7f283415dc50 2024-05-11T01:16:15.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.153+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f283406a5b0 con 0x7f283415dc50 2024-05-11T01:16:15.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.154+0000 7f28317fa640 1 -- 172.21.15.16:0/1841493651 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f281c00b860 con 0x7f283415dc50 2024-05-11T01:16:15.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.154+0000 7f28317fa640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f28140762d0 0x7f2814078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.154+0000 7f28317fa640 1 -- 172.21.15.16:0/1841493651 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f281c097a00 con 0x7f283415dc50 2024-05-11T01:16:15.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.155+0000 7f2838b95640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f28140762d0 0x7f2814078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.155+0000 7f2838b95640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f28140762d0 0x7f2814078790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28240012e0 tx=0x7f2824009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.159+0000 7f28317fa640 1 -- 172.21.15.16:0/1841493651 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f281c061240 con 0x7f283415dc50 2024-05-11T01:16:15.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.349+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f283406cf10 con 0x7f28140762d0 2024-05-11T01:16:15.350 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.350+0000 7f28317fa640 1 -- 172.21.15.16:0/1841493651 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f283406cf10 con 0x7f28140762d0 2024-05-11T01:16:15.350 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-05-11T01:16:15.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f28140762d0 msgr2=0x7f2814078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f28140762d0 0x7f2814078790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f28240012e0 tx=0x7f2824009040 comp rx=0 tx=0).stop 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f283415dc50 msgr2=0x7f2834145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f283415dc50 0x7f2834145110 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f281c00d7d0 tx=0x7f281c00dc90 comp rx=0 tx=0).stop 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 shutdown_connections 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f28140762d0 0x7f2814078790 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2834164e10 0x7f283415f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f283415dc50 0x7f2834145110 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 --2- 172.21.15.16:0/1841493651 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f283415d870 0x7f28341447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 >> 172.21.15.16:0/1841493651 conn(0x7f28340d17a0 msgr2=0x7f28340d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 shutdown_connections 2024-05-11T01:16:15.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.352+0000 7f283adf9640 1 -- 172.21.15.16:0/1841493651 wait complete. 2024-05-11T01:16:15.363 INFO:tasks.ceph:Scrubbing osd.5 2024-05-11T01:16:15.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-11T01:16:15.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.471+0000 7f599c37f640 1 Processor -- start 2024-05-11T01:16:15.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.471+0000 7f599c37f640 1 -- start start 2024-05-11T01:16:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.472+0000 7f599c37f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f59940bac90 0x7f59940d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.472+0000 7f599c37f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59940d3a90 con 0x7f59940d5290 2024-05-11T01:16:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.472+0000 7f599c37f640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59940d3d70 con 0x7f599415f3d0 2024-05-11T01:16:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.472+0000 7f599c37f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f59940cfaa0 con 0x7f59940bac90 2024-05-11T01:16:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.472+0000 7f599991a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f59940bac90 0x7f59940d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.473+0000 7f599a91c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f59940d5290 0x7f59940b84a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57098/0 (socket says 172.21.15.16:57098) 2024-05-11T01:16:15.473 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.473+0000 7f599a91c640 1 -- 172.21.15.16:0/1139808019 learned_addr learned my addr 172.21.15.16:0/1139808019 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:15.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.473+0000 7f599991a640 1 -- 172.21.15.16:0/1139808019 >> v1:172.21.15.174:6789/0 conn(0x7f599415f3d0 legacy=0x7f59940d4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:15.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.473+0000 7f599991a640 1 -- 172.21.15.16:0/1139808019 >> v1:172.21.15.16:6789/0 conn(0x7f59940d5290 legacy=0x7f59940b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.473+0000 7f599991a640 1 -- 172.21.15.16:0/1139808019 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59940d4050 con 0x7f59940bac90 2024-05-11T01:16:15.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.473+0000 7f5999119640 1 -- 172.21.15.16:0/1139808019 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011351199 0 0) 0x7f59940d3a90 con 0x7f59940d5290 2024-05-11T01:16:15.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f599991a640 1 --2- 172.21.15.16:0/1139808019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 0x7f59940d33b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5988009790 tx=0x7f598802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcdde676a539f78 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f5999119640 1 -- 172.21.15.16:0/1139808019 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988037070 con 0x7f59940bac90 2024-05-11T01:16:15.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f5999119640 1 -- 172.21.15.16:0/1139808019 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598802ae50 con 0x7f59940bac90 2024-05-11T01:16:15.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f5999119640 1 -- 172.21.15.16:0/1139808019 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988032660 con 0x7f59940bac90 2024-05-11T01:16:15.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f599c37f640 1 -- 172.21.15.16:0/1139808019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 msgr2=0x7f59940d33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f599c37f640 1 --2- 172.21.15.16:0/1139808019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 0x7f59940d33b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5988009790 tx=0x7f598802a100 comp rx=0 tx=0).stop 2024-05-11T01:16:15.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f599c37f640 1 -- 172.21.15.16:0/1139808019 shutdown_connections 2024-05-11T01:16:15.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f599c37f640 1 --2- 172.21.15.16:0/1139808019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 0x7f59940d33b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f599c37f640 1 -- 172.21.15.16:0/1139808019 >> 172.21.15.16:0/1139808019 conn(0x7f5994073f30 msgr2=0x7f5994074340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f599c37f640 1 -- 172.21.15.16:0/1139808019 shutdown_connections 2024-05-11T01:16:15.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.474+0000 7f599c37f640 1 -- 172.21.15.16:0/1139808019 wait complete. 2024-05-11T01:16:15.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.475+0000 7f599c37f640 1 Processor -- start 2024-05-11T01:16:15.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599c37f640 1 -- start start 2024-05-11T01:16:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599c37f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 0x7f599414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599c37f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59940d5290 0x7f599414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599c37f640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f599415f3d0 0x7f59940c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599c37f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f599415f7b0 con 0x7f59940bac90 2024-05-11T01:16:15.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599c37f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f59940d4610 con 0x7f59940d5290 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599c37f640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f599415f930 con 0x7f599415f3d0 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599a11b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 0x7f599414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599a11b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 0x7f599414bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34970/0 (socket says 172.21.15.16:34970) 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.476+0000 7f599a11b640 1 -- 172.21.15.16:0/228448180 learned_addr learned my addr 172.21.15.16:0/228448180 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599991a640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59940d5290 0x7f599414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599a91c640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f599415f3d0 0x7f59940c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599a11b640 1 -- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f599415f3d0 msgr2=0x7f59940c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599a11b640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f599415f3d0 0x7f59940c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599a11b640 1 -- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59940d5290 msgr2=0x7f599414b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599a11b640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59940d5290 0x7f599414b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599a11b640 1 -- 172.21.15.16:0/228448180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59940cbca0 con 0x7f59940bac90 2024-05-11T01:16:15.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599991a640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59940d5290 0x7f599414b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:15.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599a11b640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 0x7f599414bf20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f598c00b3f0 tx=0x7f598c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c015020 con 0x7f59940bac90 2024-05-11T01:16:15.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c011830 con 0x7f59940bac90 2024-05-11T01:16:15.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59940cb9c0 con 0x7f59940bac90 2024-05-11T01:16:15.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c011c20 con 0x7f59940bac90 2024-05-11T01:16:15.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.477+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59940cd830 con 0x7f59940bac90 2024-05-11T01:16:15.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.478+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f599406a5b0 con 0x7f59940bac90 2024-05-11T01:16:15.482 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.479+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f598c018020 con 0x7f59940bac90 2024-05-11T01:16:15.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.479+0000 7f5992ffd640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f59800762d0 0x7f5980078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.480+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f598c097be0 con 0x7f59940bac90 2024-05-11T01:16:15.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.480+0000 7f5992ffd640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f598007e930 0x7f5980080d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.480+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 --> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5980081370 con 0x7f598007e930 2024-05-11T01:16:15.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.480+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f598c098070 con 0x7f59940bac90 2024-05-11T01:16:15.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.480+0000 7f599991a640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f59800762d0 0x7f5980078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.480+0000 7f599a91c640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f598007e930 0x7f5980080d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.480+0000 7f599991a640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f59800762d0 0x7f5980078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5988034000 tx=0x7f598802e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.480+0000 7f599a91c640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f598007e930 0x7f5980080d40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.481+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 <== osd.5 v2:172.21.15.174:6817/3546567206 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5980081370 con 0x7f598007e930 2024-05-11T01:16:15.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.494+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 --> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f599415be00 con 0x7f598007e930 2024-05-11T01:16:15.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f5992ffd640 1 -- 172.21.15.16:0/228448180 <== osd.5 v2:172.21.15.174:6817/3546567206 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f599415be00 con 0x7f598007e930 2024-05-11T01:16:15.495 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:16:15.495 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-11T01:16:15.495 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:16:15.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f598007e930 msgr2=0x7f5980080d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6817/3546567206,v1:172.21.15.174:6819/3546567206] conn(0x7f598007e930 0x7f5980080d40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f59800762d0 msgr2=0x7f5980078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f59800762d0 0x7f5980078790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5988034000 tx=0x7f598802e000 comp rx=0 tx=0).stop 2024-05-11T01:16:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 msgr2=0x7f599414bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 --2- 172.21.15.16:0/228448180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59940bac90 0x7f599414bf20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f598c00b3f0 tx=0x7f598c00b8b0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599a91c640 1 -- 172.21.15.16:0/228448180 reap_dead start 2024-05-11T01:16:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 shutdown_connections 2024-05-11T01:16:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 >> 172.21.15.16:0/228448180 conn(0x7f5994073f30 msgr2=0x7f59940cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 shutdown_connections 2024-05-11T01:16:15.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.495+0000 7f599c37f640 1 -- 172.21.15.16:0/228448180 wait complete. 2024-05-11T01:16:15.505 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-11T01:16:15.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.611+0000 7fb8c2f0a640 1 Processor -- start 2024-05-11T01:16:15.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.611+0000 7fb8c2f0a640 1 -- start start 2024-05-11T01:16:15.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c2f0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c2f0a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb8bc0d4990 0x7fb8bc06db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c2f0a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc163e90 con 0x7fb8bc0bac10 2024-05-11T01:16:15.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c2f0a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb8bc0cfad0 con 0x7fb8bc0d4990 2024-05-11T01:16:15.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c2f0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc0b7690 con 0x7fb8bc0b6d70 2024-05-11T01:16:15.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c14a7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb8bc0d4990 0x7fb8bc06db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8b3fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb8bc0bac10 0x7fb8bc06d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57108/0 (socket says 172.21.15.16:57108) 2024-05-11T01:16:15.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c14a7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb8bc0d4990 0x7fb8bc06db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34982/0 (socket says 172.21.15.16:34982) 2024-05-11T01:16:15.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8b3fff640 1 -- 172.21.15.16:0/1173112359 learned_addr learned my addr 172.21.15.16:0/1173112359 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:15.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c0ca6640 1 --2- 172.21.15.16:0/1173112359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c14a7640 1 -- 172.21.15.16:0/1173112359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 msgr2=0x7fb8bc0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:15.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c14a7640 1 --2- 172.21.15.16:0/1173112359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c14a7640 1 -- 172.21.15.16:0/1173112359 >> v1:172.21.15.16:6789/0 conn(0x7fb8bc0bac10 legacy=0x7fb8bc06d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8c14a7640 1 -- 172.21.15.16:0/1173112359 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc163310 con 0x7fb8bc0d4990 2024-05-11T01:16:15.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.612+0000 7fb8b37fe640 1 -- 172.21.15.16:0/1173112359 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140050674 0 0) 0x7fb8bc163e90 con 0x7fb8bc0bac10 2024-05-11T01:16:15.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.613+0000 7fb8c14a7640 1 --2- 172.21.15.16:0/1173112359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0d4990 0x7fb8bc06db20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009d90 tx=0x7fb8b402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185ebbde058542d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.613+0000 7fb8b37fe640 1 -- 172.21.15.16:0/1173112359 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4031600 con 0x7fb8bc0d4990 2024-05-11T01:16:15.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.613+0000 7fb8b37fe640 1 -- 172.21.15.16:0/1173112359 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b40317a0 con 0x7fb8bc0d4990 2024-05-11T01:16:15.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.613+0000 7fb8b37fe640 1 -- 172.21.15.16:0/1173112359 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4031b70 con 0x7fb8bc0d4990 2024-05-11T01:16:15.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.614+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/1173112359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0d4990 msgr2=0x7fb8bc06db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.614+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/1173112359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0d4990 0x7fb8bc06db20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009d90 tx=0x7fb8b402a5d0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.614+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/1173112359 shutdown_connections 2024-05-11T01:16:15.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.614+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/1173112359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0d4990 0x7fb8bc06db20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.614+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/1173112359 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.614+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/1173112359 >> 172.21.15.16:0/1173112359 conn(0x7fb8bc074140 msgr2=0x7fb8bc0d1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.614+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/1173112359 shutdown_connections 2024-05-11T01:16:15.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.614+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/1173112359 wait complete. 2024-05-11T01:16:15.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.615+0000 7fb8c2f0a640 1 Processor -- start 2024-05-11T01:16:15.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.615+0000 7fb8c2f0a640 1 -- start start 2024-05-11T01:16:15.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c2f0a640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c2f0a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0bac10 0x7fb8bc153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c2f0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8bc0d4990 0x7fb8bc15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c2f0a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc163bb0 con 0x7fb8bc0bac10 2024-05-11T01:16:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c2f0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1638d0 con 0x7fb8bc0d4990 2024-05-11T01:16:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c2f0a640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc15f830 con 0x7fb8bc0b6d70 2024-05-11T01:16:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8b3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0bac10 0x7fb8bc153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8b3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0bac10 0x7fb8bc153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34984/0 (socket says 172.21.15.16:34984) 2024-05-11T01:16:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8b3fff640 1 -- 172.21.15.16:0/986851544 learned_addr learned my addr 172.21.15.16:0/986851544 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c0ca6640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c14a7640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8bc0d4990 0x7fb8bc15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8b3fff640 1 -- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 msgr2=0x7fb8bc0cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8b3fff640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8b3fff640 1 -- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8bc0d4990 msgr2=0x7fb8bc15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8b3fff640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8bc0d4990 0x7fb8bc15faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8b3fff640 1 -- 172.21.15.16:0/986851544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc0ccc10 con 0x7fb8bc0bac10 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c14a7640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8bc0d4990 0x7fb8bc15faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.616+0000 7fb8c0ca6640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.617+0000 7fb8b3fff640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0bac10 0x7fb8bc153b90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c4c0 tx=0x7fb8ac00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.617+0000 7fb8b17fa640 1 -- 172.21.15.16:0/986851544 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac018070 con 0x7fb8bc0bac10 2024-05-11T01:16:15.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.617+0000 7fb8b17fa640 1 -- 172.21.15.16:0/986851544 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac007500 con 0x7fb8bc0bac10 2024-05-11T01:16:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.617+0000 7fb8b17fa640 1 -- 172.21.15.16:0/986851544 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac004a20 con 0x7fb8bc0bac10 2024-05-11T01:16:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.617+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc0ccef0 con 0x7fb8bc0bac10 2024-05-11T01:16:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.617+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc0cd4b0 con 0x7fb8bc0bac10 2024-05-11T01:16:15.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.618+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8bc06a5b0 con 0x7fb8bc0bac10 2024-05-11T01:16:15.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.619+0000 7fb8b17fa640 1 -- 172.21.15.16:0/986851544 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7fb8ac01b070 con 0x7fb8bc0bac10 2024-05-11T01:16:15.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.619+0000 7fb8b17fa640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fb8a80762d0 0x7fb8a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.619+0000 7fb8b17fa640 1 -- 172.21.15.16:0/986851544 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7fb8ac096b20 con 0x7fb8bc0bac10 2024-05-11T01:16:15.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.620+0000 7fb8c0ca6640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fb8a80762d0 0x7fb8a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.620+0000 7fb8c0ca6640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fb8a80762d0 0x7fb8a8078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009b90 tx=0x7fb8b8008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.624 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.624+0000 7fb8b17fa640 1 -- 172.21.15.16:0/986851544 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb8ac0602d0 con 0x7fb8bc0bac10 2024-05-11T01:16:15.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.820+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fb8bc0b4a30 con 0x7fb8a80762d0 2024-05-11T01:16:15.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.821+0000 7fb8b17fa640 1 -- 172.21.15.16:0/986851544 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb8bc0b4a30 con 0x7fb8a80762d0 2024-05-11T01:16:15.821 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-05-11T01:16:15.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fb8a80762d0 msgr2=0x7fb8a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fb8a80762d0 0x7fb8a8078790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8009b90 tx=0x7fb8b8008040 comp rx=0 tx=0).stop 2024-05-11T01:16:15.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0bac10 msgr2=0x7fb8bc153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0bac10 0x7fb8bc153b90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c4c0 tx=0x7fb8ac00c980 comp rx=0 tx=0).stop 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 shutdown_connections 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7fb8a80762d0 0x7fb8a8078790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8bc0d4990 0x7fb8bc15faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8bc0bac10 0x7fb8bc153b90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 --2- 172.21.15.16:0/986851544 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7fb8bc0b6d70 0x7fb8bc0cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 >> 172.21.15.16:0/986851544 conn(0x7fb8bc074140 msgr2=0x7fb8bc0b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 shutdown_connections 2024-05-11T01:16:15.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.823+0000 7fb8c2f0a640 1 -- 172.21.15.16:0/986851544 wait complete. 2024-05-11T01:16:15.835 INFO:tasks.ceph:Scrubbing osd.6 2024-05-11T01:16:15.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-11T01:16:15.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.943+0000 7f795841c640 1 Processor -- start 2024-05-11T01:16:15.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.943+0000 7f795841c640 1 -- start start 2024-05-11T01:16:15.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f795841c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79500d2af0 0x7f795006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f795841c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7950071c70 0x7f7950163a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f795841c640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79500d2ed0 con 0x7f7950070780 2024-05-11T01:16:15.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f795841c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f79500723e0 con 0x7f7950071c70 2024-05-11T01:16:15.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f795841c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f79500726c0 con 0x7f79500d2af0 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f79569b9640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7950070780 0x7f795015fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57112/0 (socket says 172.21.15.16:57112) 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f79569b9640 1 -- 172.21.15.16:0/1746005177 learned_addr learned my addr 172.21.15.16:0/1746005177 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f79561b8640 1 --2- 172.21.15.16:0/1746005177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79500d2af0 0x7f795006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.944+0000 7f79559b7640 1 --2- 172.21.15.16:0/1746005177 >> v2:172.21.15.174:3300/0 conn(0x7f7950071c70 0x7f7950163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.945+0000 7f79551b6640 1 -- 172.21.15.16:0/1746005177 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899853639 0 0) 0x7f79500d2ed0 con 0x7f7950070780 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.945+0000 7f79551b6640 1 -- 172.21.15.16:0/1746005177 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f793c003520 con 0x7f7950070780 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.945+0000 7f79559b7640 1 -- 172.21.15.16:0/1746005177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79500d2af0 msgr2=0x7f795006d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.945+0000 7f79559b7640 1 --2- 172.21.15.16:0/1746005177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79500d2af0 0x7f795006d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.945+0000 7f79559b7640 1 -- 172.21.15.16:0/1746005177 >> v1:172.21.15.16:6789/0 conn(0x7f7950070780 legacy=0x7f795015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.945+0000 7f79559b7640 1 -- 172.21.15.16:0/1746005177 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79500729a0 con 0x7f7950071c70 2024-05-11T01:16:15.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f79559b7640 1 --2- 172.21.15.16:0/1746005177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7950071c70 0x7f7950163a40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f794c0097a0 tx=0x7f794c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2919301a44e5e2f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f79551b6640 1 -- 172.21.15.16:0/1746005177 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c037070 con 0x7f7950071c70 2024-05-11T01:16:15.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f79551b6640 1 -- 172.21.15.16:0/1746005177 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f794c032440 con 0x7f7950071c70 2024-05-11T01:16:15.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f79551b6640 1 -- 172.21.15.16:0/1746005177 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c0327f0 con 0x7f7950071c70 2024-05-11T01:16:15.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f795841c640 1 -- 172.21.15.16:0/1746005177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7950071c70 msgr2=0x7f7950163a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f795841c640 1 --2- 172.21.15.16:0/1746005177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7950071c70 0x7f7950163a40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f794c0097a0 tx=0x7f794c02a180 comp rx=0 tx=0).stop 2024-05-11T01:16:15.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f795841c640 1 -- 172.21.15.16:0/1746005177 shutdown_connections 2024-05-11T01:16:15.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f795841c640 1 --2- 172.21.15.16:0/1746005177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7950071c70 0x7f7950163a40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f795841c640 1 --2- 172.21.15.16:0/1746005177 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f79500d2af0 0x7f795006d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f795841c640 1 -- 172.21.15.16:0/1746005177 >> 172.21.15.16:0/1746005177 conn(0x7f79500d3100 msgr2=0x7f79500d3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f795841c640 1 -- 172.21.15.16:0/1746005177 shutdown_connections 2024-05-11T01:16:15.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.946+0000 7f795841c640 1 -- 172.21.15.16:0/1746005177 wait complete. 2024-05-11T01:16:15.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f795841c640 1 Processor -- start 2024-05-11T01:16:15.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f795841c640 1 -- start start 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f795841c640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7950070780 0x7f79500cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f795841c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7950071c70 0x7f79500b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f795841c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79500d2af0 0x7f795015fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f795841c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f79500720e0 con 0x7f7950071c70 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f795841c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7950163540 con 0x7f79500d2af0 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f795841c640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f7950163f80 con 0x7f7950070780 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.948+0000 7f79559b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7950071c70 0x7f79500b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79559b7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7950071c70 0x7f79500b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:34988/0 (socket says 172.21.15.16:34988) 2024-05-11T01:16:15.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79559b7640 1 -- 172.21.15.16:0/3577980447 learned_addr learned my addr 172.21.15.16:0/3577980447 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79561b8640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7950070780 0x7f79500cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79569b9640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79500d2af0 0x7f795015fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79559b7640 1 -- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7950070780 msgr2=0x7f79500cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79559b7640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f7950070780 0x7f79500cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79559b7640 1 -- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79500d2af0 msgr2=0x7f795015fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79559b7640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79500d2af0 0x7f795015fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79559b7640 1 -- 172.21.15.16:0/3577980447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79500b4790 con 0x7f7950071c70 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f79559b7640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7950071c70 0x7f79500b4250 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f794c0097a0 tx=0x7f794c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c037050 con 0x7f7950071c70 2024-05-11T01:16:15.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f794c038040 con 0x7f7950071c70 2024-05-11T01:16:15.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79501f4e90 con 0x7f7950071c70 2024-05-11T01:16:15.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c004490 con 0x7f7950071c70 2024-05-11T01:16:15.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.949+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79500ce960 con 0x7f7950071c70 2024-05-11T01:16:15.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.950+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79500ce430 con 0x7f7950071c70 2024-05-11T01:16:15.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.951+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f794c03c6d0 con 0x7f7950071c70 2024-05-11T01:16:15.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.951+0000 7f7946ffd640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f79340762d0 0x7f7934078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.951+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f794c0b8030 con 0x7f7950071c70 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.952+0000 7f7946ffd640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f793407e930 0x7f7934080d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.952+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 --> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f794c040e80 con 0x7f793407e930 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.952+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f794c0bf050 con 0x7f7950071c70 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.952+0000 7f79561b8640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f79340762d0 0x7f7934078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.952+0000 7f79569b9640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f793407e930 0x7f7934080d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.952+0000 7f79561b8640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f79340762d0 0x7f7934078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7940009b40 tx=0x7f7940009190 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.952+0000 7f79569b9640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f793407e930 0x7f7934080d40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:15.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.953+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 <== osd.6 v2:172.21.15.174:6816/3065840134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f794c040e80 con 0x7f793407e930 2024-05-11T01:16:15.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.966+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 --> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f795006a5b0 con 0x7f793407e930 2024-05-11T01:16:15.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f7946ffd640 1 -- 172.21.15.16:0/3577980447 <== osd.6 v2:172.21.15.174:6816/3065840134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f795006a5b0 con 0x7f793407e930 2024-05-11T01:16:15.967 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:16:15.967 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-11T01:16:15.968 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:16:15.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f793407e930 msgr2=0x7f7934080d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6816/3065840134,v1:172.21.15.174:6818/3065840134] conn(0x7f793407e930 0x7f7934080d40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f79340762d0 msgr2=0x7f7934078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f79340762d0 0x7f7934078790 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7940009b40 tx=0x7f7940009190 comp rx=0 tx=0).stop 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7950071c70 msgr2=0x7f79500b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 --2- 172.21.15.16:0/3577980447 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7950071c70 0x7f79500b4250 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f794c0097a0 tx=0x7f794c0046c0 comp rx=0 tx=0).stop 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f79569b9640 1 -- 172.21.15.16:0/3577980447 reap_dead start 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 shutdown_connections 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 >> 172.21.15.16:0/3577980447 conn(0x7f79500d3100 msgr2=0x7f79500b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:15.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 shutdown_connections 2024-05-11T01:16:15.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:15.967+0000 7f795841c640 1 -- 172.21.15.16:0/3577980447 wait complete. 2024-05-11T01:16:15.978 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-11T01:16:16.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.082+0000 7f45e3cc4640 1 Processor -- start 2024-05-11T01:16:16.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.083+0000 7f45e3cc4640 1 -- start start 2024-05-11T01:16:16.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.083+0000 7f45e3cc4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45dc0d0000 0x7f45dc0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.083+0000 7f45e3cc4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc0baed0 0x7f45dc162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.083+0000 7f45e3cc4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45dc0d0920 con 0x7f45dc06d3e0 2024-05-11T01:16:16.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.083+0000 7f45e3cc4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f45dc163820 con 0x7f45dc0d0000 2024-05-11T01:16:16.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.083+0000 7f45e3cc4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f45dc163b00 con 0x7f45dc0baed0 2024-05-11T01:16:16.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.083+0000 7f45e1a60640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45dc0d0000 0x7f45dc0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.084+0000 7f45e2261640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f45dc06d3e0 0x7f45dc06d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57124/0 (socket says 172.21.15.16:57124) 2024-05-11T01:16:16.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.084+0000 7f45e2261640 1 -- 172.21.15.16:0/2404285392 learned_addr learned my addr 172.21.15.16:0/2404285392 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.084+0000 7f45e125f640 1 --2- 172.21.15.16:0/2404285392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc0baed0 0x7f45dc162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.084+0000 7f45e1a60640 1 -- 172.21.15.16:0/2404285392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc0baed0 msgr2=0x7f45dc162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.084+0000 7f45e1a60640 1 --2- 172.21.15.16:0/2404285392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc0baed0 0x7f45dc162fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.084+0000 7f45e1a60640 1 -- 172.21.15.16:0/2404285392 >> v1:172.21.15.16:6789/0 conn(0x7f45dc06d3e0 legacy=0x7f45dc06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.084+0000 7f45e1a60640 1 -- 172.21.15.16:0/2404285392 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45dc0d33f0 con 0x7f45dc0d0000 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e1a60640 1 --2- 172.21.15.16:0/2404285392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0d0000 0x7f45dc0d03e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f45d40097a0 tx=0x7f45d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd729646e621f84 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e0a5e640 1 -- 172.21.15.16:0/2404285392 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4037070 con 0x7f45dc0d0000 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e0a5e640 1 -- 172.21.15.16:0/2404285392 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d4032440 con 0x7f45dc0d0000 2024-05-11T01:16:16.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e0a5e640 1 -- 172.21.15.16:0/2404285392 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4032810 con 0x7f45dc0d0000 2024-05-11T01:16:16.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e3cc4640 1 -- 172.21.15.16:0/2404285392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0d0000 msgr2=0x7f45dc0d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/2404285392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0d0000 0x7f45dc0d03e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f45d40097a0 tx=0x7f45d402a180 comp rx=0 tx=0).stop 2024-05-11T01:16:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e3cc4640 1 -- 172.21.15.16:0/2404285392 shutdown_connections 2024-05-11T01:16:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/2404285392 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc0baed0 0x7f45dc162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/2404285392 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0d0000 0x7f45dc0d03e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e3cc4640 1 -- 172.21.15.16:0/2404285392 >> 172.21.15.16:0/2404285392 conn(0x7f45dc074140 msgr2=0x7f45dc0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e3cc4640 1 -- 172.21.15.16:0/2404285392 shutdown_connections 2024-05-11T01:16:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.085+0000 7f45e3cc4640 1 -- 172.21.15.16:0/2404285392 wait complete. 2024-05-11T01:16:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e3cc4640 1 Processor -- start 2024-05-11T01:16:16.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e3cc4640 1 -- start start 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e3cc4640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc06d3e0 0x7f45dc0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e3cc4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0baed0 0x7f45dc162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e3cc4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45dc0d0000 0x7f45dc15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e3cc4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f45dc163de0 con 0x7f45dc0baed0 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e3cc4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f45dc163510 con 0x7f45dc0d0000 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e3cc4640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f45dc15f750 con 0x7f45dc06d3e0 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.087+0000 7f45e125f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0baed0 0x7f45dc162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e125f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0baed0 0x7f45dc162240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35012/0 (socket says 172.21.15.16:35012) 2024-05-11T01:16:16.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e125f640 1 -- 172.21.15.16:0/3682759539 learned_addr learned my addr 172.21.15.16:0/3682759539 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e1a60640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc06d3e0 0x7f45dc0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e2261640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45dc0d0000 0x7f45dc15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e125f640 1 -- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc06d3e0 msgr2=0x7f45dc0caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e125f640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc06d3e0 0x7f45dc0caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e125f640 1 -- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45dc0d0000 msgr2=0x7f45dc15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e125f640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45dc0d0000 0x7f45dc15ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e125f640 1 -- 172.21.15.16:0/3682759539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45dc161db0 con 0x7f45dc0baed0 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e125f640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0baed0 0x7f45dc162240 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f45d000d620 tx=0x7f45d000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45da7fc640 1 -- 172.21.15.16:0/3682759539 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d000b620 con 0x7f45dc0baed0 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45da7fc640 1 -- 172.21.15.16:0/3682759539 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d0019070 con 0x7f45dc0baed0 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45dc15c4d0 con 0x7f45dc0baed0 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45da7fc640 1 -- 172.21.15.16:0/3682759539 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d000ba00 con 0x7f45dc0baed0 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.088+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45dc162780 con 0x7f45dc0baed0 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.089+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45dc06a5b0 con 0x7f45dc0baed0 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.090+0000 7f45da7fc640 1 -- 172.21.15.16:0/3682759539 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f45d000bba0 con 0x7f45dc0baed0 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.090+0000 7f45da7fc640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f45c80762d0 0x7f45c8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.091+0000 7f45da7fc640 1 -- 172.21.15.16:0/3682759539 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f45d0097ba0 con 0x7f45dc0baed0 2024-05-11T01:16:16.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.091+0000 7f45e1a60640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f45c80762d0 0x7f45c8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.091+0000 7f45e1a60640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f45c80762d0 0x7f45c8078790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45d4034000 tx=0x7f45d402e000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.095+0000 7f45da7fc640 1 -- 172.21.15.16:0/3682759539 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f45d0061340 con 0x7f45dc0baed0 2024-05-11T01:16:16.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.287+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f45dc15cb20 con 0x7f45c80762d0 2024-05-11T01:16:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.289+0000 7f45da7fc640 1 -- 172.21.15.16:0/3682759539 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45dc15cb20 con 0x7f45c80762d0 2024-05-11T01:16:16.288 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-05-11T01:16:16.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f45c80762d0 msgr2=0x7f45c8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f45c80762d0 0x7f45c8078790 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f45d4034000 tx=0x7f45d402e000 comp rx=0 tx=0).stop 2024-05-11T01:16:16.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0baed0 msgr2=0x7f45dc162240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0baed0 0x7f45dc162240 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f45d000d620 tx=0x7f45d000dae0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 shutdown_connections 2024-05-11T01:16:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f45c80762d0 0x7f45c8078790 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45dc0d0000 0x7f45dc15ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45dc0baed0 0x7f45dc162240 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 --2- 172.21.15.16:0/3682759539 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f45dc06d3e0 0x7f45dc0caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 >> 172.21.15.16:0/3682759539 conn(0x7f45dc074140 msgr2=0x7f45dc0ba4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 shutdown_connections 2024-05-11T01:16:16.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.290+0000 7f45e3cc4640 1 -- 172.21.15.16:0/3682759539 wait complete. 2024-05-11T01:16:16.301 INFO:tasks.ceph:Scrubbing osd.7 2024-05-11T01:16:16.301 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-11T01:16:16.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.408+0000 7f4ed9946640 1 Processor -- start 2024-05-11T01:16:16.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.408+0000 7f4ed9946640 1 -- start start 2024-05-11T01:16:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed9946640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4ed40cdcf0 0x7f4ed40d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.410 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed9946640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 0x7f4ed40b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed9946640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ed415da30 0x7f4ed415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed9946640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4ed415e7b0 con 0x7f4ed415da30 2024-05-11T01:16:16.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed9946640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f4ed40d1170 con 0x7f4ed40cdcf0 2024-05-11T01:16:16.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed9946640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed40d1450 con 0x7f4ed40b4cf0 2024-05-11T01:16:16.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ed415da30 0x7f4ed415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ed415da30 0x7f4ed415dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35016/0 (socket says 172.21.15.16:35016) 2024-05-11T01:16:16.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.409+0000 7f4ed37fe640 1 -- 172.21.15.16:0/543341894 learned_addr learned my addr 172.21.15.16:0/543341894 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed27fc640 1 --2- 172.21.15.16:0/543341894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 0x7f4ed40b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed2ffd640 1 --2- 172.21.15.16:0/543341894 >> v2:172.21.15.174:3300/0 conn(0x7f4ed40cdcf0 0x7f4ed40d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed37fe640 1 -- 172.21.15.16:0/543341894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 msgr2=0x7f4ed40b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed37fe640 1 --2- 172.21.15.16:0/543341894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 0x7f4ed40b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed37fe640 1 -- 172.21.15.16:0/543341894 >> v2:172.21.15.174:3300/0 conn(0x7f4ed40cdcf0 msgr2=0x7f4ed40d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed37fe640 1 --2- 172.21.15.16:0/543341894 >> v2:172.21.15.174:3300/0 conn(0x7f4ed40cdcf0 0x7f4ed40d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed37fe640 1 -- 172.21.15.16:0/543341894 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed40d1730 con 0x7f4ed415da30 2024-05-11T01:16:16.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed27fc640 1 --2- 172.21.15.16:0/543341894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 0x7f4ed40b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:16.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed2ffd640 1 --2- 172.21.15.16:0/543341894 >> v2:172.21.15.174:3300/0 conn(0x7f4ed40cdcf0 0x7f4ed40d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:16.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed37fe640 1 --2- 172.21.15.16:0/543341894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 0x7f4ed415dec0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4ed406ce90 tx=0x7f4ec402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65010982ba2c3712 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.410+0000 7f4ed1ffb640 1 -- 172.21.15.16:0/543341894 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4036070 con 0x7f4ed415da30 2024-05-11T01:16:16.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed1ffb640 1 -- 172.21.15.16:0/543341894 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec4031600 con 0x7f4ed415da30 2024-05-11T01:16:16.413 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed1ffb640 1 -- 172.21.15.16:0/543341894 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40319d0 con 0x7f4ed415da30 2024-05-11T01:16:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 -- 172.21.15.16:0/543341894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 msgr2=0x7f4ed415dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 --2- 172.21.15.16:0/543341894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 0x7f4ed415dec0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4ed406ce90 tx=0x7f4ec402a610 comp rx=0 tx=0).stop 2024-05-11T01:16:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 -- 172.21.15.16:0/543341894 shutdown_connections 2024-05-11T01:16:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 --2- 172.21.15.16:0/543341894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 0x7f4ed415dec0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 --2- 172.21.15.16:0/543341894 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 0x7f4ed40b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 --2- 172.21.15.16:0/543341894 >> v2:172.21.15.174:3300/0 conn(0x7f4ed40cdcf0 0x7f4ed40d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 -- 172.21.15.16:0/543341894 >> 172.21.15.16:0/543341894 conn(0x7f4ed40681c0 msgr2=0x7f4ed40685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:16.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 -- 172.21.15.16:0/543341894 shutdown_connections 2024-05-11T01:16:16.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.411+0000 7f4ed9946640 1 -- 172.21.15.16:0/543341894 wait complete. 2024-05-11T01:16:16.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.412+0000 7f4ed9946640 1 Processor -- start 2024-05-11T01:16:16.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed9946640 1 -- start start 2024-05-11T01:16:16.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed9946640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 0x7f4ed40b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed9946640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed40cdcf0 0x7f4ed4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed9946640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 0x7f4ed415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed9946640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed40ce250 con 0x7f4ed415da30 2024-05-11T01:16:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed9946640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed40ce0d0 con 0x7f4ed40cdcf0 2024-05-11T01:16:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed9946640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4ed4153d30 con 0x7f4ed40b4cf0 2024-05-11T01:16:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 0x7f4ed415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 0x7f4ed415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35028/0 (socket says 172.21.15.16:35028) 2024-05-11T01:16:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed37fe640 1 -- 172.21.15.16:0/2800122078 learned_addr learned my addr 172.21.15.16:0/2800122078 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:16.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.413+0000 7f4ed2ffd640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 0x7f4ed40b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed27fc640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed40cdcf0 0x7f4ed4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed37fe640 1 -- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 msgr2=0x7f4ed40b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed37fe640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4ed40b4cf0 0x7f4ed40b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed37fe640 1 -- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed40cdcf0 msgr2=0x7f4ed4157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed37fe640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ed40cdcf0 0x7f4ed4157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed37fe640 1 -- 172.21.15.16:0/2800122078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed40b8650 con 0x7f4ed415da30 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed37fe640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 0x7f4ed415acd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009f40 tx=0x7f4ec4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4041020 con 0x7f4ed415da30 2024-05-11T01:16:16.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec4007780 con 0x7f4ed415da30 2024-05-11T01:16:16.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed40b7070 con 0x7f4ed415da30 2024-05-11T01:16:16.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4036040 con 0x7f4ed415da30 2024-05-11T01:16:16.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.414+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed40b7630 con 0x7f4ed415da30 2024-05-11T01:16:16.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.415+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ed4153b80 con 0x7f4ed415da30 2024-05-11T01:16:16.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.416+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f4ec4044020 con 0x7f4ed415da30 2024-05-11T01:16:16.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.416+0000 7f4ecbfff640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4eb40762d0 0x7f4eb4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.416+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f4ec40b8390 con 0x7f4ed415da30 2024-05-11T01:16:16.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.416+0000 7f4ecbfff640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f4eb407e930 0x7f4eb4080d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.416+0000 7f4ed2ffd640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4eb40762d0 0x7f4eb4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.416+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 --> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ec4047e50 con 0x7f4eb407e930 2024-05-11T01:16:16.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.416+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f4ec40bf050 con 0x7f4ed415da30 2024-05-11T01:16:16.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.417+0000 7f4ed27fc640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f4eb407e930 0x7f4eb4080d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.417+0000 7f4ed2ffd640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4eb40762d0 0x7f4eb4078790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00ab60 tx=0x7f4ecc008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.417+0000 7f4ed27fc640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f4eb407e930 0x7f4eb4080d40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.418+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 <== osd.7 v2:172.21.15.174:6808/3689065409 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4ec4047e50 con 0x7f4eb407e930 2024-05-11T01:16:16.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.431+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 --> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4ed406a5b0 con 0x7f4eb407e930 2024-05-11T01:16:16.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.432+0000 7f4ecbfff640 1 -- 172.21.15.16:0/2800122078 <== osd.7 v2:172.21.15.174:6808/3689065409 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4ed406a5b0 con 0x7f4eb407e930 2024-05-11T01:16:16.432 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-05-11T01:16:16.433 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-11T01:16:16.433 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-05-11T01:16:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f4eb407e930 msgr2=0x7f4eb4080d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6808/3689065409,v1:172.21.15.174:6809/3689065409] conn(0x7f4eb407e930 0x7f4eb4080d40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4eb40762d0 msgr2=0x7f4eb4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4eb40762d0 0x7f4eb4078790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00ab60 tx=0x7f4ecc008040 comp rx=0 tx=0).stop 2024-05-11T01:16:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 msgr2=0x7f4ed415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 --2- 172.21.15.16:0/2800122078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ed415da30 0x7f4ed415acd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009f40 tx=0x7f4ec4004a40 comp rx=0 tx=0).stop 2024-05-11T01:16:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed37fe640 1 -- 172.21.15.16:0/2800122078 reap_dead start 2024-05-11T01:16:16.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 shutdown_connections 2024-05-11T01:16:16.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 >> 172.21.15.16:0/2800122078 conn(0x7f4ed40681c0 msgr2=0x7f4ed40685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:16.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 shutdown_connections 2024-05-11T01:16:16.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.433+0000 7f4ed9946640 1 -- 172.21.15.16:0/2800122078 wait complete. 2024-05-11T01:16:16.444 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-11T01:16:16.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.548+0000 7f6bddf19640 1 Processor -- start 2024-05-11T01:16:16.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.548+0000 7f6bddf19640 1 -- start start 2024-05-11T01:16:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bddf19640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6bd80d0540 0x7f6bd80d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bddf19640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd8073ca0 con 0x7f6bd8160e30 2024-05-11T01:16:16.549 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bddf19640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd8073f80 con 0x7f6bd80cdda0 2024-05-11T01:16:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bddf19640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd80745d0 con 0x7f6bd80d0540 2024-05-11T01:16:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bd6ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6bd80d0540 0x7f6bd80d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bd7fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6bd8160e30 0x7f6bd81612c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57134/0 (socket says 172.21.15.16:57134) 2024-05-11T01:16:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bd7fff640 1 -- 172.21.15.16:0/1734950631 learned_addr learned my addr 172.21.15.16:0/1734950631 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bd6ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6bd80d0540 0x7f6bd80d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35042/0 (socket says 172.21.15.16:35042) 2024-05-11T01:16:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bd6ffd640 1 -- 172.21.15.16:0/1734950631 >> v1:172.21.15.174:6789/0 conn(0x7f6bd80cdda0 legacy=0x7f6bd80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bd6ffd640 1 -- 172.21.15.16:0/1734950631 >> v1:172.21.15.16:6789/0 conn(0x7f6bd8160e30 legacy=0x7f6bd81612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.549+0000 7f6bd6ffd640 1 -- 172.21.15.16:0/1734950631 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd8074260 con 0x7f6bd80d0540 2024-05-11T01:16:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.550+0000 7f6bd6ffd640 1 --2- 172.21.15.16:0/1734950631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd80d09c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0097a0 tx=0x7f6bcc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1d50aab6c1e46e server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.550+0000 7f6bd67fc640 1 -- 172.21.15.16:0/1734950631 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc037070 con 0x7f6bd80d0540 2024-05-11T01:16:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.550+0000 7f6bd67fc640 1 -- 172.21.15.16:0/1734950631 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bcc032440 con 0x7f6bd80d0540 2024-05-11T01:16:16.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.550+0000 7f6bd67fc640 1 -- 172.21.15.16:0/1734950631 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc032810 con 0x7f6bd80d0540 2024-05-11T01:16:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.551+0000 7f6bddf19640 1 -- 172.21.15.16:0/1734950631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 msgr2=0x7f6bd80d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.551+0000 7f6bddf19640 1 --2- 172.21.15.16:0/1734950631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd80d09c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc0097a0 tx=0x7f6bcc02a230 comp rx=0 tx=0).stop 2024-05-11T01:16:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.551+0000 7f6bddf19640 1 -- 172.21.15.16:0/1734950631 shutdown_connections 2024-05-11T01:16:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.551+0000 7f6bddf19640 1 --2- 172.21.15.16:0/1734950631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd80d09c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.551+0000 7f6bddf19640 1 -- 172.21.15.16:0/1734950631 >> 172.21.15.16:0/1734950631 conn(0x7f6bd8072c70 msgr2=0x7f6bd80b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.551+0000 7f6bddf19640 1 -- 172.21.15.16:0/1734950631 shutdown_connections 2024-05-11T01:16:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.551+0000 7f6bddf19640 1 -- 172.21.15.16:0/1734950631 wait complete. 2024-05-11T01:16:16.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.552+0000 7f6bddf19640 1 Processor -- start 2024-05-11T01:16:16.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.552+0000 7f6bddf19640 1 -- start start 2024-05-11T01:16:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bddf19640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bd80cdda0 0x7f6bd81f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bddf19640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd809a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bddf19640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8160e30 0x7f6bd80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bddf19640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd8161b50 con 0x7f6bd80d0540 2024-05-11T01:16:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bddf19640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd81619d0 con 0x7f6bd80cdda0 2024-05-11T01:16:16.556 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bddf19640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd8161cd0 con 0x7f6bd8160e30 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd809a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd809a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35050/0 (socket says 172.21.15.16:35050) 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd6ffd640 1 -- 172.21.15.16:0/4285516804 learned_addr learned my addr 172.21.15.16:0/4285516804 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd7fff640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8160e30 0x7f6bd80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd77fe640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bd80cdda0 0x7f6bd81f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd6ffd640 1 -- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8160e30 msgr2=0x7f6bd80c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd6ffd640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8160e30 0x7f6bd80c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd6ffd640 1 -- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bd80cdda0 msgr2=0x7f6bd81f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd6ffd640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bd80cdda0 0x7f6bd81f4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd6ffd640 1 -- 172.21.15.16:0/4285516804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd809aee0 con 0x7f6bd80d0540 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.553+0000 7f6bd7fff640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8160e30 0x7f6bd80c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.554+0000 7f6bd6ffd640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd809a9a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc035040 tx=0x7f6bcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.554+0000 7f6bbffff640 1 -- 172.21.15.16:0/4285516804 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc037040 con 0x7f6bd80d0540 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.554+0000 7f6bbffff640 1 -- 172.21.15.16:0/4285516804 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bcc030770 con 0x7f6bd80d0540 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.554+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd81f4f60 con 0x7f6bd80d0540 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.554+0000 7f6bbffff640 1 -- 172.21.15.16:0/4285516804 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc030b80 con 0x7f6bd80d0540 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.554+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd81f5520 con 0x7f6bd80d0540 2024-05-11T01:16:16.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.555+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bd80cfe80 con 0x7f6bd80d0540 2024-05-11T01:16:16.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.556+0000 7f6bbffff640 1 -- 172.21.15.16:0/4285516804 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f6bcc044020 con 0x7f6bd80d0540 2024-05-11T01:16:16.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.556+0000 7f6bbffff640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6bc4076300 0x7f6bc40787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.556+0000 7f6bbffff640 1 -- 172.21.15.16:0/4285516804 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f6bcc0b7d40 con 0x7f6bd80d0540 2024-05-11T01:16:16.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.556+0000 7f6bd77fe640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6bc4076300 0x7f6bc40787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.557+0000 7f6bd77fe640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6bc4076300 0x7f6bc40787c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8000f60 tx=0x7f6bc8009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.560+0000 7f6bbffff640 1 -- 172.21.15.16:0/4285516804 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6bd80cfe80 con 0x7f6bd80d0540 2024-05-11T01:16:16.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.751+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6bd806a5b0 con 0x7f6bc4076300 2024-05-11T01:16:16.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.753+0000 7f6bbffff640 1 -- 172.21.15.16:0/4285516804 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6bd806a5b0 con 0x7f6bc4076300 2024-05-11T01:16:16.752 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-05-11T01:16:16.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6bc4076300 msgr2=0x7f6bc40787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6bc4076300 0x7f6bc40787c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8000f60 tx=0x7f6bc8009040 comp rx=0 tx=0).stop 2024-05-11T01:16:16.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 msgr2=0x7f6bd809a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd809a9a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc035040 tx=0x7f6bcc0046c0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 shutdown_connections 2024-05-11T01:16:16.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6bd8160e30 0x7f6bd80c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6bd80d0540 0x7f6bd809a9a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6bc4076300 0x7f6bc40787c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 --2- 172.21.15.16:0/4285516804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bd80cdda0 0x7f6bd81f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 >> 172.21.15.16:0/4285516804 conn(0x7f6bd8072c70 msgr2=0x7f6bd80b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:16.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 shutdown_connections 2024-05-11T01:16:16.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.754+0000 7f6bddf19640 1 -- 172.21.15.16:0/4285516804 wait complete. 2024-05-11T01:16:16.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:16:16.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.869+0000 7f6c7e5e7640 1 Processor -- start 2024-05-11T01:16:16.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.869+0000 7f6c7e5e7640 1 -- start start 2024-05-11T01:16:16.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7e5e7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6c780baed0 0x7f6c78162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7e5e7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6c780d3bf0 0x7f6c780d4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7e5e7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c78163820 con 0x7f6c780d0000 2024-05-11T01:16:16.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7e5e7640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6c78163b00 con 0x7f6c780d3bf0 2024-05-11T01:16:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7e5e7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f6c780d33f0 con 0x7f6c780baed0 2024-05-11T01:16:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7cb84640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6c780d3bf0 0x7f6c780d4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7cb84640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6c780d3bf0 0x7f6c780d4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35056/0 (socket says 172.21.15.16:35056) 2024-05-11T01:16:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7cb84640 1 -- 172.21.15.16:0/986128164 learned_addr learned my addr 172.21.15.16:0/986128164 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7cb84640 1 -- 172.21.15.16:0/986128164 >> v2:172.21.15.174:3300/0 conn(0x7f6c780baed0 msgr2=0x7f6c78162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7cb84640 1 --2- 172.21.15.16:0/986128164 >> v2:172.21.15.174:3300/0 conn(0x7f6c780baed0 0x7f6c78162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7cb84640 1 -- 172.21.15.16:0/986128164 >> v1:172.21.15.174:6789/0 conn(0x7f6c780d0000 legacy=0x7f6c780d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:16.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.870+0000 7f6c7cb84640 1 -- 172.21.15.16:0/986128164 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c780d36d0 con 0x7f6c780d3bf0 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.871+0000 7f6c7cb84640 1 --2- 172.21.15.16:0/986128164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780d4080 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6c780b7d20 tx=0x7f6c7002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dc18b4e8468a07 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.871+0000 7f6c777fe640 1 -- 172.21.15.16:0/986128164 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70036070 con 0x7f6c780d3bf0 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.871+0000 7f6c777fe640 1 -- 172.21.15.16:0/986128164 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c70031600 con 0x7f6c780d3bf0 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.871+0000 7f6c777fe640 1 -- 172.21.15.16:0/986128164 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c700319d0 con 0x7f6c780d3bf0 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.871+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/986128164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 msgr2=0x7f6c780d4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.871+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/986128164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780d4080 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6c780b7d20 tx=0x7f6c7002a6a0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.872+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/986128164 shutdown_connections 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.872+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/986128164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780d4080 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.872+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/986128164 >> v2:172.21.15.174:3300/0 conn(0x7f6c780baed0 0x7f6c78162fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.872+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/986128164 >> 172.21.15.16:0/986128164 conn(0x7f6c78074140 msgr2=0x7f6c780b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.872+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/986128164 shutdown_connections 2024-05-11T01:16:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.872+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/986128164 wait complete. 2024-05-11T01:16:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.873+0000 7f6c7e5e7640 1 Processor -- start 2024-05-11T01:16:16.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.873+0000 7f6c7e5e7640 1 -- start start 2024-05-11T01:16:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.873+0000 7f6c7e5e7640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780baed0 0x7f6c780ba670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.873+0000 7f6c7e5e7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780d0000 0x7f6c78153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.873+0000 7f6c7e5e7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.873+0000 7f6c7e5e7640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7815f750 con 0x7f6c780d3bf0 2024-05-11T01:16:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.873+0000 7f6c7e5e7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78163de0 con 0x7f6c780d0000 2024-05-11T01:16:16.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.873+0000 7f6c7e5e7640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7815f8d0 con 0x7f6c780baed0 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35062/0 (socket says 172.21.15.16:35062) 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 -- 172.21.15.16:0/2758160714 learned_addr learned my addr 172.21.15.16:0/2758160714 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c6ffff640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780d0000 0x7f6c78153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c77fff640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780baed0 0x7f6c780ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 -- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780baed0 msgr2=0x7f6c780ba670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780baed0 0x7f6c780ba670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 -- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780d0000 msgr2=0x7f6c78153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:16.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780d0000 0x7f6c78153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 -- 172.21.15.16:0/2758160714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c780cea00 con 0x7f6c780d3bf0 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c77fff640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780baed0 0x7f6c780ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7cb84640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780ccee0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6c70034040 tx=0x7f6c70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c757fa640 1 -- 172.21.15.16:0/2758160714 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70041020 con 0x7f6c780d3bf0 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c757fa640 1 -- 172.21.15.16:0/2758160714 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c70007780 con 0x7f6c780d3bf0 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c780cece0 con 0x7f6c780d3bf0 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c757fa640 1 -- 172.21.15.16:0/2758160714 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70036040 con 0x7f6c780d3bf0 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.874+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c780cc400 con 0x7f6c780d3bf0 2024-05-11T01:16:16.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.876+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7806a5b0 con 0x7f6c780d3bf0 2024-05-11T01:16:16.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.876+0000 7f6c757fa640 1 -- 172.21.15.16:0/2758160714 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f6c70044020 con 0x7f6c780d3bf0 2024-05-11T01:16:16.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.877+0000 7f6c757fa640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6c580762d0 0x7f6c58078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:16.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.877+0000 7f6c757fa640 1 -- 172.21.15.16:0/2758160714 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f6c700b85a0 con 0x7f6c780d3bf0 2024-05-11T01:16:16.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.877+0000 7f6c77fff640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6c580762d0 0x7f6c58078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:16.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.877+0000 7f6c77fff640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6c580762d0 0x7f6c58078790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800a810 tx=0x7f6c68008040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:16.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:16.881+0000 7f6c757fa640 1 -- 172.21.15.16:0/2758160714 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6c7004b030 con 0x7f6c780d3bf0 2024-05-11T01:16:17.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.067+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c780babb0 con 0x7f6c580762d0 2024-05-11T01:16:17.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.074+0000 7f6c757fa640 1 -- 172.21.15.16:0/2758160714 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251840 (secure 0 0 0) 0x7f6c780babb0 con 0x7f6c580762d0 2024-05-11T01:16:17.076 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:16:17.077 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:16:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.076+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6c580762d0 msgr2=0x7f6c58078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.076+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6c580762d0 0x7f6c58078790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800a810 tx=0x7f6c68008040 comp rx=0 tx=0).stop 2024-05-11T01:16:17.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.076+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 msgr2=0x7f6c780ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.076+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780ccee0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6c70034040 tx=0x7f6c70004a40 comp rx=0 tx=0).stop 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.077+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 shutdown_connections 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.077+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c780d3bf0 0x7f6c780ccee0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.077+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f6c580762d0 0x7f6c58078790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.077+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6c780d0000 0x7f6c78153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.077+0000 7f6c7e5e7640 1 --2- 172.21.15.16:0/2758160714 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f6c780baed0 0x7f6c780ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.077+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 >> 172.21.15.16:0/2758160714 conn(0x7f6c78074140 msgr2=0x7f6c7815ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.077+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 shutdown_connections 2024-05-11T01:16:17.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:17.077+0000 7f6c7e5e7640 1 -- 172.21.15.16:0/2758160714 wait complete. 2024-05-11T01:16:17.088 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-05-11T01:16:15.191387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594162,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":179,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329880,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754644840,"statfs":{"total":773094113280,"available":772756316160,"internally_reserved":0,"allocated":7053312,"data_stored":3923540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003106"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285253+0000","last_change":"2024-05-11T01:13:57.572612+0000","last_active":"2024-05-11T01:14:46.285253+0000","last_peered":"2024-05-11T01:14:46.285253+0000","last_clean":"2024-05-11T01:14:46.285253+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:14:46.285253+0000","last_undegraded":"2024-05-11T01:14:46.285253+0000","last_fullsized":"2024-05-11T01:14:46.285253+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:06:34.417796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287984+0000","last_change":"2024-05-11T01:13:57.592028+0000","last_active":"2024-05-11T01:14:46.287984+0000","last_peered":"2024-05-11T01:14:46.287984+0000","last_clean":"2024-05-11T01:14:46.287984+0000","last_became_active":"2024-05-11T01:13:57.591749+0000","last_became_peered":"2024-05-11T01:13:57.591749+0000","last_unstale":"2024-05-11T01:14:46.287984+0000","last_undegraded":"2024-05-11T01:14:46.287984+0000","last_fullsized":"2024-05-11T01:14:46.287984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:07:26.697058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283899+0000","last_change":"2024-05-11T01:13:57.577565+0000","last_active":"2024-05-11T01:14:46.283899+0000","last_peered":"2024-05-11T01:14:46.283899+0000","last_clean":"2024-05-11T01:14:46.283899+0000","last_became_active":"2024-05-11T01:13:57.577002+0000","last_became_peered":"2024-05-11T01:13:57.577002+0000","last_unstale":"2024-05-11T01:14:46.283899+0000","last_undegraded":"2024-05-11T01:14:46.283899+0000","last_fullsized":"2024-05-11T01:14:46.283899+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:10:34.026303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189449+0000","last_change":"2024-05-11T01:13:57.588370+0000","last_active":"2024-05-11T01:14:47.189449+0000","last_peered":"2024-05-11T01:14:47.189449+0000","last_clean":"2024-05-11T01:14:47.189449+0000","last_became_active":"2024-05-11T01:13:57.587912+0000","last_became_peered":"2024-05-11T01:13:57.587912+0000","last_unstale":"2024-05-11T01:14:47.189449+0000","last_undegraded":"2024-05-11T01:14:47.189449+0000","last_fullsized":"2024-05-11T01:14:47.189449+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286887+0000","last_change":"2024-05-11T01:13:57.589752+0000","last_active":"2024-05-11T01:14:46.286887+0000","last_peered":"2024-05-11T01:14:46.286887+0000","last_clean":"2024-05-11T01:14:46.286887+0000","last_became_active":"2024-05-11T01:13:57.589446+0000","last_became_peered":"2024-05-11T01:13:57.589446+0000","last_unstale":"2024-05-11T01:14:46.286887+0000","last_undegraded":"2024-05-11T01:14:46.286887+0000","last_fullsized":"2024-05-11T01:14:46.286887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:28:37.601407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776331+0000","last_change":"2024-05-11T01:13:57.580181+0000","last_active":"2024-05-11T01:14:46.776331+0000","last_peered":"2024-05-11T01:14:46.776331+0000","last_clean":"2024-05-11T01:14:46.776331+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:14:46.776331+0000","last_undegraded":"2024-05-11T01:14:46.776331+0000","last_fullsized":"2024-05-11T01:14:46.776331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:39:24.131603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284108+0000","last_change":"2024-05-11T01:13:57.574956+0000","last_active":"2024-05-11T01:14:46.284108+0000","last_peered":"2024-05-11T01:14:46.284108+0000","last_clean":"2024-05-11T01:14:46.284108+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:14:46.284108+0000","last_undegraded":"2024-05-11T01:14:46.284108+0000","last_fullsized":"2024-05-11T01:14:46.284108+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:57:22.062523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.188981+0000","last_change":"2024-05-11T01:13:57.584499+0000","last_active":"2024-05-11T01:14:47.188981+0000","last_peered":"2024-05-11T01:14:47.188981+0000","last_clean":"2024-05-11T01:14:47.188981+0000","last_became_active":"2024-05-11T01:13:57.584207+0000","last_became_peered":"2024-05-11T01:13:57.584207+0000","last_unstale":"2024-05-11T01:14:47.188981+0000","last_undegraded":"2024-05-11T01:14:47.188981+0000","last_fullsized":"2024-05-11T01:14:47.188981+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:32:22.587470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189594+0000","last_change":"2024-05-11T01:13:57.587045+0000","last_active":"2024-05-11T01:14:47.189594+0000","last_peered":"2024-05-11T01:14:47.189594+0000","last_clean":"2024-05-11T01:14:47.189594+0000","last_became_active":"2024-05-11T01:13:57.586787+0000","last_became_peered":"2024-05-11T01:13:57.586787+0000","last_unstale":"2024-05-11T01:14:47.189594+0000","last_undegraded":"2024-05-11T01:14:47.189594+0000","last_fullsized":"2024-05-11T01:14:47.189594+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189713+0000","last_change":"2024-05-11T01:13:57.587253+0000","last_active":"2024-05-11T01:14:47.189713+0000","last_peered":"2024-05-11T01:14:47.189713+0000","last_clean":"2024-05-11T01:14:47.189713+0000","last_became_active":"2024-05-11T01:13:57.586646+0000","last_became_peered":"2024-05-11T01:13:57.586646+0000","last_unstale":"2024-05-11T01:14:47.189713+0000","last_undegraded":"2024-05-11T01:14:47.189713+0000","last_fullsized":"2024-05-11T01:14:47.189713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189903+0000","last_change":"2024-05-11T01:13:57.587659+0000","last_active":"2024-05-11T01:14:47.189903+0000","last_peered":"2024-05-11T01:14:47.189903+0000","last_clean":"2024-05-11T01:14:47.189903+0000","last_became_active":"2024-05-11T01:13:57.587368+0000","last_became_peered":"2024-05-11T01:13:57.587368+0000","last_unstale":"2024-05-11T01:14:47.189903+0000","last_undegraded":"2024-05-11T01:14:47.189903+0000","last_fullsized":"2024-05-11T01:14:47.189903+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286908+0000","last_change":"2024-05-11T01:13:57.584583+0000","last_active":"2024-05-11T01:14:46.286908+0000","last_peered":"2024-05-11T01:14:46.286908+0000","last_clean":"2024-05-11T01:14:46.286908+0000","last_became_active":"2024-05-11T01:13:57.584324+0000","last_became_peered":"2024-05-11T01:13:57.584324+0000","last_unstale":"2024-05-11T01:14:46.286908+0000","last_undegraded":"2024-05-11T01:14:46.286908+0000","last_fullsized":"2024-05-11T01:14:46.286908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:39:33.068502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283756+0000","last_change":"2024-05-11T01:13:57.577183+0000","last_active":"2024-05-11T01:14:46.283756+0000","last_peered":"2024-05-11T01:14:46.283756+0000","last_clean":"2024-05-11T01:14:46.283756+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:14:46.283756+0000","last_undegraded":"2024-05-11T01:14:46.283756+0000","last_fullsized":"2024-05-11T01:14:46.283756+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:22:44.895342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.342397+0000","last_change":"2024-05-11T01:14:46.342397+0000","last_active":"2024-05-11T01:14:46.342397+0000","last_peered":"2024-05-11T01:14:46.342397+0000","last_clean":"2024-05-11T01:14:46.342397+0000","last_became_active":"2024-05-11T01:14:46.342122+0000","last_became_peered":"2024-05-11T01:14:46.342122+0000","last_unstale":"2024-05-11T01:14:46.342397+0000","last_undegraded":"2024-05-11T01:14:46.342397+0000","last_fullsized":"2024-05-11T01:14:46.342397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:01:11.288206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776260+0000","last_change":"2024-05-11T01:13:57.572461+0000","last_active":"2024-05-11T01:14:46.776260+0000","last_peered":"2024-05-11T01:14:46.776260+0000","last_clean":"2024-05-11T01:14:46.776260+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:14:46.776260+0000","last_undegraded":"2024-05-11T01:14:46.776260+0000","last_fullsized":"2024-05-11T01:14:46.776260+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:14:31.437203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286984+0000","last_change":"2024-05-11T01:13:57.587648+0000","last_active":"2024-05-11T01:14:46.286984+0000","last_peered":"2024-05-11T01:14:46.286984+0000","last_clean":"2024-05-11T01:14:46.286984+0000","last_became_active":"2024-05-11T01:13:57.587111+0000","last_became_peered":"2024-05-11T01:13:57.587111+0000","last_unstale":"2024-05-11T01:14:46.286984+0000","last_undegraded":"2024-05-11T01:14:46.286984+0000","last_fullsized":"2024-05-11T01:14:46.286984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284670+0000","last_change":"2024-05-11T01:13:57.580387+0000","last_active":"2024-05-11T01:14:46.284670+0000","last_peered":"2024-05-11T01:14:46.284670+0000","last_clean":"2024-05-11T01:14:46.284670+0000","last_became_active":"2024-05-11T01:13:57.580071+0000","last_became_peered":"2024-05-11T01:13:57.580071+0000","last_unstale":"2024-05-11T01:14:46.284670+0000","last_undegraded":"2024-05-11T01:14:46.284670+0000","last_fullsized":"2024-05-11T01:14:46.284670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:23:20.774634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284854+0000","last_change":"2024-05-11T01:13:57.591548+0000","last_active":"2024-05-11T01:14:46.284854+0000","last_peered":"2024-05-11T01:14:46.284854+0000","last_clean":"2024-05-11T01:14:46.284854+0000","last_became_active":"2024-05-11T01:13:57.591258+0000","last_became_peered":"2024-05-11T01:13:57.591258+0000","last_unstale":"2024-05-11T01:14:46.284854+0000","last_undegraded":"2024-05-11T01:14:46.284854+0000","last_fullsized":"2024-05-11T01:14:46.284854+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:35:06.829596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.289685+0000","last_change":"2024-05-11T01:14:46.289685+0000","last_active":"2024-05-11T01:14:46.289685+0000","last_peered":"2024-05-11T01:14:46.289685+0000","last_clean":"2024-05-11T01:14:46.289685+0000","last_became_active":"2024-05-11T01:14:46.289402+0000","last_became_peered":"2024-05-11T01:14:46.289402+0000","last_unstale":"2024-05-11T01:14:46.289685+0000","last_undegraded":"2024-05-11T01:14:46.289685+0000","last_fullsized":"2024-05-11T01:14:46.289685+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:34:21.164320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283990+0000","last_change":"2024-05-11T01:13:57.591249+0000","last_active":"2024-05-11T01:14:46.283990+0000","last_peered":"2024-05-11T01:14:46.283990+0000","last_clean":"2024-05-11T01:14:46.283990+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:14:46.283990+0000","last_undegraded":"2024-05-11T01:14:46.283990+0000","last_fullsized":"2024-05-11T01:14:46.283990+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:08:22.601079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776383+0000","last_change":"2024-05-11T01:13:57.581635+0000","last_active":"2024-05-11T01:14:46.776383+0000","last_peered":"2024-05-11T01:14:46.776383+0000","last_clean":"2024-05-11T01:14:46.776383+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:14:46.776383+0000","last_undegraded":"2024-05-11T01:14:46.776383+0000","last_fullsized":"2024-05-11T01:14:46.776383+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:14.120977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189389+0000","last_change":"2024-05-11T01:13:57.585351+0000","last_active":"2024-05-11T01:14:47.189389+0000","last_peered":"2024-05-11T01:14:47.189389+0000","last_clean":"2024-05-11T01:14:47.189389+0000","last_became_active":"2024-05-11T01:13:57.585036+0000","last_became_peered":"2024-05-11T01:13:57.585036+0000","last_unstale":"2024-05-11T01:14:47.189389+0000","last_undegraded":"2024-05-11T01:14:47.189389+0000","last_fullsized":"2024-05-11T01:14:47.189389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287134+0000","last_change":"2024-05-11T01:13:57.579302+0000","last_active":"2024-05-11T01:14:46.287134+0000","last_peered":"2024-05-11T01:14:46.287134+0000","last_clean":"2024-05-11T01:14:46.287134+0000","last_became_active":"2024-05-11T01:13:57.578993+0000","last_became_peered":"2024-05-11T01:13:57.578993+0000","last_unstale":"2024-05-11T01:14:46.287134+0000","last_undegraded":"2024-05-11T01:14:46.287134+0000","last_fullsized":"2024-05-11T01:14:46.287134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287076+0000","last_change":"2024-05-11T01:13:57.578977+0000","last_active":"2024-05-11T01:14:46.287076+0000","last_peered":"2024-05-11T01:14:46.287076+0000","last_clean":"2024-05-11T01:14:46.287076+0000","last_became_active":"2024-05-11T01:13:57.578695+0000","last_became_peered":"2024-05-11T01:13:57.578695+0000","last_unstale":"2024-05-11T01:14:46.287076+0000","last_undegraded":"2024-05-11T01:14:46.287076+0000","last_fullsized":"2024-05-11T01:14:46.287076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:35:47.438149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287690+0000","last_change":"2024-05-11T01:13:57.577301+0000","last_active":"2024-05-11T01:14:46.287690+0000","last_peered":"2024-05-11T01:14:46.287690+0000","last_clean":"2024-05-11T01:14:46.287690+0000","last_became_active":"2024-05-11T01:13:57.576996+0000","last_became_peered":"2024-05-11T01:13:57.576996+0000","last_unstale":"2024-05-11T01:14:46.287690+0000","last_undegraded":"2024-05-11T01:14:46.287690+0000","last_fullsized":"2024-05-11T01:14:46.287690+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:52:30.583524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284000+0000","last_change":"2024-05-11T01:13:57.579927+0000","last_active":"2024-05-11T01:14:46.284000+0000","last_peered":"2024-05-11T01:14:46.284000+0000","last_clean":"2024-05-11T01:14:46.284000+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:14:46.284000+0000","last_undegraded":"2024-05-11T01:14:46.284000+0000","last_fullsized":"2024-05-11T01:14:46.284000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:21:50.459972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284000+0000","last_change":"2024-05-11T01:13:57.577630+0000","last_active":"2024-05-11T01:14:46.284000+0000","last_peered":"2024-05-11T01:14:46.284000+0000","last_clean":"2024-05-11T01:14:46.284000+0000","last_became_active":"2024-05-11T01:13:57.577363+0000","last_became_peered":"2024-05-11T01:13:57.577363+0000","last_unstale":"2024-05-11T01:14:46.284000+0000","last_undegraded":"2024-05-11T01:14:46.284000+0000","last_fullsized":"2024-05-11T01:14:46.284000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:45:17.071449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287030+0000","last_change":"2024-05-11T01:13:57.584410+0000","last_active":"2024-05-11T01:14:46.287030+0000","last_peered":"2024-05-11T01:14:46.287030+0000","last_clean":"2024-05-11T01:14:46.287030+0000","last_became_active":"2024-05-11T01:13:57.584164+0000","last_became_peered":"2024-05-11T01:13:57.584164+0000","last_unstale":"2024-05-11T01:14:46.287030+0000","last_undegraded":"2024-05-11T01:14:46.287030+0000","last_fullsized":"2024-05-11T01:14:46.287030+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:57.382038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287343+0000","last_change":"2024-05-11T01:13:57.576284+0000","last_active":"2024-05-11T01:14:46.287343+0000","last_peered":"2024-05-11T01:14:46.287343+0000","last_clean":"2024-05-11T01:14:46.287343+0000","last_became_active":"2024-05-11T01:13:57.575987+0000","last_became_peered":"2024-05-11T01:13:57.575987+0000","last_unstale":"2024-05-11T01:14:46.287343+0000","last_undegraded":"2024-05-11T01:14:46.287343+0000","last_fullsized":"2024-05-11T01:14:46.287343+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:32:18.908780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284095+0000","last_change":"2024-05-11T01:13:57.577419+0000","last_active":"2024-05-11T01:14:46.284095+0000","last_peered":"2024-05-11T01:14:46.284095+0000","last_clean":"2024-05-11T01:14:46.284095+0000","last_became_active":"2024-05-11T01:13:57.576839+0000","last_became_peered":"2024-05-11T01:13:57.576839+0000","last_unstale":"2024-05-11T01:14:46.284095+0000","last_undegraded":"2024-05-11T01:14:46.284095+0000","last_fullsized":"2024-05-11T01:14:46.284095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:40:40.812341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776393+0000","last_change":"2024-05-11T01:13:57.578349+0000","last_active":"2024-05-11T01:14:46.776393+0000","last_peered":"2024-05-11T01:14:46.776393+0000","last_clean":"2024-05-11T01:14:46.776393+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:14:46.776393+0000","last_undegraded":"2024-05-11T01:14:46.776393+0000","last_fullsized":"2024-05-11T01:14:46.776393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:08.968382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283679+0000","last_change":"2024-05-11T01:13:57.576536+0000","last_active":"2024-05-11T01:14:46.283679+0000","last_peered":"2024-05-11T01:14:46.283679+0000","last_clean":"2024-05-11T01:14:46.283679+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:14:46.283679+0000","last_undegraded":"2024-05-11T01:14:46.283679+0000","last_fullsized":"2024-05-11T01:14:46.283679+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:43:42.479176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341554+0000","last_change":"2024-05-11T01:13:57.574297+0000","last_active":"2024-05-11T01:14:46.341554+0000","last_peered":"2024-05-11T01:14:46.341554+0000","last_clean":"2024-05-11T01:14:46.341554+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:14:46.341554+0000","last_undegraded":"2024-05-11T01:14:46.341554+0000","last_fullsized":"2024-05-11T01:14:46.341554+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:19:29.558619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"58'4","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776851+0000","last_change":"2024-05-11T01:13:56.581273+0000","last_active":"2024-05-11T01:14:46.776851+0000","last_peered":"2024-05-11T01:14:46.776851+0000","last_clean":"2024-05-11T01:14:46.776851+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:14:46.776851+0000","last_undegraded":"2024-05-11T01:14:46.776851+0000","last_fullsized":"2024-05-11T01:14:46.776851+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:26:08.221664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287789+0000","last_change":"2024-05-11T01:13:57.572345+0000","last_active":"2024-05-11T01:14:46.287789+0000","last_peered":"2024-05-11T01:14:46.287789+0000","last_clean":"2024-05-11T01:14:46.287789+0000","last_became_active":"2024-05-11T01:13:57.572038+0000","last_became_peered":"2024-05-11T01:13:57.572038+0000","last_unstale":"2024-05-11T01:14:46.287789+0000","last_undegraded":"2024-05-11T01:14:46.287789+0000","last_fullsized":"2024-05-11T01:14:46.287789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285033+0000","last_change":"2024-05-11T01:13:56.576801+0000","last_active":"2024-05-11T01:14:46.285033+0000","last_peered":"2024-05-11T01:14:46.285033+0000","last_clean":"2024-05-11T01:14:46.285033+0000","last_became_active":"2024-05-11T01:13:56.576512+0000","last_became_peered":"2024-05-11T01:13:56.576512+0000","last_unstale":"2024-05-11T01:14:46.285033+0000","last_undegraded":"2024-05-11T01:14:46.285033+0000","last_fullsized":"2024-05-11T01:14:46.285033+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287076+0000","last_change":"2024-05-11T01:13:57.576538+0000","last_active":"2024-05-11T01:14:46.287076+0000","last_peered":"2024-05-11T01:14:46.287076+0000","last_clean":"2024-05-11T01:14:46.287076+0000","last_became_active":"2024-05-11T01:13:57.576234+0000","last_became_peered":"2024-05-11T01:13:57.576234+0000","last_unstale":"2024-05-11T01:14:46.287076+0000","last_undegraded":"2024-05-11T01:14:46.287076+0000","last_fullsized":"2024-05-11T01:14:46.287076+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:05:14.944546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341642+0000","last_change":"2024-05-11T01:13:56.575205+0000","last_active":"2024-05-11T01:14:46.341642+0000","last_peered":"2024-05-11T01:14:46.341642+0000","last_clean":"2024-05-11T01:14:46.341642+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:14:46.341642+0000","last_undegraded":"2024-05-11T01:14:46.341642+0000","last_fullsized":"2024-05-11T01:14:46.341642+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:14:30.550696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341541+0000","last_change":"2024-05-11T01:13:57.577041+0000","last_active":"2024-05-11T01:14:46.341541+0000","last_peered":"2024-05-11T01:14:46.341541+0000","last_clean":"2024-05-11T01:14:46.341541+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:14:46.341541+0000","last_undegraded":"2024-05-11T01:14:46.341541+0000","last_fullsized":"2024-05-11T01:14:46.341541+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:10:38.921303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284213+0000","last_change":"2024-05-11T01:13:56.578882+0000","last_active":"2024-05-11T01:14:46.284213+0000","last_peered":"2024-05-11T01:14:46.284213+0000","last_clean":"2024-05-11T01:14:46.284213+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:14:46.284213+0000","last_undegraded":"2024-05-11T01:14:46.284213+0000","last_fullsized":"2024-05-11T01:14:46.284213+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:49.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284140+0000","last_change":"2024-05-11T01:13:57.578580+0000","last_active":"2024-05-11T01:14:46.284140+0000","last_peered":"2024-05-11T01:14:46.284140+0000","last_clean":"2024-05-11T01:14:46.284140+0000","last_became_active":"2024-05-11T01:13:57.578287+0000","last_became_peered":"2024-05-11T01:13:57.578287+0000","last_unstale":"2024-05-11T01:14:46.284140+0000","last_undegraded":"2024-05-11T01:14:46.284140+0000","last_fullsized":"2024-05-11T01:14:46.284140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:39:09.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776539+0000","last_change":"2024-05-11T01:13:56.575181+0000","last_active":"2024-05-11T01:14:46.776539+0000","last_peered":"2024-05-11T01:14:46.776539+0000","last_clean":"2024-05-11T01:14:46.776539+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:14:46.776539+0000","last_undegraded":"2024-05-11T01:14:46.776539+0000","last_fullsized":"2024-05-11T01:14:46.776539+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:27:32.595573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189336+0000","last_change":"2024-05-11T01:13:57.591245+0000","last_active":"2024-05-11T01:14:47.189336+0000","last_peered":"2024-05-11T01:14:47.189336+0000","last_clean":"2024-05-11T01:14:47.189336+0000","last_became_active":"2024-05-11T01:13:57.590734+0000","last_became_peered":"2024-05-11T01:13:57.590734+0000","last_unstale":"2024-05-11T01:14:47.189336+0000","last_undegraded":"2024-05-11T01:14:47.189336+0000","last_fullsized":"2024-05-11T01:14:47.189336+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:06:40.266391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"58'1","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284243+0000","last_change":"2024-05-11T01:13:56.574294+0000","last_active":"2024-05-11T01:14:46.284243+0000","last_peered":"2024-05-11T01:14:46.284243+0000","last_clean":"2024-05-11T01:14:46.284243+0000","last_became_active":"2024-05-11T01:13:56.574005+0000","last_became_peered":"2024-05-11T01:13:56.574005+0000","last_unstale":"2024-05-11T01:14:46.284243+0000","last_undegraded":"2024-05-11T01:14:46.284243+0000","last_fullsized":"2024-05-11T01:14:46.284243+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:10:19.793450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189029+0000","last_change":"2024-05-11T01:13:57.584809+0000","last_active":"2024-05-11T01:14:47.189029+0000","last_peered":"2024-05-11T01:14:47.189029+0000","last_clean":"2024-05-11T01:14:47.189029+0000","last_became_active":"2024-05-11T01:13:57.584406+0000","last_became_peered":"2024-05-11T01:13:57.584406+0000","last_unstale":"2024-05-11T01:14:47.189029+0000","last_undegraded":"2024-05-11T01:14:47.189029+0000","last_fullsized":"2024-05-11T01:14:47.189029+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:22:38.509581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286737+0000","last_change":"2024-05-11T01:13:56.573597+0000","last_active":"2024-05-11T01:14:46.286737+0000","last_peered":"2024-05-11T01:14:46.286737+0000","last_clean":"2024-05-11T01:14:46.286737+0000","last_became_active":"2024-05-11T01:13:56.573279+0000","last_became_peered":"2024-05-11T01:13:56.573279+0000","last_unstale":"2024-05-11T01:14:46.286737+0000","last_undegraded":"2024-05-11T01:14:46.286737+0000","last_fullsized":"2024-05-11T01:14:46.286737+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:16:43.996372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287040+0000","last_change":"2024-05-11T01:13:57.579325+0000","last_active":"2024-05-11T01:14:46.287040+0000","last_peered":"2024-05-11T01:14:46.287040+0000","last_clean":"2024-05-11T01:14:46.287040+0000","last_became_active":"2024-05-11T01:13:57.578950+0000","last_became_peered":"2024-05-11T01:13:57.578950+0000","last_unstale":"2024-05-11T01:14:46.287040+0000","last_undegraded":"2024-05-11T01:14:46.287040+0000","last_fullsized":"2024-05-11T01:14:46.287040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189121+0000","last_change":"2024-05-11T01:13:56.572658+0000","last_active":"2024-05-11T01:14:47.189121+0000","last_peered":"2024-05-11T01:14:47.189121+0000","last_clean":"2024-05-11T01:14:47.189121+0000","last_became_active":"2024-05-11T01:13:56.572329+0000","last_became_peered":"2024-05-11T01:13:56.572329+0000","last_unstale":"2024-05-11T01:14:47.189121+0000","last_undegraded":"2024-05-11T01:14:47.189121+0000","last_fullsized":"2024-05-11T01:14:47.189121+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:07:43.968105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284929+0000","last_change":"2024-05-11T01:13:57.590749+0000","last_active":"2024-05-11T01:14:46.284929+0000","last_peered":"2024-05-11T01:14:46.284929+0000","last_clean":"2024-05-11T01:14:46.284929+0000","last_became_active":"2024-05-11T01:13:57.590241+0000","last_became_peered":"2024-05-11T01:13:57.590241+0000","last_unstale":"2024-05-11T01:14:46.284929+0000","last_undegraded":"2024-05-11T01:14:46.284929+0000","last_fullsized":"2024-05-11T01:14:46.284929+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:07:21.860466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284838+0000","last_change":"2024-05-11T01:13:56.571495+0000","last_active":"2024-05-11T01:14:46.284838+0000","last_peered":"2024-05-11T01:14:46.284838+0000","last_clean":"2024-05-11T01:14:46.284838+0000","last_became_active":"2024-05-11T01:13:56.571211+0000","last_became_peered":"2024-05-11T01:13:56.571211+0000","last_unstale":"2024-05-11T01:14:46.284838+0000","last_undegraded":"2024-05-11T01:14:46.284838+0000","last_fullsized":"2024-05-11T01:14:46.284838+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:26:54.553975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285270+0000","last_change":"2024-05-11T01:13:57.580458+0000","last_active":"2024-05-11T01:14:46.285270+0000","last_peered":"2024-05-11T01:14:46.285270+0000","last_clean":"2024-05-11T01:14:46.285270+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:14:46.285270+0000","last_undegraded":"2024-05-11T01:14:46.285270+0000","last_fullsized":"2024-05-11T01:14:46.285270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:04:46.054505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189839+0000","last_change":"2024-05-11T01:13:56.576731+0000","last_active":"2024-05-11T01:14:47.189839+0000","last_peered":"2024-05-11T01:14:47.189839+0000","last_clean":"2024-05-11T01:14:47.189839+0000","last_became_active":"2024-05-11T01:13:56.576163+0000","last_became_peered":"2024-05-11T01:13:56.576163+0000","last_unstale":"2024-05-11T01:14:47.189839+0000","last_undegraded":"2024-05-11T01:14:47.189839+0000","last_fullsized":"2024-05-11T01:14:47.189839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:38:23.827988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776622+0000","last_change":"2024-05-11T01:13:57.577568+0000","last_active":"2024-05-11T01:14:46.776622+0000","last_peered":"2024-05-11T01:14:46.776622+0000","last_clean":"2024-05-11T01:14:46.776622+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:14:46.776622+0000","last_undegraded":"2024-05-11T01:14:46.776622+0000","last_fullsized":"2024-05-11T01:14:46.776622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:52.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"58'3","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285139+0000","last_change":"2024-05-11T01:13:56.577136+0000","last_active":"2024-05-11T01:14:46.285139+0000","last_peered":"2024-05-11T01:14:46.285139+0000","last_clean":"2024-05-11T01:14:46.285139+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:14:46.285139+0000","last_undegraded":"2024-05-11T01:14:46.285139+0000","last_fullsized":"2024-05-11T01:14:46.285139+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:13.115684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284390+0000","last_change":"2024-05-11T01:13:57.578847+0000","last_active":"2024-05-11T01:14:46.284390+0000","last_peered":"2024-05-11T01:14:46.284390+0000","last_clean":"2024-05-11T01:14:46.284390+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:14:46.284390+0000","last_undegraded":"2024-05-11T01:14:46.284390+0000","last_fullsized":"2024-05-11T01:14:46.284390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:46:36.963140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'11","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:09.720950+0000","last_change":"2024-05-11T01:13:56.576612+0000","last_active":"2024-05-11T01:16:09.720950+0000","last_peered":"2024-05-11T01:16:09.720950+0000","last_clean":"2024-05-11T01:16:09.720950+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:16:09.720950+0000","last_undegraded":"2024-05-11T01:16:09.720950+0000","last_fullsized":"2024-05-11T01:16:09.720950+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:43:48.758010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287250+0000","last_change":"2024-05-11T01:13:57.587446+0000","last_active":"2024-05-11T01:14:46.287250+0000","last_peered":"2024-05-11T01:14:46.287250+0000","last_clean":"2024-05-11T01:14:46.287250+0000","last_became_active":"2024-05-11T01:13:57.587034+0000","last_became_peered":"2024-05-11T01:13:57.587034+0000","last_unstale":"2024-05-11T01:14:46.287250+0000","last_undegraded":"2024-05-11T01:14:46.287250+0000","last_fullsized":"2024-05-11T01:14:46.287250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:40:51.169562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"58'2","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776593+0000","last_change":"2024-05-11T01:13:56.579530+0000","last_active":"2024-05-11T01:14:46.776593+0000","last_peered":"2024-05-11T01:14:46.776593+0000","last_clean":"2024-05-11T01:14:46.776593+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:14:46.776593+0000","last_undegraded":"2024-05-11T01:14:46.776593+0000","last_fullsized":"2024-05-11T01:14:46.776593+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:24:40.643431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189401+0000","last_change":"2024-05-11T01:13:57.589755+0000","last_active":"2024-05-11T01:14:47.189401+0000","last_peered":"2024-05-11T01:14:47.189401+0000","last_clean":"2024-05-11T01:14:47.189401+0000","last_became_active":"2024-05-11T01:13:57.589439+0000","last_became_peered":"2024-05-11T01:13:57.589439+0000","last_unstale":"2024-05-11T01:14:47.189401+0000","last_undegraded":"2024-05-11T01:14:47.189401+0000","last_fullsized":"2024-05-11T01:14:47.189401+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284299+0000","last_change":"2024-05-11T01:13:56.570421+0000","last_active":"2024-05-11T01:14:46.284299+0000","last_peered":"2024-05-11T01:14:46.284299+0000","last_clean":"2024-05-11T01:14:46.284299+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:14:46.284299+0000","last_undegraded":"2024-05-11T01:14:46.284299+0000","last_fullsized":"2024-05-11T01:14:46.284299+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:24.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776250+0000","last_change":"2024-05-11T01:13:57.577363+0000","last_active":"2024-05-11T01:14:46.776250+0000","last_peered":"2024-05-11T01:14:46.776250+0000","last_clean":"2024-05-11T01:14:46.776250+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:14:46.776250+0000","last_undegraded":"2024-05-11T01:14:46.776250+0000","last_fullsized":"2024-05-11T01:14:46.776250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:22:06.053759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776435+0000","last_change":"2024-05-11T01:13:56.579496+0000","last_active":"2024-05-11T01:14:46.776435+0000","last_peered":"2024-05-11T01:14:46.776435+0000","last_clean":"2024-05-11T01:14:46.776435+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:14:46.776435+0000","last_undegraded":"2024-05-11T01:14:46.776435+0000","last_fullsized":"2024-05-11T01:14:46.776435+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284175+0000","last_change":"2024-05-11T01:13:57.572047+0000","last_active":"2024-05-11T01:14:46.284175+0000","last_peered":"2024-05-11T01:14:46.284175+0000","last_clean":"2024-05-11T01:14:46.284175+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:14:46.284175+0000","last_undegraded":"2024-05-11T01:14:46.284175+0000","last_fullsized":"2024-05-11T01:14:46.284175+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:57:04.869128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"58'8","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189203+0000","last_change":"2024-05-11T01:13:56.576267+0000","last_active":"2024-05-11T01:14:47.189203+0000","last_peered":"2024-05-11T01:14:47.189203+0000","last_clean":"2024-05-11T01:14:47.189203+0000","last_became_active":"2024-05-11T01:13:56.575422+0000","last_became_peered":"2024-05-11T01:13:56.575422+0000","last_unstale":"2024-05-11T01:14:47.189203+0000","last_undegraded":"2024-05-11T01:14:47.189203+0000","last_fullsized":"2024-05-11T01:14:47.189203+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:46:03.149087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283932+0000","last_change":"2024-05-11T01:13:57.579696+0000","last_active":"2024-05-11T01:14:46.283932+0000","last_peered":"2024-05-11T01:14:46.283932+0000","last_clean":"2024-05-11T01:14:46.283932+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:14:46.283932+0000","last_undegraded":"2024-05-11T01:14:46.283932+0000","last_fullsized":"2024-05-11T01:14:46.283932+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:25:35.579492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284079+0000","last_change":"2024-05-11T01:13:56.572880+0000","last_active":"2024-05-11T01:14:46.284079+0000","last_peered":"2024-05-11T01:14:46.284079+0000","last_clean":"2024-05-11T01:14:46.284079+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:14:46.284079+0000","last_undegraded":"2024-05-11T01:14:46.284079+0000","last_fullsized":"2024-05-11T01:14:46.284079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:09:53.078730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189698+0000","last_change":"2024-05-11T01:13:57.589024+0000","last_active":"2024-05-11T01:14:47.189698+0000","last_peered":"2024-05-11T01:14:47.189698+0000","last_clean":"2024-05-11T01:14:47.189698+0000","last_became_active":"2024-05-11T01:13:57.588641+0000","last_became_peered":"2024-05-11T01:13:57.588641+0000","last_unstale":"2024-05-11T01:14:47.189698+0000","last_undegraded":"2024-05-11T01:14:47.189698+0000","last_fullsized":"2024-05-11T01:14:47.189698+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:34.282722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285092+0000","last_change":"2024-05-11T01:13:56.571741+0000","last_active":"2024-05-11T01:14:46.285092+0000","last_peered":"2024-05-11T01:14:46.285092+0000","last_clean":"2024-05-11T01:14:46.285092+0000","last_became_active":"2024-05-11T01:13:56.571143+0000","last_became_peered":"2024-05-11T01:13:56.571143+0000","last_unstale":"2024-05-11T01:14:46.285092+0000","last_undegraded":"2024-05-11T01:14:46.285092+0000","last_fullsized":"2024-05-11T01:14:46.285092+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287406+0000","last_change":"2024-05-11T01:13:57.573076+0000","last_active":"2024-05-11T01:14:46.287406+0000","last_peered":"2024-05-11T01:14:46.287406+0000","last_clean":"2024-05-11T01:14:46.287406+0000","last_became_active":"2024-05-11T01:13:57.572777+0000","last_became_peered":"2024-05-11T01:13:57.572777+0000","last_unstale":"2024-05-11T01:14:46.287406+0000","last_undegraded":"2024-05-11T01:14:46.287406+0000","last_fullsized":"2024-05-11T01:14:46.287406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:43:50.595866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"58'1","reported_seq":20,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287538+0000","last_change":"2024-05-11T01:13:56.573996+0000","last_active":"2024-05-11T01:14:46.287538+0000","last_peered":"2024-05-11T01:14:46.287538+0000","last_clean":"2024-05-11T01:14:46.287538+0000","last_became_active":"2024-05-11T01:13:56.573737+0000","last_became_peered":"2024-05-11T01:13:56.573737+0000","last_unstale":"2024-05-11T01:14:46.287538+0000","last_undegraded":"2024-05-11T01:14:46.287538+0000","last_fullsized":"2024-05-11T01:14:46.287538+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287575+0000","last_change":"2024-05-11T01:13:57.577270+0000","last_active":"2024-05-11T01:14:46.287575+0000","last_peered":"2024-05-11T01:14:46.287575+0000","last_clean":"2024-05-11T01:14:46.287575+0000","last_became_active":"2024-05-11T01:13:57.576978+0000","last_became_peered":"2024-05-11T01:13:57.576978+0000","last_unstale":"2024-05-11T01:14:46.287575+0000","last_undegraded":"2024-05-11T01:14:46.287575+0000","last_fullsized":"2024-05-11T01:14:46.287575+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:28:09.256513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776756+0000","last_change":"2024-05-11T01:13:56.576926+0000","last_active":"2024-05-11T01:14:46.776756+0000","last_peered":"2024-05-11T01:14:46.776756+0000","last_clean":"2024-05-11T01:14:46.776756+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:14:46.776756+0000","last_undegraded":"2024-05-11T01:14:46.776756+0000","last_fullsized":"2024-05-11T01:14:46.776756+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:56:12.073465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776445+0000","last_change":"2024-05-11T01:13:57.577484+0000","last_active":"2024-05-11T01:14:46.776445+0000","last_peered":"2024-05-11T01:14:46.776445+0000","last_clean":"2024-05-11T01:14:46.776445+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:14:46.776445+0000","last_undegraded":"2024-05-11T01:14:46.776445+0000","last_fullsized":"2024-05-11T01:14:46.776445+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:02:51.004964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776830+0000","last_change":"2024-05-11T01:13:56.574465+0000","last_active":"2024-05-11T01:14:46.776830+0000","last_peered":"2024-05-11T01:14:46.776830+0000","last_clean":"2024-05-11T01:14:46.776830+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:14:46.776830+0000","last_undegraded":"2024-05-11T01:14:46.776830+0000","last_fullsized":"2024-05-11T01:14:46.776830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:12:07.180777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341240+0000","last_change":"2024-05-11T01:13:57.578265+0000","last_active":"2024-05-11T01:14:46.341240+0000","last_peered":"2024-05-11T01:14:46.341240+0000","last_clean":"2024-05-11T01:14:46.341240+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:14:46.341240+0000","last_undegraded":"2024-05-11T01:14:46.341240+0000","last_fullsized":"2024-05-11T01:14:46.341240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:01:25.875348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287365+0000","last_change":"2024-05-11T01:13:56.581631+0000","last_active":"2024-05-11T01:14:46.287365+0000","last_peered":"2024-05-11T01:14:46.287365+0000","last_clean":"2024-05-11T01:14:46.287365+0000","last_became_active":"2024-05-11T01:13:56.581299+0000","last_became_peered":"2024-05-11T01:13:56.581299+0000","last_unstale":"2024-05-11T01:14:46.287365+0000","last_undegraded":"2024-05-11T01:14:46.287365+0000","last_fullsized":"2024-05-11T01:14:46.287365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:35:01.793210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283707+0000","last_change":"2024-05-11T01:13:57.566550+0000","last_active":"2024-05-11T01:14:46.283707+0000","last_peered":"2024-05-11T01:14:46.283707+0000","last_clean":"2024-05-11T01:14:46.283707+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:14:46.283707+0000","last_undegraded":"2024-05-11T01:14:46.283707+0000","last_fullsized":"2024-05-11T01:14:46.283707+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:03.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189307+0000","last_change":"2024-05-11T01:13:56.575003+0000","last_active":"2024-05-11T01:14:47.189307+0000","last_peered":"2024-05-11T01:14:47.189307+0000","last_clean":"2024-05-11T01:14:47.189307+0000","last_became_active":"2024-05-11T01:13:56.574726+0000","last_became_peered":"2024-05-11T01:13:56.574726+0000","last_unstale":"2024-05-11T01:14:47.189307+0000","last_undegraded":"2024-05-11T01:14:47.189307+0000","last_fullsized":"2024-05-11T01:14:47.189307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:15:10.911003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189149+0000","last_change":"2024-05-11T01:13:57.576056+0000","last_active":"2024-05-11T01:14:47.189149+0000","last_peered":"2024-05-11T01:14:47.189149+0000","last_clean":"2024-05-11T01:14:47.189149+0000","last_became_active":"2024-05-11T01:13:57.575723+0000","last_became_peered":"2024-05-11T01:13:57.575723+0000","last_unstale":"2024-05-11T01:14:47.189149+0000","last_undegraded":"2024-05-11T01:14:47.189149+0000","last_fullsized":"2024-05-11T01:14:47.189149+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:23:18.980085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284012+0000","last_change":"2024-05-11T01:13:56.572002+0000","last_active":"2024-05-11T01:14:46.284012+0000","last_peered":"2024-05-11T01:14:46.284012+0000","last_clean":"2024-05-11T01:14:46.284012+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:14:46.284012+0000","last_undegraded":"2024-05-11T01:14:46.284012+0000","last_fullsized":"2024-05-11T01:14:46.284012+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:47:51.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287887+0000","last_change":"2024-05-11T01:13:57.587557+0000","last_active":"2024-05-11T01:14:46.287887+0000","last_peered":"2024-05-11T01:14:46.287887+0000","last_clean":"2024-05-11T01:14:46.287887+0000","last_became_active":"2024-05-11T01:13:57.587255+0000","last_became_peered":"2024-05-11T01:13:57.587255+0000","last_unstale":"2024-05-11T01:14:46.287887+0000","last_undegraded":"2024-05-11T01:14:46.287887+0000","last_fullsized":"2024-05-11T01:14:46.287887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:55:49.649677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"61'3","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:06.168128+0000","last_change":"2024-05-11T01:13:56.569719+0000","last_active":"2024-05-11T01:16:06.168128+0000","last_peered":"2024-05-11T01:16:06.168128+0000","last_clean":"2024-05-11T01:16:06.168128+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:16:06.168128+0000","last_undegraded":"2024-05-11T01:16:06.168128+0000","last_fullsized":"2024-05-11T01:16:06.168128+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:31.676051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189623+0000","last_change":"2024-05-11T01:13:57.588129+0000","last_active":"2024-05-11T01:14:47.189623+0000","last_peered":"2024-05-11T01:14:47.189623+0000","last_clean":"2024-05-11T01:14:47.189623+0000","last_became_active":"2024-05-11T01:13:57.577948+0000","last_became_peered":"2024-05-11T01:13:57.577948+0000","last_unstale":"2024-05-11T01:14:47.189623+0000","last_undegraded":"2024-05-11T01:14:47.189623+0000","last_fullsized":"2024-05-11T01:14:47.189623+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:12:46.084292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285353+0000","last_change":"2024-05-11T01:13:56.581361+0000","last_active":"2024-05-11T01:14:46.285353+0000","last_peered":"2024-05-11T01:14:46.285353+0000","last_clean":"2024-05-11T01:14:46.285353+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:14:46.285353+0000","last_undegraded":"2024-05-11T01:14:46.285353+0000","last_fullsized":"2024-05-11T01:14:46.285353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:40:04.033751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.285181+0000","last_change":"2024-05-11T01:13:57.577408+0000","last_active":"2024-05-11T01:14:46.285181+0000","last_peered":"2024-05-11T01:14:46.285181+0000","last_clean":"2024-05-11T01:14:46.285181+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:14:46.285181+0000","last_undegraded":"2024-05-11T01:14:46.285181+0000","last_fullsized":"2024-05-11T01:14:46.285181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:01:35.115339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341392+0000","last_change":"2024-05-11T01:13:56.576240+0000","last_active":"2024-05-11T01:14:46.341392+0000","last_peered":"2024-05-11T01:14:46.341392+0000","last_clean":"2024-05-11T01:14:46.341392+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:14:46.341392+0000","last_undegraded":"2024-05-11T01:14:46.341392+0000","last_fullsized":"2024-05-11T01:14:46.341392+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:34:14.479816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776562+0000","last_change":"2024-05-11T01:13:57.579958+0000","last_active":"2024-05-11T01:14:46.776562+0000","last_peered":"2024-05-11T01:14:46.776562+0000","last_clean":"2024-05-11T01:14:46.776562+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:14:46.776562+0000","last_undegraded":"2024-05-11T01:14:46.776562+0000","last_fullsized":"2024-05-11T01:14:46.776562+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:11.535454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284511+0000","last_change":"2024-05-11T01:13:56.577155+0000","last_active":"2024-05-11T01:14:46.284511+0000","last_peered":"2024-05-11T01:14:46.284511+0000","last_clean":"2024-05-11T01:14:46.284511+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:14:46.284511+0000","last_undegraded":"2024-05-11T01:14:46.284511+0000","last_fullsized":"2024-05-11T01:14:46.284511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:44:10.530161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.776496+0000","last_change":"2024-05-11T01:13:57.578289+0000","last_active":"2024-05-11T01:14:46.776496+0000","last_peered":"2024-05-11T01:14:46.776496+0000","last_clean":"2024-05-11T01:14:46.776496+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:14:46.776496+0000","last_undegraded":"2024-05-11T01:14:46.776496+0000","last_fullsized":"2024-05-11T01:14:46.776496+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:48:25.040040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284370+0000","last_change":"2024-05-11T01:13:56.573647+0000","last_active":"2024-05-11T01:14:46.284370+0000","last_peered":"2024-05-11T01:14:46.284370+0000","last_clean":"2024-05-11T01:14:46.284370+0000","last_became_active":"2024-05-11T01:13:56.573347+0000","last_became_peered":"2024-05-11T01:13:56.573347+0000","last_unstale":"2024-05-11T01:14:46.284370+0000","last_undegraded":"2024-05-11T01:14:46.284370+0000","last_fullsized":"2024-05-11T01:14:46.284370+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:47:34.803535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.286760+0000","last_change":"2024-05-11T01:13:57.582673+0000","last_active":"2024-05-11T01:14:46.286760+0000","last_peered":"2024-05-11T01:14:46.286760+0000","last_clean":"2024-05-11T01:14:46.286760+0000","last_became_active":"2024-05-11T01:13:57.582398+0000","last_became_peered":"2024-05-11T01:13:57.582398+0000","last_unstale":"2024-05-11T01:14:46.286760+0000","last_undegraded":"2024-05-11T01:14:46.286760+0000","last_fullsized":"2024-05-11T01:14:46.286760+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:53:00.000306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.341258+0000","last_change":"2024-05-11T01:13:56.577053+0000","last_active":"2024-05-11T01:14:46.341258+0000","last_peered":"2024-05-11T01:14:46.341258+0000","last_clean":"2024-05-11T01:14:46.341258+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:14:46.341258+0000","last_undegraded":"2024-05-11T01:14:46.341258+0000","last_fullsized":"2024-05-11T01:14:46.341258+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:58:13.014779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.283991+0000","last_change":"2024-05-11T01:13:57.575506+0000","last_active":"2024-05-11T01:14:46.283991+0000","last_peered":"2024-05-11T01:14:46.283991+0000","last_clean":"2024-05-11T01:14:46.283991+0000","last_became_active":"2024-05-11T01:13:57.575239+0000","last_became_peered":"2024-05-11T01:13:57.575239+0000","last_unstale":"2024-05-11T01:14:46.283991+0000","last_undegraded":"2024-05-11T01:14:46.283991+0000","last_fullsized":"2024-05-11T01:14:46.283991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:33:02.113131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189357+0000","last_change":"2024-05-11T01:13:56.576345+0000","last_active":"2024-05-11T01:14:47.189357+0000","last_peered":"2024-05-11T01:14:47.189357+0000","last_clean":"2024-05-11T01:14:47.189357+0000","last_became_active":"2024-05-11T01:13:56.575838+0000","last_became_peered":"2024-05-11T01:13:56.575838+0000","last_unstale":"2024-05-11T01:14:47.189357+0000","last_undegraded":"2024-05-11T01:14:47.189357+0000","last_fullsized":"2024-05-11T01:14:47.189357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:12:51.632315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:47.189822+0000","last_change":"2024-05-11T01:13:57.588794+0000","last_active":"2024-05-11T01:14:47.189822+0000","last_peered":"2024-05-11T01:14:47.189822+0000","last_clean":"2024-05-11T01:14:47.189822+0000","last_became_active":"2024-05-11T01:13:57.586986+0000","last_became_peered":"2024-05-11T01:13:57.586986+0000","last_unstale":"2024-05-11T01:14:47.189822+0000","last_undegraded":"2024-05-11T01:14:47.189822+0000","last_fullsized":"2024-05-11T01:14:47.189822+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:56.549341+0000","last_clean_scrub_stamp":"2024-05-11T01:13:56.549341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:00:28.690447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"58'2","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.287873+0000","last_change":"2024-05-11T01:13:56.579830+0000","last_active":"2024-05-11T01:14:46.287873+0000","last_peered":"2024-05-11T01:14:46.287873+0000","last_clean":"2024-05-11T01:14:46.287873+0000","last_became_active":"2024-05-11T01:13:56.579637+0000","last_became_peered":"2024-05-11T01:13:56.579637+0000","last_unstale":"2024-05-11T01:14:46.287873+0000","last_undegraded":"2024-05-11T01:14:46.287873+0000","last_fullsized":"2024-05-11T01:14:46.287873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:13:55.544048+0000","last_clean_scrub_stamp":"2024-05-11T01:13:55.544048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:06.364927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"50'86","reported_seq":249,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:14:46.284042+0000","last_change":"2024-05-11T01:01:05.481666+0000","last_active":"2024-05-11T01:14:46.284042+0000","last_peered":"2024-05-11T01:14:46.284042+0000","last_clean":"2024-05-11T01:14:46.284042+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:14:46.284042+0000","last_undegraded":"2024-05-11T01:14:46.284042+0000","last_fullsized":"2024-05-11T01:14:46.284042+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:01:04.247952+0000","last_clean_scrub_stamp":"2024-05-11T01:01:04.247952+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:52:41.519377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3794,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1323008,"data_stored":932360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":342574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54104,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317736,"statfs":{"total":96636764160,"available":96581361664,"internally_reserved":0,"allocated":737280,"data_stored":344898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40224,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331616,"statfs":{"total":96636764160,"available":96595574784,"internally_reserved":0,"allocated":737280,"data_stored":342540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":741376,"data_stored":344920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58264,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313576,"statfs":{"total":96636764160,"available":96577101824,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36636,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335204,"statfs":{"total":96636764160,"available":96599248896,"internally_reserved":0,"allocated":1323008,"data_stored":932304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:16:17.094 INFO:tasks.ceph:pgid 7.3f last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.094 INFO:tasks.ceph:pgid 7.3e last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.095 INFO:tasks.ceph:pgid 7.3d last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.095 INFO:tasks.ceph:pgid 7.3c last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.095 INFO:tasks.ceph:pgid 7.3b last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.095 INFO:tasks.ceph:pgid 7.3a last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.095 INFO:tasks.ceph:pgid 7.39 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.096 INFO:tasks.ceph:pgid 7.38 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.096 INFO:tasks.ceph:pgid 7.37 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.096 INFO:tasks.ceph:pgid 7.36 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.096 INFO:tasks.ceph:pgid 7.35 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.096 INFO:tasks.ceph:pgid 7.34 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.096 INFO:tasks.ceph:pgid 7.33 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.097 INFO:tasks.ceph:pgid 7.32 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.097 INFO:tasks.ceph:pgid 7.31 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.097 INFO:tasks.ceph:pgid 7.30 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.097 INFO:tasks.ceph:pgid 7.2f last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.097 INFO:tasks.ceph:pgid 7.2e last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.098 INFO:tasks.ceph:pgid 7.2d last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.098 INFO:tasks.ceph:pgid 7.2c last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.098 INFO:tasks.ceph:pgid 7.2b last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.098 INFO:tasks.ceph:pgid 7.2a last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.098 INFO:tasks.ceph:pgid 7.29 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.099 INFO:tasks.ceph:pgid 7.28 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.099 INFO:tasks.ceph:pgid 7.27 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.099 INFO:tasks.ceph:pgid 7.26 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.099 INFO:tasks.ceph:pgid 7.25 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.099 INFO:tasks.ceph:pgid 7.24 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.099 INFO:tasks.ceph:pgid 7.23 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.099 INFO:tasks.ceph:pgid 7.22 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.100 INFO:tasks.ceph:pgid 7.21 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.100 INFO:tasks.ceph:pgid 7.20 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.100 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.100 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.100 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.100 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.101 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.101 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.101 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.101 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.101 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.101 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.101 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.102 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.102 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.102 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.102 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.102 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.102 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.103 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.103 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.103 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.103 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.103 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.103 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.103 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.104 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.104 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.104 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.104 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.104 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.104 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.105 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.105 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.105 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.105 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.105 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.105 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.106 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.106 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.106 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.106 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.106 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.106 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.107 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.107 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.107 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.107 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.107 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.107 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.107 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.108 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.108 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.108 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.108 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.108 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.108 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.109 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.109 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.109 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.109 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.109 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.109 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.110 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.110 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-11T01:13:56.549341+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=56, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.110 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-11T01:13:55.544048+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=13, tm_sec=55, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.110 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-11T01:01:04.247952+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=1, tm_sec=4, tm_wday=5, tm_yday=132, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=11, tm_hour=1, tm_min=16, tm_sec=12, tm_wday=5, tm_yday=132, tm_isdst=0) 2024-05-11T01:16:17.110 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-11T01:16:22.585 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:16:22.589 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:16:37.111 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-11T01:16:37.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.229+0000 7f078ed78640 1 Processor -- start 2024-05-11T01:16:37.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.229+0000 7f078ed78640 1 -- start start 2024-05-11T01:16:37.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.230+0000 7f078ed78640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07880cea90 0x7f07880cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.230+0000 7f078ed78640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0788070890 0x7f0788070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.230+0000 7f078ed78640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07880d0f30 con 0x7f078806c3e0 2024-05-11T01:16:37.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.230+0000 7f078ed78640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f07880d1210 con 0x7f0788070890 2024-05-11T01:16:37.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.230+0000 7f078ed78640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f07880d14f0 con 0x7f07880cea90 2024-05-11T01:16:37.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.230+0000 7f078d315640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0788070890 0x7f0788070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.231+0000 7f078d315640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0788070890 0x7f0788070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56508/0 (socket says 172.21.15.16:56508) 2024-05-11T01:16:37.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.231+0000 7f078d315640 1 -- 172.21.15.16:0/2338833683 learned_addr learned my addr 172.21.15.16:0/2338833683 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:37.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.231+0000 7f0787fff640 1 --2- 172.21.15.16:0/2338833683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07880cea90 0x7f07880cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.231+0000 7f078d315640 1 -- 172.21.15.16:0/2338833683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07880cea90 msgr2=0x7f07880cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:37.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.231+0000 7f078d315640 1 --2- 172.21.15.16:0/2338833683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07880cea90 0x7f07880cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.231+0000 7f078d315640 1 -- 172.21.15.16:0/2338833683 >> v1:172.21.15.174:6789/0 conn(0x7f078806c3e0 legacy=0x7f078806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.231+0000 7f078d315640 1 -- 172.21.15.16:0/2338833683 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07880d17d0 con 0x7f0788070890 2024-05-11T01:16:37.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.231+0000 7f0787fff640 1 --2- 172.21.15.16:0/2338833683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07880cea90 0x7f07880cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-11T01:16:37.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078d315640 1 --2- 172.21.15.16:0/2338833683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0788070890 0x7f0788070cf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0780009e50 tx=0x7f078002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75505f200a25dca server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f07877fe640 1 -- 172.21.15.16:0/2338833683 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780036070 con 0x7f0788070890 2024-05-11T01:16:37.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f07877fe640 1 -- 172.21.15.16:0/2338833683 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0780031600 con 0x7f0788070890 2024-05-11T01:16:37.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f07877fe640 1 -- 172.21.15.16:0/2338833683 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07800319d0 con 0x7f0788070890 2024-05-11T01:16:37.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078ed78640 1 -- 172.21.15.16:0/2338833683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0788070890 msgr2=0x7f0788070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078ed78640 1 --2- 172.21.15.16:0/2338833683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0788070890 0x7f0788070cf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0780009e50 tx=0x7f078002a710 comp rx=0 tx=0).stop 2024-05-11T01:16:37.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078ed78640 1 -- 172.21.15.16:0/2338833683 shutdown_connections 2024-05-11T01:16:37.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078ed78640 1 --2- 172.21.15.16:0/2338833683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0788070890 0x7f0788070cf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078ed78640 1 --2- 172.21.15.16:0/2338833683 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f07880cea90 0x7f07880cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078ed78640 1 -- 172.21.15.16:0/2338833683 >> 172.21.15.16:0/2338833683 conn(0x7f07880d2060 msgr2=0x7f07880d2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:37.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078ed78640 1 -- 172.21.15.16:0/2338833683 shutdown_connections 2024-05-11T01:16:37.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.232+0000 7f078ed78640 1 -- 172.21.15.16:0/2338833683 wait complete. 2024-05-11T01:16:37.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.234+0000 7f078ed78640 1 Processor -- start 2024-05-11T01:16:37.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.234+0000 7f078ed78640 1 -- start start 2024-05-11T01:16:37.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078ed78640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078806c3e0 0x7f078815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078ed78640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0788070890 0x7f07880b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078ed78640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07880cea90 0x7f0788132110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078ed78640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f07880cf450 con 0x7f07880cea90 2024-05-11T01:16:37.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078ed78640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f07880d0b50 con 0x7f0788070890 2024-05-11T01:16:37.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078ed78640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f0788132b60 con 0x7f078806c3e0 2024-05-11T01:16:37.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07880cea90 0x7f0788132110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07880cea90 0x7f0788132110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56514/0 (socket says 172.21.15.16:56514) 2024-05-11T01:16:37.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 -- 172.21.15.16:0/2871175425 learned_addr learned my addr 172.21.15.16:0/2871175425 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:37.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078cb14640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078806c3e0 0x7f078815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f0787fff640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0788070890 0x7f07880b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 -- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078806c3e0 msgr2=0x7f078815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078806c3e0 0x7f078815cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 -- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0788070890 msgr2=0x7f07880b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0788070890 0x7f07880b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 -- 172.21.15.16:0/2871175425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0788132e40 con 0x7f07880cea90 2024-05-11T01:16:37.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f078d315640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07880cea90 0x7f0788132110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0780009e50 tx=0x7f0780004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.235+0000 7f07857fa640 1 -- 172.21.15.16:0/2871175425 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780036050 con 0x7f07880cea90 2024-05-11T01:16:37.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.236+0000 7f07857fa640 1 -- 172.21.15.16:0/2871175425 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0780042070 con 0x7f07880cea90 2024-05-11T01:16:37.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.236+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07880b52f0 con 0x7f07880cea90 2024-05-11T01:16:37.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.236+0000 7f07857fa640 1 -- 172.21.15.16:0/2871175425 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0780009510 con 0x7f07880cea90 2024-05-11T01:16:37.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.236+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07880b6030 con 0x7f07880cea90 2024-05-11T01:16:37.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.237+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078806a5b0 con 0x7f07880cea90 2024-05-11T01:16:37.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.237+0000 7f07857fa640 1 -- 172.21.15.16:0/2871175425 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f0780007bd0 con 0x7f07880cea90 2024-05-11T01:16:37.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.238+0000 7f07857fa640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f07740762d0 0x7f0774078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.238+0000 7f07857fa640 1 -- 172.21.15.16:0/2871175425 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f07800b8400 con 0x7f07880cea90 2024-05-11T01:16:37.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.238+0000 7f078cb14640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f07740762d0 0x7f0774078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.238+0000 7f078cb14640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f07740762d0 0x7f0774078790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07780017c0 tx=0x7f0778009040 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.242+0000 7f07857fa640 1 -- 172.21.15.16:0/2871175425 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f07800815f0 con 0x7f07880cea90 2024-05-11T01:16:37.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.427+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 --> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0788133010 con 0x7f07740762d0 2024-05-11T01:16:37.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.434+0000 7f07857fa640 1 -- 172.21.15.16:0/2871175425 <== mgr.4874 v2:172.21.15.174:6832/2049624093 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251894 (secure 0 0 0) 0x7f0788133010 con 0x7f07740762d0 2024-05-11T01:16:37.436 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:16:37.437 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-05-11T01:16:37.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f07740762d0 msgr2=0x7f0774078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f07740762d0 0x7f0774078790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f07780017c0 tx=0x7f0778009040 comp rx=0 tx=0).stop 2024-05-11T01:16:37.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07880cea90 msgr2=0x7f0788132110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07880cea90 0x7f0788132110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0780009e50 tx=0x7f0780004a40 comp rx=0 tx=0).stop 2024-05-11T01:16:37.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 shutdown_connections 2024-05-11T01:16:37.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07880cea90 0x7f0788132110 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f07740762d0 0x7f0774078790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0788070890 0x7f07880b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 --2- 172.21.15.16:0/2871175425 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f078806c3e0 0x7f078815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 >> 172.21.15.16:0/2871175425 conn(0x7f07880d2060 msgr2=0x7f07880d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:37.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 shutdown_connections 2024-05-11T01:16:37.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.437+0000 7f078ed78640 1 -- 172.21.15.16:0/2871175425 wait complete. 2024-05-11T01:16:37.447 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-05-11T01:16:37.196351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594162,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":179,"num_write_kb":1648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329832,"kb_used_data":6888,"kb_used_omap":12,"kb_used_meta":322867,"kb_avail":754644888,"statfs":{"total":773094113280,"available":772756365312,"internally_reserved":0,"allocated":7053312,"data_stored":3923540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":330616368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002609"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:24.880223+0000","last_change":"2024-05-11T01:16:24.880243+0000","last_active":"2024-05-11T01:16:24.880223+0000","last_peered":"2024-05-11T01:16:24.880223+0000","last_clean":"2024-05-11T01:16:24.880223+0000","last_became_active":"2024-05-11T01:13:57.572121+0000","last_became_peered":"2024-05-11T01:13:57.572121+0000","last_unstale":"2024-05-11T01:16:24.880223+0000","last_undegraded":"2024-05-11T01:16:24.880223+0000","last_fullsized":"2024-05-11T01:16:24.880223+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:24.880133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:24.880133+0000","last_clean_scrub_stamp":"2024-05-11T01:16:24.880133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:29:18.139912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:25.134016+0000","last_change":"2024-05-11T01:16:25.134038+0000","last_active":"2024-05-11T01:16:25.134016+0000","last_peered":"2024-05-11T01:16:25.134016+0000","last_clean":"2024-05-11T01:16:25.134016+0000","last_became_active":"2024-05-11T01:13:57.591749+0000","last_became_peered":"2024-05-11T01:13:57.591749+0000","last_unstale":"2024-05-11T01:16:25.134016+0000","last_undegraded":"2024-05-11T01:16:25.134016+0000","last_fullsized":"2024-05-11T01:16:25.134016+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:25.133940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:25.133940+0000","last_clean_scrub_stamp":"2024-05-11T01:16:25.133940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:20:30.641945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:23.039124+0000","last_change":"2024-05-11T01:16:23.039148+0000","last_active":"2024-05-11T01:16:23.039124+0000","last_peered":"2024-05-11T01:16:23.039124+0000","last_clean":"2024-05-11T01:16:23.039124+0000","last_became_active":"2024-05-11T01:13:57.577002+0000","last_became_peered":"2024-05-11T01:13:57.577002+0000","last_unstale":"2024-05-11T01:16:23.039124+0000","last_undegraded":"2024-05-11T01:16:23.039124+0000","last_fullsized":"2024-05-11T01:16:23.039124+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:23.039035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:23.039035+0000","last_clean_scrub_stamp":"2024-05-11T01:16:23.039035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:59:48.552217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:27.093233+0000","last_change":"2024-05-11T01:16:27.093257+0000","last_active":"2024-05-11T01:16:27.093233+0000","last_peered":"2024-05-11T01:16:27.093233+0000","last_clean":"2024-05-11T01:16:27.093233+0000","last_became_active":"2024-05-11T01:13:57.587912+0000","last_became_peered":"2024-05-11T01:13:57.587912+0000","last_unstale":"2024-05-11T01:16:27.093233+0000","last_undegraded":"2024-05-11T01:16:27.093233+0000","last_fullsized":"2024-05-11T01:16:27.093233+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:27.093141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:27.093141+0000","last_clean_scrub_stamp":"2024-05-11T01:16:27.093141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:21:14.497012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:24.129500+0000","last_change":"2024-05-11T01:16:24.129500+0000","last_active":"2024-05-11T01:16:24.129500+0000","last_peered":"2024-05-11T01:16:24.129500+0000","last_clean":"2024-05-11T01:16:24.129500+0000","last_became_active":"2024-05-11T01:13:57.589446+0000","last_became_peered":"2024-05-11T01:13:57.589446+0000","last_unstale":"2024-05-11T01:16:24.129500+0000","last_undegraded":"2024-05-11T01:16:24.129500+0000","last_fullsized":"2024-05-11T01:16:24.129500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:24.129397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:24.129397+0000","last_clean_scrub_stamp":"2024-05-11T01:16:24.129397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:42:04.888107+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:29.709154+0000","last_change":"2024-05-11T01:16:29.709154+0000","last_active":"2024-05-11T01:16:29.709154+0000","last_peered":"2024-05-11T01:16:29.709154+0000","last_clean":"2024-05-11T01:16:29.709154+0000","last_became_active":"2024-05-11T01:13:57.579742+0000","last_became_peered":"2024-05-11T01:13:57.579742+0000","last_unstale":"2024-05-11T01:16:29.709154+0000","last_undegraded":"2024-05-11T01:16:29.709154+0000","last_fullsized":"2024-05-11T01:16:29.709154+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:29.709033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:29.709033+0000","last_clean_scrub_stamp":"2024-05-11T01:16:29.709033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:24:25.623790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:25.855240+0000","last_change":"2024-05-11T01:16:25.855240+0000","last_active":"2024-05-11T01:16:25.855240+0000","last_peered":"2024-05-11T01:16:25.855240+0000","last_clean":"2024-05-11T01:16:25.855240+0000","last_became_active":"2024-05-11T01:13:57.574655+0000","last_became_peered":"2024-05-11T01:13:57.574655+0000","last_unstale":"2024-05-11T01:16:25.855240+0000","last_undegraded":"2024-05-11T01:16:25.855240+0000","last_fullsized":"2024-05-11T01:16:25.855240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:25.855110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:25.855110+0000","last_clean_scrub_stamp":"2024-05-11T01:16:25.855110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:51:01.112630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:22.085666+0000","last_change":"2024-05-11T01:16:22.085666+0000","last_active":"2024-05-11T01:16:22.085666+0000","last_peered":"2024-05-11T01:16:22.085666+0000","last_clean":"2024-05-11T01:16:22.085666+0000","last_became_active":"2024-05-11T01:13:57.584207+0000","last_became_peered":"2024-05-11T01:13:57.584207+0000","last_unstale":"2024-05-11T01:16:22.085666+0000","last_undegraded":"2024-05-11T01:16:22.085666+0000","last_fullsized":"2024-05-11T01:16:22.085666+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:22.085547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:22.085547+0000","last_clean_scrub_stamp":"2024-05-11T01:16:22.085547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:27:17.552621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:14.103407+0000","last_change":"2024-05-11T01:16:14.103407+0000","last_active":"2024-05-11T01:16:14.103407+0000","last_peered":"2024-05-11T01:16:14.103407+0000","last_clean":"2024-05-11T01:16:14.103407+0000","last_became_active":"2024-05-11T01:13:57.586787+0000","last_became_peered":"2024-05-11T01:13:57.586787+0000","last_unstale":"2024-05-11T01:16:14.103407+0000","last_undegraded":"2024-05-11T01:16:14.103407+0000","last_fullsized":"2024-05-11T01:16:14.103407+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:14.103310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:14.103310+0000","last_clean_scrub_stamp":"2024-05-11T01:16:14.103310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:47.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:24.081134+0000","last_change":"2024-05-11T01:16:24.081134+0000","last_active":"2024-05-11T01:16:24.081134+0000","last_peered":"2024-05-11T01:16:24.081134+0000","last_clean":"2024-05-11T01:16:24.081134+0000","last_became_active":"2024-05-11T01:13:57.586646+0000","last_became_peered":"2024-05-11T01:13:57.586646+0000","last_unstale":"2024-05-11T01:16:24.081134+0000","last_undegraded":"2024-05-11T01:16:24.081134+0000","last_fullsized":"2024-05-11T01:16:24.081134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:24.080974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:24.080974+0000","last_clean_scrub_stamp":"2024-05-11T01:16:24.080974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:47:51.587948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:25.090704+0000","last_change":"2024-05-11T01:16:25.090704+0000","last_active":"2024-05-11T01:16:25.090704+0000","last_peered":"2024-05-11T01:16:25.090704+0000","last_clean":"2024-05-11T01:16:25.090704+0000","last_became_active":"2024-05-11T01:13:57.587368+0000","last_became_peered":"2024-05-11T01:13:57.587368+0000","last_unstale":"2024-05-11T01:16:25.090704+0000","last_undegraded":"2024-05-11T01:16:25.090704+0000","last_fullsized":"2024-05-11T01:16:25.090704+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:25.090589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:25.090589+0000","last_clean_scrub_stamp":"2024-05-11T01:16:25.090589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:44:03.742834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:23.094008+0000","last_change":"2024-05-11T01:16:23.094008+0000","last_active":"2024-05-11T01:16:23.094008+0000","last_peered":"2024-05-11T01:16:23.094008+0000","last_clean":"2024-05-11T01:16:23.094008+0000","last_became_active":"2024-05-11T01:13:57.584324+0000","last_became_peered":"2024-05-11T01:13:57.584324+0000","last_unstale":"2024-05-11T01:16:23.094008+0000","last_undegraded":"2024-05-11T01:16:23.094008+0000","last_fullsized":"2024-05-11T01:16:23.094008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:23.093890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:23.093890+0000","last_clean_scrub_stamp":"2024-05-11T01:16:23.093890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:00:34.055778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:19.158179+0000","last_change":"2024-05-11T01:16:19.158179+0000","last_active":"2024-05-11T01:16:19.158179+0000","last_peered":"2024-05-11T01:16:19.158179+0000","last_clean":"2024-05-11T01:16:19.158179+0000","last_became_active":"2024-05-11T01:13:57.576883+0000","last_became_peered":"2024-05-11T01:13:57.576883+0000","last_unstale":"2024-05-11T01:16:19.158179+0000","last_undegraded":"2024-05-11T01:16:19.158179+0000","last_fullsized":"2024-05-11T01:16:19.158179+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:19.158026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:19.158026+0000","last_clean_scrub_stamp":"2024-05-11T01:16:19.158026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:27:04.257409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:26.180536+0000","last_change":"2024-05-11T01:16:26.180559+0000","last_active":"2024-05-11T01:16:26.180536+0000","last_peered":"2024-05-11T01:16:26.180536+0000","last_clean":"2024-05-11T01:16:26.180536+0000","last_became_active":"2024-05-11T01:14:46.342122+0000","last_became_peered":"2024-05-11T01:14:46.342122+0000","last_unstale":"2024-05-11T01:16:26.180536+0000","last_undegraded":"2024-05-11T01:16:26.180536+0000","last_fullsized":"2024-05-11T01:16:26.180536+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:26.180442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:26.180442+0000","last_clean_scrub_stamp":"2024-05-11T01:16:26.180442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:34:38.644066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:22.682304+0000","last_change":"2024-05-11T01:16:22.682329+0000","last_active":"2024-05-11T01:16:22.682304+0000","last_peered":"2024-05-11T01:16:22.682304+0000","last_clean":"2024-05-11T01:16:22.682304+0000","last_became_active":"2024-05-11T01:13:57.572028+0000","last_became_peered":"2024-05-11T01:13:57.572028+0000","last_unstale":"2024-05-11T01:16:22.682304+0000","last_undegraded":"2024-05-11T01:16:22.682304+0000","last_fullsized":"2024-05-11T01:16:22.682304+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:22.682207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:22.682207+0000","last_clean_scrub_stamp":"2024-05-11T01:16:22.682207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:15:41.201249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:26.589211+0000","last_change":"2024-05-11T01:16:26.589257+0000","last_active":"2024-05-11T01:16:26.589211+0000","last_peered":"2024-05-11T01:16:26.589211+0000","last_clean":"2024-05-11T01:16:26.589211+0000","last_became_active":"2024-05-11T01:13:57.587111+0000","last_became_peered":"2024-05-11T01:13:57.587111+0000","last_unstale":"2024-05-11T01:16:26.589211+0000","last_undegraded":"2024-05-11T01:16:26.589211+0000","last_fullsized":"2024-05-11T01:16:26.589211+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:26.589102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:26.589102+0000","last_clean_scrub_stamp":"2024-05-11T01:16:26.589102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:33:44.666966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:26.087195+0000","last_change":"2024-05-11T01:16:26.087236+0000","last_active":"2024-05-11T01:16:26.087195+0000","last_peered":"2024-05-11T01:16:26.087195+0000","last_clean":"2024-05-11T01:16:26.087195+0000","last_became_active":"2024-05-11T01:13:57.580071+0000","last_became_peered":"2024-05-11T01:13:57.580071+0000","last_unstale":"2024-05-11T01:16:26.087195+0000","last_undegraded":"2024-05-11T01:16:26.087195+0000","last_fullsized":"2024-05-11T01:16:26.087195+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:26.087100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:26.087100+0000","last_clean_scrub_stamp":"2024-05-11T01:16:26.087100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:47:33.163470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:28.145246+0000","last_change":"2024-05-11T01:16:28.145269+0000","last_active":"2024-05-11T01:16:28.145246+0000","last_peered":"2024-05-11T01:16:28.145246+0000","last_clean":"2024-05-11T01:16:28.145246+0000","last_became_active":"2024-05-11T01:13:57.591258+0000","last_became_peered":"2024-05-11T01:13:57.591258+0000","last_unstale":"2024-05-11T01:16:28.145246+0000","last_undegraded":"2024-05-11T01:16:28.145246+0000","last_fullsized":"2024-05-11T01:16:28.145246+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:28.145148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:28.145148+0000","last_clean_scrub_stamp":"2024-05-11T01:16:28.145148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:11:41.156206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:27.613973+0000","last_change":"2024-05-11T01:16:27.613995+0000","last_active":"2024-05-11T01:16:27.613973+0000","last_peered":"2024-05-11T01:16:27.613973+0000","last_clean":"2024-05-11T01:16:27.613973+0000","last_became_active":"2024-05-11T01:14:46.289402+0000","last_became_peered":"2024-05-11T01:14:46.289402+0000","last_unstale":"2024-05-11T01:16:27.613973+0000","last_undegraded":"2024-05-11T01:16:27.613973+0000","last_fullsized":"2024-05-11T01:16:27.613973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:27.613880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:27.613880+0000","last_clean_scrub_stamp":"2024-05-11T01:16:27.613880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:21:15.017751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:22.152641+0000","last_change":"2024-05-11T01:16:22.152686+0000","last_active":"2024-05-11T01:16:22.152641+0000","last_peered":"2024-05-11T01:16:22.152641+0000","last_clean":"2024-05-11T01:16:22.152641+0000","last_became_active":"2024-05-11T01:13:57.590966+0000","last_became_peered":"2024-05-11T01:13:57.590966+0000","last_unstale":"2024-05-11T01:16:22.152641+0000","last_undegraded":"2024-05-11T01:16:22.152641+0000","last_fullsized":"2024-05-11T01:16:22.152641+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:22.152543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:22.152543+0000","last_clean_scrub_stamp":"2024-05-11T01:16:22.152543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:35:22.985240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:30.726267+0000","last_change":"2024-05-11T01:16:30.726293+0000","last_active":"2024-05-11T01:16:30.726267+0000","last_peered":"2024-05-11T01:16:30.726267+0000","last_clean":"2024-05-11T01:16:30.726267+0000","last_became_active":"2024-05-11T01:13:57.581360+0000","last_became_peered":"2024-05-11T01:13:57.581360+0000","last_unstale":"2024-05-11T01:16:30.726267+0000","last_undegraded":"2024-05-11T01:16:30.726267+0000","last_fullsized":"2024-05-11T01:16:30.726267+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:30.726172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:30.726172+0000","last_clean_scrub_stamp":"2024-05-11T01:16:30.726172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:29:23.985951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:15.079518+0000","last_change":"2024-05-11T01:16:15.079518+0000","last_active":"2024-05-11T01:16:15.079518+0000","last_peered":"2024-05-11T01:16:15.079518+0000","last_clean":"2024-05-11T01:16:15.079518+0000","last_became_active":"2024-05-11T01:13:57.585036+0000","last_became_peered":"2024-05-11T01:13:57.585036+0000","last_unstale":"2024-05-11T01:16:15.079518+0000","last_undegraded":"2024-05-11T01:16:15.079518+0000","last_fullsized":"2024-05-11T01:16:15.079518+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:15.079408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:15.079408+0000","last_clean_scrub_stamp":"2024-05-11T01:16:15.079408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:14:56.028239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:22.629446+0000","last_change":"2024-05-11T01:16:22.629469+0000","last_active":"2024-05-11T01:16:22.629446+0000","last_peered":"2024-05-11T01:16:22.629446+0000","last_clean":"2024-05-11T01:16:22.629446+0000","last_became_active":"2024-05-11T01:13:57.578993+0000","last_became_peered":"2024-05-11T01:13:57.578993+0000","last_unstale":"2024-05-11T01:16:22.629446+0000","last_undegraded":"2024-05-11T01:16:22.629446+0000","last_fullsized":"2024-05-11T01:16:22.629446+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:22.629349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:22.629349+0000","last_clean_scrub_stamp":"2024-05-11T01:16:22.629349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:56:20.011081+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:21.678414+0000","last_change":"2024-05-11T01:16:21.678445+0000","last_active":"2024-05-11T01:16:21.678414+0000","last_peered":"2024-05-11T01:16:21.678414+0000","last_clean":"2024-05-11T01:16:21.678414+0000","last_became_active":"2024-05-11T01:13:57.578695+0000","last_became_peered":"2024-05-11T01:13:57.578695+0000","last_unstale":"2024-05-11T01:16:21.678414+0000","last_undegraded":"2024-05-11T01:16:21.678414+0000","last_fullsized":"2024-05-11T01:16:21.678414+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:21.678317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:21.678317+0000","last_clean_scrub_stamp":"2024-05-11T01:16:21.678317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:32:51.093674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:20.674854+0000","last_change":"2024-05-11T01:16:20.674903+0000","last_active":"2024-05-11T01:16:20.674854+0000","last_peered":"2024-05-11T01:16:20.674854+0000","last_clean":"2024-05-11T01:16:20.674854+0000","last_became_active":"2024-05-11T01:13:57.576996+0000","last_became_peered":"2024-05-11T01:13:57.576996+0000","last_unstale":"2024-05-11T01:16:20.674854+0000","last_undegraded":"2024-05-11T01:16:20.674854+0000","last_fullsized":"2024-05-11T01:16:20.674854+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:20.674750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:20.674750+0000","last_clean_scrub_stamp":"2024-05-11T01:16:20.674750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:07:13.869456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:21.185873+0000","last_change":"2024-05-11T01:16:21.185909+0000","last_active":"2024-05-11T01:16:21.185873+0000","last_peered":"2024-05-11T01:16:21.185873+0000","last_clean":"2024-05-11T01:16:21.185873+0000","last_became_active":"2024-05-11T01:13:57.579391+0000","last_became_peered":"2024-05-11T01:13:57.579391+0000","last_unstale":"2024-05-11T01:16:21.185873+0000","last_undegraded":"2024-05-11T01:16:21.185873+0000","last_fullsized":"2024-05-11T01:16:21.185873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:21.185769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:21.185769+0000","last_clean_scrub_stamp":"2024-05-11T01:16:21.185769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:31:02.237835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:23.996714+0000","last_change":"2024-05-11T01:16:23.996734+0000","last_active":"2024-05-11T01:16:23.996714+0000","last_peered":"2024-05-11T01:16:23.996714+0000","last_clean":"2024-05-11T01:16:23.996714+0000","last_became_active":"2024-05-11T01:13:57.577363+0000","last_became_peered":"2024-05-11T01:13:57.577363+0000","last_unstale":"2024-05-11T01:16:23.996714+0000","last_undegraded":"2024-05-11T01:16:23.996714+0000","last_fullsized":"2024-05-11T01:16:23.996714+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:23.996638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:23.996638+0000","last_clean_scrub_stamp":"2024-05-11T01:16:23.996638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:04:02.562636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:22.097839+0000","last_change":"2024-05-11T01:16:22.097863+0000","last_active":"2024-05-11T01:16:22.097839+0000","last_peered":"2024-05-11T01:16:22.097839+0000","last_clean":"2024-05-11T01:16:22.097839+0000","last_became_active":"2024-05-11T01:13:57.584164+0000","last_became_peered":"2024-05-11T01:13:57.584164+0000","last_unstale":"2024-05-11T01:16:22.097839+0000","last_undegraded":"2024-05-11T01:16:22.097839+0000","last_fullsized":"2024-05-11T01:16:22.097839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:22.097739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:22.097739+0000","last_clean_scrub_stamp":"2024-05-11T01:16:22.097739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:53:53.615795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:18.678031+0000","last_change":"2024-05-11T01:16:18.678056+0000","last_active":"2024-05-11T01:16:18.678031+0000","last_peered":"2024-05-11T01:16:18.678031+0000","last_clean":"2024-05-11T01:16:18.678031+0000","last_became_active":"2024-05-11T01:13:57.575987+0000","last_became_peered":"2024-05-11T01:13:57.575987+0000","last_unstale":"2024-05-11T01:16:18.678031+0000","last_undegraded":"2024-05-11T01:16:18.678031+0000","last_fullsized":"2024-05-11T01:16:18.678031+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:18.677941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:18.677941+0000","last_clean_scrub_stamp":"2024-05-11T01:16:18.677941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:25:42.903233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:22.031622+0000","last_change":"2024-05-11T01:16:22.031668+0000","last_active":"2024-05-11T01:16:22.031622+0000","last_peered":"2024-05-11T01:16:22.031622+0000","last_clean":"2024-05-11T01:16:22.031622+0000","last_became_active":"2024-05-11T01:13:57.576839+0000","last_became_peered":"2024-05-11T01:13:57.576839+0000","last_unstale":"2024-05-11T01:16:22.031622+0000","last_undegraded":"2024-05-11T01:16:22.031622+0000","last_fullsized":"2024-05-11T01:16:22.031622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:22.031514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:22.031514+0000","last_clean_scrub_stamp":"2024-05-11T01:16:22.031514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:08:59.899968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:26.701673+0000","last_change":"2024-05-11T01:16:26.701702+0000","last_active":"2024-05-11T01:16:26.701673+0000","last_peered":"2024-05-11T01:16:26.701673+0000","last_clean":"2024-05-11T01:16:26.701673+0000","last_became_active":"2024-05-11T01:13:57.578039+0000","last_became_peered":"2024-05-11T01:13:57.578039+0000","last_unstale":"2024-05-11T01:16:26.701673+0000","last_undegraded":"2024-05-11T01:16:26.701673+0000","last_fullsized":"2024-05-11T01:16:26.701673+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:26.701565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:26.701565+0000","last_clean_scrub_stamp":"2024-05-11T01:16:26.701565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:00:19.071328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:18.156658+0000","last_change":"2024-05-11T01:16:18.156700+0000","last_active":"2024-05-11T01:16:18.156658+0000","last_peered":"2024-05-11T01:16:18.156658+0000","last_clean":"2024-05-11T01:16:18.156658+0000","last_became_active":"2024-05-11T01:13:57.576207+0000","last_became_peered":"2024-05-11T01:13:57.576207+0000","last_unstale":"2024-05-11T01:16:18.156658+0000","last_undegraded":"2024-05-11T01:16:18.156658+0000","last_fullsized":"2024-05-11T01:16:18.156658+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:18.156558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:18.156558+0000","last_clean_scrub_stamp":"2024-05-11T01:16:18.156558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:05:54.288561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:17.655696+0000","last_change":"2024-05-11T01:16:17.655734+0000","last_active":"2024-05-11T01:16:17.655696+0000","last_peered":"2024-05-11T01:16:17.655696+0000","last_clean":"2024-05-11T01:16:17.655696+0000","last_became_active":"2024-05-11T01:13:57.574000+0000","last_became_peered":"2024-05-11T01:13:57.574000+0000","last_unstale":"2024-05-11T01:16:17.655696+0000","last_undegraded":"2024-05-11T01:16:17.655696+0000","last_fullsized":"2024-05-11T01:16:17.655696+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:17.655571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:17.655571+0000","last_clean_scrub_stamp":"2024-05-11T01:16:17.655571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:07:36.050775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"61'6","reported_seq":34,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:21.652241+0000","last_change":"2024-05-11T01:16:21.652308+0000","last_active":"2024-05-11T01:16:21.652241+0000","last_peered":"2024-05-11T01:16:21.652241+0000","last_clean":"2024-05-11T01:16:21.652241+0000","last_became_active":"2024-05-11T01:13:56.580967+0000","last_became_peered":"2024-05-11T01:13:56.580967+0000","last_unstale":"2024-05-11T01:16:21.652241+0000","last_undegraded":"2024-05-11T01:16:21.652241+0000","last_fullsized":"2024-05-11T01:16:21.652241+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'6","last_scrub_stamp":"2024-05-11T01:16:21.652136+0000","last_deep_scrub":"61'6","last_deep_scrub_stamp":"2024-05-11T01:16:21.652136+0000","last_clean_scrub_stamp":"2024-05-11T01:16:21.652136+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:20:27.160140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:16.613652+0000","last_change":"2024-05-11T01:16:16.613678+0000","last_active":"2024-05-11T01:16:16.613652+0000","last_peered":"2024-05-11T01:16:16.613652+0000","last_clean":"2024-05-11T01:16:16.613652+0000","last_became_active":"2024-05-11T01:13:57.572038+0000","last_became_peered":"2024-05-11T01:13:57.572038+0000","last_unstale":"2024-05-11T01:16:16.613652+0000","last_undegraded":"2024-05-11T01:16:16.613652+0000","last_fullsized":"2024-05-11T01:16:16.613652+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:16.613552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:16.613552+0000","last_clean_scrub_stamp":"2024-05-11T01:16:16.613552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:43:00.876552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"58'1","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:20.095006+0000","last_change":"2024-05-11T01:16:20.095030+0000","last_active":"2024-05-11T01:16:20.095006+0000","last_peered":"2024-05-11T01:16:20.095006+0000","last_clean":"2024-05-11T01:16:20.095006+0000","last_became_active":"2024-05-11T01:13:56.576512+0000","last_became_peered":"2024-05-11T01:13:56.576512+0000","last_unstale":"2024-05-11T01:16:20.095006+0000","last_undegraded":"2024-05-11T01:16:20.095006+0000","last_fullsized":"2024-05-11T01:16:20.095006+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'1","last_scrub_stamp":"2024-05-11T01:16:20.094917+0000","last_deep_scrub":"58'1","last_deep_scrub_stamp":"2024-05-11T01:16:20.094917+0000","last_clean_scrub_stamp":"2024-05-11T01:16:20.094917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:03:34.833782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:20.119722+0000","last_change":"2024-05-11T01:16:20.119722+0000","last_active":"2024-05-11T01:16:20.119722+0000","last_peered":"2024-05-11T01:16:20.119722+0000","last_clean":"2024-05-11T01:16:20.119722+0000","last_became_active":"2024-05-11T01:13:57.576234+0000","last_became_peered":"2024-05-11T01:13:57.576234+0000","last_unstale":"2024-05-11T01:16:20.119722+0000","last_undegraded":"2024-05-11T01:16:20.119722+0000","last_fullsized":"2024-05-11T01:16:20.119722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:20.119570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:20.119570+0000","last_clean_scrub_stamp":"2024-05-11T01:16:20.119570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:36:02.919176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"61'3","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:14.586632+0000","last_change":"2024-05-11T01:16:14.586632+0000","last_active":"2024-05-11T01:16:14.586632+0000","last_peered":"2024-05-11T01:16:14.586632+0000","last_clean":"2024-05-11T01:16:14.586632+0000","last_became_active":"2024-05-11T01:13:56.574784+0000","last_became_peered":"2024-05-11T01:13:56.574784+0000","last_unstale":"2024-05-11T01:16:14.586632+0000","last_undegraded":"2024-05-11T01:16:14.586632+0000","last_fullsized":"2024-05-11T01:16:14.586632+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'3","last_scrub_stamp":"2024-05-11T01:16:14.586543+0000","last_deep_scrub":"61'3","last_deep_scrub_stamp":"2024-05-11T01:16:14.586543+0000","last_clean_scrub_stamp":"2024-05-11T01:16:14.586543+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:20:44.832754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:18.643245+0000","last_change":"2024-05-11T01:16:18.643245+0000","last_active":"2024-05-11T01:16:18.643245+0000","last_peered":"2024-05-11T01:16:18.643245+0000","last_clean":"2024-05-11T01:16:18.643245+0000","last_became_active":"2024-05-11T01:13:57.576758+0000","last_became_peered":"2024-05-11T01:13:57.576758+0000","last_unstale":"2024-05-11T01:16:18.643245+0000","last_undegraded":"2024-05-11T01:16:18.643245+0000","last_fullsized":"2024-05-11T01:16:18.643245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:18.643127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:18.643127+0000","last_clean_scrub_stamp":"2024-05-11T01:16:18.643127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:39:04.545286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"61'3","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:21.868342+0000","last_change":"2024-05-11T01:16:21.868342+0000","last_active":"2024-05-11T01:16:21.868342+0000","last_peered":"2024-05-11T01:16:21.868342+0000","last_clean":"2024-05-11T01:16:21.868342+0000","last_became_active":"2024-05-11T01:13:56.578569+0000","last_became_peered":"2024-05-11T01:13:56.578569+0000","last_unstale":"2024-05-11T01:16:21.868342+0000","last_undegraded":"2024-05-11T01:16:21.868342+0000","last_fullsized":"2024-05-11T01:16:21.868342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'3","last_scrub_stamp":"2024-05-11T01:16:21.868203+0000","last_deep_scrub":"61'3","last_deep_scrub_stamp":"2024-05-11T01:16:21.868203+0000","last_clean_scrub_stamp":"2024-05-11T01:16:21.868203+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:42:23.003202+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:25.043634+0000","last_change":"2024-05-11T01:16:25.043634+0000","last_active":"2024-05-11T01:16:25.043634+0000","last_peered":"2024-05-11T01:16:25.043634+0000","last_clean":"2024-05-11T01:16:25.043634+0000","last_became_active":"2024-05-11T01:13:57.578287+0000","last_became_peered":"2024-05-11T01:13:57.578287+0000","last_unstale":"2024-05-11T01:16:25.043634+0000","last_undegraded":"2024-05-11T01:16:25.043634+0000","last_fullsized":"2024-05-11T01:16:25.043634+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:25.043533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:25.043533+0000","last_clean_scrub_stamp":"2024-05-11T01:16:25.043533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:21:55.600742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"58'1","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:17.709157+0000","last_change":"2024-05-11T01:16:17.709157+0000","last_active":"2024-05-11T01:16:17.709157+0000","last_peered":"2024-05-11T01:16:17.709157+0000","last_clean":"2024-05-11T01:16:17.709157+0000","last_became_active":"2024-05-11T01:13:56.574900+0000","last_became_peered":"2024-05-11T01:13:56.574900+0000","last_unstale":"2024-05-11T01:16:17.709157+0000","last_undegraded":"2024-05-11T01:16:17.709157+0000","last_fullsized":"2024-05-11T01:16:17.709157+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'1","last_scrub_stamp":"2024-05-11T01:16:17.709042+0000","last_deep_scrub":"58'1","last_deep_scrub_stamp":"2024-05-11T01:16:17.709042+0000","last_clean_scrub_stamp":"2024-05-11T01:16:17.709042+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:19:08.828435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:31.056689+0000","last_change":"2024-05-11T01:16:31.056689+0000","last_active":"2024-05-11T01:16:31.056689+0000","last_peered":"2024-05-11T01:16:31.056689+0000","last_clean":"2024-05-11T01:16:31.056689+0000","last_became_active":"2024-05-11T01:13:57.590734+0000","last_became_peered":"2024-05-11T01:13:57.590734+0000","last_unstale":"2024-05-11T01:16:31.056689+0000","last_undegraded":"2024-05-11T01:16:31.056689+0000","last_fullsized":"2024-05-11T01:16:31.056689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:31.056564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:31.056564+0000","last_clean_scrub_stamp":"2024-05-11T01:16:31.056564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:28:43.734181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"58'1","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:19.127274+0000","last_change":"2024-05-11T01:16:19.127274+0000","last_active":"2024-05-11T01:16:19.127274+0000","last_peered":"2024-05-11T01:16:19.127274+0000","last_clean":"2024-05-11T01:16:19.127274+0000","last_became_active":"2024-05-11T01:13:56.574005+0000","last_became_peered":"2024-05-11T01:13:56.574005+0000","last_unstale":"2024-05-11T01:16:19.127274+0000","last_undegraded":"2024-05-11T01:16:19.127274+0000","last_fullsized":"2024-05-11T01:16:19.127274+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'1","last_scrub_stamp":"2024-05-11T01:16:19.127122+0000","last_deep_scrub":"58'1","last_deep_scrub_stamp":"2024-05-11T01:16:19.127122+0000","last_clean_scrub_stamp":"2024-05-11T01:16:19.127122+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:33:58.410961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:23.073095+0000","last_change":"2024-05-11T01:16:23.073095+0000","last_active":"2024-05-11T01:16:23.073095+0000","last_peered":"2024-05-11T01:16:23.073095+0000","last_clean":"2024-05-11T01:16:23.073095+0000","last_became_active":"2024-05-11T01:13:57.584406+0000","last_became_peered":"2024-05-11T01:13:57.584406+0000","last_unstale":"2024-05-11T01:16:23.073095+0000","last_undegraded":"2024-05-11T01:16:23.073095+0000","last_fullsized":"2024-05-11T01:16:23.073095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:23.072975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:23.072975+0000","last_clean_scrub_stamp":"2024-05-11T01:16:23.072975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:48:48.673460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:16.066429+0000","last_change":"2024-05-11T01:16:16.066429+0000","last_active":"2024-05-11T01:16:16.066429+0000","last_peered":"2024-05-11T01:16:16.066429+0000","last_clean":"2024-05-11T01:16:16.066429+0000","last_became_active":"2024-05-11T01:13:56.573279+0000","last_became_peered":"2024-05-11T01:13:56.573279+0000","last_unstale":"2024-05-11T01:16:16.066429+0000","last_undegraded":"2024-05-11T01:16:16.066429+0000","last_fullsized":"2024-05-11T01:16:16.066429+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:16.066291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:16.066291+0000","last_clean_scrub_stamp":"2024-05-11T01:16:16.066291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:53:04.369068+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:23.601534+0000","last_change":"2024-05-11T01:16:23.601534+0000","last_active":"2024-05-11T01:16:23.601534+0000","last_peered":"2024-05-11T01:16:23.601534+0000","last_clean":"2024-05-11T01:16:23.601534+0000","last_became_active":"2024-05-11T01:13:57.578950+0000","last_became_peered":"2024-05-11T01:13:57.578950+0000","last_unstale":"2024-05-11T01:16:23.601534+0000","last_undegraded":"2024-05-11T01:16:23.601534+0000","last_fullsized":"2024-05-11T01:16:23.601534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:23.601415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:23.601415+0000","last_clean_scrub_stamp":"2024-05-11T01:16:23.601415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:48:49.201900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:16.080190+0000","last_change":"2024-05-11T01:16:16.080190+0000","last_active":"2024-05-11T01:16:16.080190+0000","last_peered":"2024-05-11T01:16:16.080190+0000","last_clean":"2024-05-11T01:16:16.080190+0000","last_became_active":"2024-05-11T01:13:56.572329+0000","last_became_peered":"2024-05-11T01:13:56.572329+0000","last_unstale":"2024-05-11T01:16:16.080190+0000","last_undegraded":"2024-05-11T01:16:16.080190+0000","last_fullsized":"2024-05-11T01:16:16.080190+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:16.080031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:16.080031+0000","last_clean_scrub_stamp":"2024-05-11T01:16:16.080031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:35:21.643821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:27.110970+0000","last_change":"2024-05-11T01:16:27.110997+0000","last_active":"2024-05-11T01:16:27.110970+0000","last_peered":"2024-05-11T01:16:27.110970+0000","last_clean":"2024-05-11T01:16:27.110970+0000","last_became_active":"2024-05-11T01:13:57.590241+0000","last_became_peered":"2024-05-11T01:13:57.590241+0000","last_unstale":"2024-05-11T01:16:27.110970+0000","last_undegraded":"2024-05-11T01:16:27.110970+0000","last_fullsized":"2024-05-11T01:16:27.110970+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:27.110862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:27.110862+0000","last_clean_scrub_stamp":"2024-05-11T01:16:27.110862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T09:49:23.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:16.152696+0000","last_change":"2024-05-11T01:16:16.152696+0000","last_active":"2024-05-11T01:16:16.152696+0000","last_peered":"2024-05-11T01:16:16.152696+0000","last_clean":"2024-05-11T01:16:16.152696+0000","last_became_active":"2024-05-11T01:13:56.571211+0000","last_became_peered":"2024-05-11T01:13:56.571211+0000","last_unstale":"2024-05-11T01:16:16.152696+0000","last_undegraded":"2024-05-11T01:16:16.152696+0000","last_fullsized":"2024-05-11T01:16:16.152696+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:16.152489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:16.152489+0000","last_clean_scrub_stamp":"2024-05-11T01:16:16.152489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:41:43.734751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:28.834025+0000","last_change":"2024-05-11T01:16:28.834053+0000","last_active":"2024-05-11T01:16:28.834025+0000","last_peered":"2024-05-11T01:16:28.834025+0000","last_clean":"2024-05-11T01:16:28.834025+0000","last_became_active":"2024-05-11T01:13:57.580158+0000","last_became_peered":"2024-05-11T01:13:57.580158+0000","last_unstale":"2024-05-11T01:16:28.834025+0000","last_undegraded":"2024-05-11T01:16:28.834025+0000","last_fullsized":"2024-05-11T01:16:28.834025+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:28.833909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:28.833909+0000","last_clean_scrub_stamp":"2024-05-11T01:16:28.833909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:00:55.812028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:20.071586+0000","last_change":"2024-05-11T01:16:20.071586+0000","last_active":"2024-05-11T01:16:20.071586+0000","last_peered":"2024-05-11T01:16:20.071586+0000","last_clean":"2024-05-11T01:16:20.071586+0000","last_became_active":"2024-05-11T01:13:56.576163+0000","last_became_peered":"2024-05-11T01:13:56.576163+0000","last_unstale":"2024-05-11T01:16:20.071586+0000","last_undegraded":"2024-05-11T01:16:20.071586+0000","last_fullsized":"2024-05-11T01:16:20.071586+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:20.071436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:20.071436+0000","last_clean_scrub_stamp":"2024-05-11T01:16:20.071436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:07:13.266142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:25.737658+0000","last_change":"2024-05-11T01:16:25.737708+0000","last_active":"2024-05-11T01:16:25.737658+0000","last_peered":"2024-05-11T01:16:25.737658+0000","last_clean":"2024-05-11T01:16:25.737658+0000","last_became_active":"2024-05-11T01:13:57.577005+0000","last_became_peered":"2024-05-11T01:13:57.577005+0000","last_unstale":"2024-05-11T01:16:25.737658+0000","last_undegraded":"2024-05-11T01:16:25.737658+0000","last_fullsized":"2024-05-11T01:16:25.737658+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:25.737549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:25.737549+0000","last_clean_scrub_stamp":"2024-05-11T01:16:25.737549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:55:03.607468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"61'5","reported_seq":33,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:19.876847+0000","last_change":"2024-05-11T01:16:19.876847+0000","last_active":"2024-05-11T01:16:19.876847+0000","last_peered":"2024-05-11T01:16:19.876847+0000","last_clean":"2024-05-11T01:16:19.876847+0000","last_became_active":"2024-05-11T01:13:56.576868+0000","last_became_peered":"2024-05-11T01:13:56.576868+0000","last_unstale":"2024-05-11T01:16:19.876847+0000","last_undegraded":"2024-05-11T01:16:19.876847+0000","last_fullsized":"2024-05-11T01:16:19.876847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'5","last_scrub_stamp":"2024-05-11T01:16:19.876689+0000","last_deep_scrub":"61'5","last_deep_scrub_stamp":"2024-05-11T01:16:19.876689+0000","last_clean_scrub_stamp":"2024-05-11T01:16:19.876689+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:57.746608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:27.874909+0000","last_change":"2024-05-11T01:16:27.874934+0000","last_active":"2024-05-11T01:16:27.874909+0000","last_peered":"2024-05-11T01:16:27.874909+0000","last_clean":"2024-05-11T01:16:27.874909+0000","last_became_active":"2024-05-11T01:13:57.578573+0000","last_became_peered":"2024-05-11T01:13:57.578573+0000","last_unstale":"2024-05-11T01:16:27.874909+0000","last_undegraded":"2024-05-11T01:16:27.874909+0000","last_fullsized":"2024-05-11T01:16:27.874909+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:27.874820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:27.874820+0000","last_clean_scrub_stamp":"2024-05-11T01:16:27.874820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:31:39.395771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"61'13","reported_seq":41,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:16.130329+0000","last_change":"2024-05-11T01:16:16.130329+0000","last_active":"2024-05-11T01:16:16.130329+0000","last_peered":"2024-05-11T01:16:16.130329+0000","last_clean":"2024-05-11T01:16:16.130329+0000","last_became_active":"2024-05-11T01:13:56.576300+0000","last_became_peered":"2024-05-11T01:13:56.576300+0000","last_unstale":"2024-05-11T01:16:16.130329+0000","last_undegraded":"2024-05-11T01:16:16.130329+0000","last_fullsized":"2024-05-11T01:16:16.130329+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'13","last_scrub_stamp":"2024-05-11T01:16:16.130236+0000","last_deep_scrub":"61'13","last_deep_scrub_stamp":"2024-05-11T01:16:16.130236+0000","last_clean_scrub_stamp":"2024-05-11T01:16:16.130236+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:37:22.379399+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:24.613173+0000","last_change":"2024-05-11T01:16:24.613207+0000","last_active":"2024-05-11T01:16:24.613173+0000","last_peered":"2024-05-11T01:16:24.613173+0000","last_clean":"2024-05-11T01:16:24.613173+0000","last_became_active":"2024-05-11T01:13:57.587034+0000","last_became_peered":"2024-05-11T01:13:57.587034+0000","last_unstale":"2024-05-11T01:16:24.613173+0000","last_undegraded":"2024-05-11T01:16:24.613173+0000","last_fullsized":"2024-05-11T01:16:24.613173+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:24.613065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:24.613065+0000","last_clean_scrub_stamp":"2024-05-11T01:16:24.613065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:47:52.120040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"61'4","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:20.673591+0000","last_change":"2024-05-11T01:16:20.673623+0000","last_active":"2024-05-11T01:16:20.673591+0000","last_peered":"2024-05-11T01:16:20.673591+0000","last_clean":"2024-05-11T01:16:20.673591+0000","last_became_active":"2024-05-11T01:13:56.579247+0000","last_became_peered":"2024-05-11T01:13:56.579247+0000","last_unstale":"2024-05-11T01:16:20.673591+0000","last_undegraded":"2024-05-11T01:16:20.673591+0000","last_fullsized":"2024-05-11T01:16:20.673591+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'4","last_scrub_stamp":"2024-05-11T01:16:20.673496+0000","last_deep_scrub":"61'4","last_deep_scrub_stamp":"2024-05-11T01:16:20.673496+0000","last_clean_scrub_stamp":"2024-05-11T01:16:20.673496+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:42:01.432207+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:30.059770+0000","last_change":"2024-05-11T01:16:30.059808+0000","last_active":"2024-05-11T01:16:30.059770+0000","last_peered":"2024-05-11T01:16:30.059770+0000","last_clean":"2024-05-11T01:16:30.059770+0000","last_became_active":"2024-05-11T01:13:57.589439+0000","last_became_peered":"2024-05-11T01:13:57.589439+0000","last_unstale":"2024-05-11T01:16:30.059770+0000","last_undegraded":"2024-05-11T01:16:30.059770+0000","last_fullsized":"2024-05-11T01:16:30.059770+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:30.059658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:30.059658+0000","last_clean_scrub_stamp":"2024-05-11T01:16:30.059658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:19:18.511981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:17.795721+0000","last_change":"2024-05-11T01:16:17.795758+0000","last_active":"2024-05-11T01:16:17.795721+0000","last_peered":"2024-05-11T01:16:17.795721+0000","last_clean":"2024-05-11T01:16:17.795721+0000","last_became_active":"2024-05-11T01:13:56.570108+0000","last_became_peered":"2024-05-11T01:13:56.570108+0000","last_unstale":"2024-05-11T01:16:17.795721+0000","last_undegraded":"2024-05-11T01:16:17.795721+0000","last_fullsized":"2024-05-11T01:16:17.795721+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:17.795585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:17.795585+0000","last_clean_scrub_stamp":"2024-05-11T01:16:17.795585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:56:00.518703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:23.712505+0000","last_change":"2024-05-11T01:16:23.712531+0000","last_active":"2024-05-11T01:16:23.712505+0000","last_peered":"2024-05-11T01:16:23.712505+0000","last_clean":"2024-05-11T01:16:23.712505+0000","last_became_active":"2024-05-11T01:13:57.577018+0000","last_became_peered":"2024-05-11T01:13:57.577018+0000","last_unstale":"2024-05-11T01:16:23.712505+0000","last_undegraded":"2024-05-11T01:16:23.712505+0000","last_fullsized":"2024-05-11T01:16:23.712505+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:23.712388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:23.712388+0000","last_clean_scrub_stamp":"2024-05-11T01:16:23.712388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:39:14.375880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:19.707390+0000","last_change":"2024-05-11T01:16:19.707429+0000","last_active":"2024-05-11T01:16:19.707390+0000","last_peered":"2024-05-11T01:16:19.707390+0000","last_clean":"2024-05-11T01:16:19.707390+0000","last_became_active":"2024-05-11T01:13:56.579204+0000","last_became_peered":"2024-05-11T01:13:56.579204+0000","last_unstale":"2024-05-11T01:16:19.707390+0000","last_undegraded":"2024-05-11T01:16:19.707390+0000","last_fullsized":"2024-05-11T01:16:19.707390+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:19.707301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:19.707301+0000","last_clean_scrub_stamp":"2024-05-11T01:16:19.707301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:59:21.782586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:23.913137+0000","last_change":"2024-05-11T01:16:23.913157+0000","last_active":"2024-05-11T01:16:23.913137+0000","last_peered":"2024-05-11T01:16:23.913137+0000","last_clean":"2024-05-11T01:16:23.913137+0000","last_became_active":"2024-05-11T01:13:57.571698+0000","last_became_peered":"2024-05-11T01:13:57.571698+0000","last_unstale":"2024-05-11T01:16:23.913137+0000","last_undegraded":"2024-05-11T01:16:23.913137+0000","last_fullsized":"2024-05-11T01:16:23.913137+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:23.913058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:23.913058+0000","last_clean_scrub_stamp":"2024-05-11T01:16:23.913058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:24:19.827816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"61'12","reported_seq":40,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:18.076285+0000","last_change":"2024-05-11T01:16:18.076321+0000","last_active":"2024-05-11T01:16:18.076285+0000","last_peered":"2024-05-11T01:16:18.076285+0000","last_clean":"2024-05-11T01:16:18.076285+0000","last_became_active":"2024-05-11T01:13:56.575422+0000","last_became_peered":"2024-05-11T01:13:56.575422+0000","last_unstale":"2024-05-11T01:16:18.076285+0000","last_undegraded":"2024-05-11T01:16:18.076285+0000","last_fullsized":"2024-05-11T01:16:18.076285+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'12","last_scrub_stamp":"2024-05-11T01:16:18.076177+0000","last_deep_scrub":"61'12","last_deep_scrub_stamp":"2024-05-11T01:16:18.076177+0000","last_clean_scrub_stamp":"2024-05-11T01:16:18.076177+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:09:43.387301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:20.181514+0000","last_change":"2024-05-11T01:16:20.181556+0000","last_active":"2024-05-11T01:16:20.181514+0000","last_peered":"2024-05-11T01:16:20.181514+0000","last_clean":"2024-05-11T01:16:20.181514+0000","last_became_active":"2024-05-11T01:13:57.577283+0000","last_became_peered":"2024-05-11T01:13:57.577283+0000","last_unstale":"2024-05-11T01:16:20.181514+0000","last_undegraded":"2024-05-11T01:16:20.181514+0000","last_fullsized":"2024-05-11T01:16:20.181514+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:20.181421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:20.181421+0000","last_clean_scrub_stamp":"2024-05-11T01:16:20.181421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:20:50.427632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"61'2","reported_seq":30,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:15.142306+0000","last_change":"2024-05-11T01:16:15.142328+0000","last_active":"2024-05-11T01:16:15.142306+0000","last_peered":"2024-05-11T01:16:15.142306+0000","last_clean":"2024-05-11T01:16:15.142306+0000","last_became_active":"2024-05-11T01:13:56.572535+0000","last_became_peered":"2024-05-11T01:13:56.572535+0000","last_unstale":"2024-05-11T01:16:15.142306+0000","last_undegraded":"2024-05-11T01:16:15.142306+0000","last_fullsized":"2024-05-11T01:16:15.142306+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-05-11T01:16:15.142225+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-05-11T01:16:15.142225+0000","last_clean_scrub_stamp":"2024-05-11T01:16:15.142225+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:59:58.030759+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:29.080534+0000","last_change":"2024-05-11T01:16:29.080559+0000","last_active":"2024-05-11T01:16:29.080534+0000","last_peered":"2024-05-11T01:16:29.080534+0000","last_clean":"2024-05-11T01:16:29.080534+0000","last_became_active":"2024-05-11T01:13:57.588641+0000","last_became_peered":"2024-05-11T01:13:57.588641+0000","last_unstale":"2024-05-11T01:16:29.080534+0000","last_undegraded":"2024-05-11T01:16:29.080534+0000","last_fullsized":"2024-05-11T01:16:29.080534+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:29.080432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:29.080432+0000","last_clean_scrub_stamp":"2024-05-11T01:16:29.080432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:16:02.424369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"61'3","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:17.114138+0000","last_change":"2024-05-11T01:16:17.114166+0000","last_active":"2024-05-11T01:16:17.114138+0000","last_peered":"2024-05-11T01:16:17.114138+0000","last_clean":"2024-05-11T01:16:17.114138+0000","last_became_active":"2024-05-11T01:13:56.571143+0000","last_became_peered":"2024-05-11T01:13:56.571143+0000","last_unstale":"2024-05-11T01:16:17.114138+0000","last_undegraded":"2024-05-11T01:16:17.114138+0000","last_fullsized":"2024-05-11T01:16:17.114138+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'3","last_scrub_stamp":"2024-05-11T01:16:17.114048+0000","last_deep_scrub":"61'3","last_deep_scrub_stamp":"2024-05-11T01:16:17.114048+0000","last_clean_scrub_stamp":"2024-05-11T01:16:17.114048+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:46:32.100161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:17.660078+0000","last_change":"2024-05-11T01:16:17.660103+0000","last_active":"2024-05-11T01:16:17.660078+0000","last_peered":"2024-05-11T01:16:17.660078+0000","last_clean":"2024-05-11T01:16:17.660078+0000","last_became_active":"2024-05-11T01:13:57.572777+0000","last_became_peered":"2024-05-11T01:13:57.572777+0000","last_unstale":"2024-05-11T01:16:17.660078+0000","last_undegraded":"2024-05-11T01:16:17.660078+0000","last_fullsized":"2024-05-11T01:16:17.660078+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:17.659945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:17.659945+0000","last_clean_scrub_stamp":"2024-05-11T01:16:17.659945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:35:23.223735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"61'2","reported_seq":30,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:17.028675+0000","last_change":"2024-05-11T01:16:17.028704+0000","last_active":"2024-05-11T01:16:17.028675+0000","last_peered":"2024-05-11T01:16:17.028675+0000","last_clean":"2024-05-11T01:16:17.028675+0000","last_became_active":"2024-05-11T01:13:56.573737+0000","last_became_peered":"2024-05-11T01:13:56.573737+0000","last_unstale":"2024-05-11T01:16:17.028675+0000","last_undegraded":"2024-05-11T01:16:17.028675+0000","last_fullsized":"2024-05-11T01:16:17.028675+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-05-11T01:16:17.028590+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-05-11T01:16:17.028590+0000","last_clean_scrub_stamp":"2024-05-11T01:16:17.028590+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:19:13.821070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:19.707198+0000","last_change":"2024-05-11T01:16:19.707237+0000","last_active":"2024-05-11T01:16:19.707198+0000","last_peered":"2024-05-11T01:16:19.707198+0000","last_clean":"2024-05-11T01:16:19.707198+0000","last_became_active":"2024-05-11T01:13:57.576978+0000","last_became_peered":"2024-05-11T01:13:57.576978+0000","last_unstale":"2024-05-11T01:16:19.707198+0000","last_undegraded":"2024-05-11T01:16:19.707198+0000","last_fullsized":"2024-05-11T01:16:19.707198+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:19.707104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:19.707104+0000","last_clean_scrub_stamp":"2024-05-11T01:16:19.707104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:14:52.128851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:18.749144+0000","last_change":"2024-05-11T01:16:18.749174+0000","last_active":"2024-05-11T01:16:18.749144+0000","last_peered":"2024-05-11T01:16:18.749144+0000","last_clean":"2024-05-11T01:16:18.749144+0000","last_became_active":"2024-05-11T01:13:56.576646+0000","last_became_peered":"2024-05-11T01:13:56.576646+0000","last_unstale":"2024-05-11T01:16:18.749144+0000","last_undegraded":"2024-05-11T01:16:18.749144+0000","last_fullsized":"2024-05-11T01:16:18.749144+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:18.749040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:18.749040+0000","last_clean_scrub_stamp":"2024-05-11T01:16:18.749040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:06:48.434450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:24.744453+0000","last_change":"2024-05-11T01:16:24.744499+0000","last_active":"2024-05-11T01:16:24.744453+0000","last_peered":"2024-05-11T01:16:24.744453+0000","last_clean":"2024-05-11T01:16:24.744453+0000","last_became_active":"2024-05-11T01:13:57.577181+0000","last_became_peered":"2024-05-11T01:13:57.577181+0000","last_unstale":"2024-05-11T01:16:24.744453+0000","last_undegraded":"2024-05-11T01:16:24.744453+0000","last_fullsized":"2024-05-11T01:16:24.744453+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:24.744316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:24.744316+0000","last_clean_scrub_stamp":"2024-05-11T01:16:24.744316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:02:40.784058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"61'3","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:16.710789+0000","last_change":"2024-05-11T01:16:16.710842+0000","last_active":"2024-05-11T01:16:16.710789+0000","last_peered":"2024-05-11T01:16:16.710789+0000","last_clean":"2024-05-11T01:16:16.710789+0000","last_became_active":"2024-05-11T01:13:56.574193+0000","last_became_peered":"2024-05-11T01:13:56.574193+0000","last_unstale":"2024-05-11T01:16:16.710789+0000","last_undegraded":"2024-05-11T01:16:16.710789+0000","last_fullsized":"2024-05-11T01:16:16.710789+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'3","last_scrub_stamp":"2024-05-11T01:16:16.710704+0000","last_deep_scrub":"61'3","last_deep_scrub_stamp":"2024-05-11T01:16:16.710704+0000","last_clean_scrub_stamp":"2024-05-11T01:16:16.710704+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T12:54:33.195303+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:19.613331+0000","last_change":"2024-05-11T01:16:19.613359+0000","last_active":"2024-05-11T01:16:19.613331+0000","last_peered":"2024-05-11T01:16:19.613331+0000","last_clean":"2024-05-11T01:16:19.613331+0000","last_became_active":"2024-05-11T01:13:57.576410+0000","last_became_peered":"2024-05-11T01:13:57.576410+0000","last_unstale":"2024-05-11T01:16:19.613331+0000","last_undegraded":"2024-05-11T01:16:19.613331+0000","last_fullsized":"2024-05-11T01:16:19.613331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:19.613214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:19.613214+0000","last_clean_scrub_stamp":"2024-05-11T01:16:19.613214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:16:54.501076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:19.078671+0000","last_change":"2024-05-11T01:16:19.078705+0000","last_active":"2024-05-11T01:16:19.078671+0000","last_peered":"2024-05-11T01:16:19.078671+0000","last_clean":"2024-05-11T01:16:19.078671+0000","last_became_active":"2024-05-11T01:13:56.581299+0000","last_became_peered":"2024-05-11T01:13:56.581299+0000","last_unstale":"2024-05-11T01:16:19.078671+0000","last_undegraded":"2024-05-11T01:16:19.078671+0000","last_fullsized":"2024-05-11T01:16:19.078671+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:19.078576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:19.078576+0000","last_clean_scrub_stamp":"2024-05-11T01:16:19.078576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:21:55.149376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:17.113547+0000","last_change":"2024-05-11T01:16:17.113601+0000","last_active":"2024-05-11T01:16:17.113547+0000","last_peered":"2024-05-11T01:16:17.113547+0000","last_clean":"2024-05-11T01:16:17.113547+0000","last_became_active":"2024-05-11T01:13:57.566258+0000","last_became_peered":"2024-05-11T01:13:57.566258+0000","last_unstale":"2024-05-11T01:16:17.113547+0000","last_undegraded":"2024-05-11T01:16:17.113547+0000","last_fullsized":"2024-05-11T01:16:17.113547+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:17.113464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:17.113464+0000","last_clean_scrub_stamp":"2024-05-11T01:16:17.113464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:12:27.934343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:17.088148+0000","last_change":"2024-05-11T01:16:17.088167+0000","last_active":"2024-05-11T01:16:17.088148+0000","last_peered":"2024-05-11T01:16:17.088148+0000","last_clean":"2024-05-11T01:16:17.088148+0000","last_became_active":"2024-05-11T01:13:56.574726+0000","last_became_peered":"2024-05-11T01:13:56.574726+0000","last_unstale":"2024-05-11T01:16:17.088148+0000","last_undegraded":"2024-05-11T01:16:17.088148+0000","last_fullsized":"2024-05-11T01:16:17.088148+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:17.088075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:17.088075+0000","last_clean_scrub_stamp":"2024-05-11T01:16:17.088075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:37:27.368329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:21.054162+0000","last_change":"2024-05-11T01:16:21.054185+0000","last_active":"2024-05-11T01:16:21.054162+0000","last_peered":"2024-05-11T01:16:21.054162+0000","last_clean":"2024-05-11T01:16:21.054162+0000","last_became_active":"2024-05-11T01:13:57.575723+0000","last_became_peered":"2024-05-11T01:13:57.575723+0000","last_unstale":"2024-05-11T01:16:21.054162+0000","last_undegraded":"2024-05-11T01:16:21.054162+0000","last_fullsized":"2024-05-11T01:16:21.054162+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:21.054069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:21.054069+0000","last_clean_scrub_stamp":"2024-05-11T01:16:21.054069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:32:50.469426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:18.834744+0000","last_change":"2024-05-11T01:16:18.834769+0000","last_active":"2024-05-11T01:16:18.834744+0000","last_peered":"2024-05-11T01:16:18.834744+0000","last_clean":"2024-05-11T01:16:18.834744+0000","last_became_active":"2024-05-11T01:13:56.571735+0000","last_became_peered":"2024-05-11T01:13:56.571735+0000","last_unstale":"2024-05-11T01:16:18.834744+0000","last_undegraded":"2024-05-11T01:16:18.834744+0000","last_fullsized":"2024-05-11T01:16:18.834744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:18.834653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:18.834653+0000","last_clean_scrub_stamp":"2024-05-11T01:16:18.834653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:02:34.874395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:25.586473+0000","last_change":"2024-05-11T01:16:25.586533+0000","last_active":"2024-05-11T01:16:25.586473+0000","last_peered":"2024-05-11T01:16:25.586473+0000","last_clean":"2024-05-11T01:16:25.586473+0000","last_became_active":"2024-05-11T01:13:57.587255+0000","last_became_peered":"2024-05-11T01:13:57.587255+0000","last_unstale":"2024-05-11T01:16:25.586473+0000","last_undegraded":"2024-05-11T01:16:25.586473+0000","last_fullsized":"2024-05-11T01:16:25.586473+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:25.586365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:25.586365+0000","last_clean_scrub_stamp":"2024-05-11T01:16:25.586365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:44:04.238610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"61'3","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:15.694778+0000","last_change":"2024-05-11T01:16:15.694800+0000","last_active":"2024-05-11T01:16:15.694778+0000","last_peered":"2024-05-11T01:16:15.694778+0000","last_clean":"2024-05-11T01:16:15.694778+0000","last_became_active":"2024-05-11T01:13:56.569400+0000","last_became_peered":"2024-05-11T01:13:56.569400+0000","last_unstale":"2024-05-11T01:16:15.694778+0000","last_undegraded":"2024-05-11T01:16:15.694778+0000","last_fullsized":"2024-05-11T01:16:15.694778+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'3","last_scrub_stamp":"2024-05-11T01:16:15.694697+0000","last_deep_scrub":"61'3","last_deep_scrub_stamp":"2024-05-11T01:16:15.694697+0000","last_clean_scrub_stamp":"2024-05-11T01:16:15.694697+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:10:19.839135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:26.055978+0000","last_change":"2024-05-11T01:16:26.056007+0000","last_active":"2024-05-11T01:16:26.055978+0000","last_peered":"2024-05-11T01:16:26.055978+0000","last_clean":"2024-05-11T01:16:26.055978+0000","last_became_active":"2024-05-11T01:13:57.577948+0000","last_became_peered":"2024-05-11T01:13:57.577948+0000","last_unstale":"2024-05-11T01:16:26.055978+0000","last_undegraded":"2024-05-11T01:16:26.055978+0000","last_fullsized":"2024-05-11T01:16:26.055978+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:26.055884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:26.055884+0000","last_clean_scrub_stamp":"2024-05-11T01:16:26.055884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T07:33:44.133749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:22.892943+0000","last_change":"2024-05-11T01:16:22.892988+0000","last_active":"2024-05-11T01:16:22.892943+0000","last_peered":"2024-05-11T01:16:22.892943+0000","last_clean":"2024-05-11T01:16:22.892943+0000","last_became_active":"2024-05-11T01:13:56.581048+0000","last_became_peered":"2024-05-11T01:13:56.581048+0000","last_unstale":"2024-05-11T01:16:22.892943+0000","last_undegraded":"2024-05-11T01:16:22.892943+0000","last_fullsized":"2024-05-11T01:16:22.892943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:22.892819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:22.892819+0000","last_clean_scrub_stamp":"2024-05-11T01:16:22.892819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:32:35.559163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:26.903112+0000","last_change":"2024-05-11T01:16:26.903136+0000","last_active":"2024-05-11T01:16:26.903112+0000","last_peered":"2024-05-11T01:16:26.903112+0000","last_clean":"2024-05-11T01:16:26.903112+0000","last_became_active":"2024-05-11T01:13:57.577146+0000","last_became_peered":"2024-05-11T01:13:57.577146+0000","last_unstale":"2024-05-11T01:16:26.903112+0000","last_undegraded":"2024-05-11T01:16:26.903112+0000","last_fullsized":"2024-05-11T01:16:26.903112+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:26.902985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:26.902985+0000","last_clean_scrub_stamp":"2024-05-11T01:16:26.902985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T05:45:43.173698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:15.589540+0000","last_change":"2024-05-11T01:16:15.589584+0000","last_active":"2024-05-11T01:16:15.589540+0000","last_peered":"2024-05-11T01:16:15.589540+0000","last_clean":"2024-05-11T01:16:15.589540+0000","last_became_active":"2024-05-11T01:13:56.575971+0000","last_became_peered":"2024-05-11T01:13:56.575971+0000","last_unstale":"2024-05-11T01:16:15.589540+0000","last_undegraded":"2024-05-11T01:16:15.589540+0000","last_fullsized":"2024-05-11T01:16:15.589540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:15.589448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:15.589448+0000","last_clean_scrub_stamp":"2024-05-11T01:16:15.589448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T10:30:56.641514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:28.752057+0000","last_change":"2024-05-11T01:16:28.752080+0000","last_active":"2024-05-11T01:16:28.752057+0000","last_peered":"2024-05-11T01:16:28.752057+0000","last_clean":"2024-05-11T01:16:28.752057+0000","last_became_active":"2024-05-11T01:13:57.579350+0000","last_became_peered":"2024-05-11T01:13:57.579350+0000","last_unstale":"2024-05-11T01:16:28.752057+0000","last_undegraded":"2024-05-11T01:16:28.752057+0000","last_fullsized":"2024-05-11T01:16:28.752057+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:28.751941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:28.751941+0000","last_clean_scrub_stamp":"2024-05-11T01:16:28.751941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:32:41.418284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:20.908494+0000","last_change":"2024-05-11T01:16:20.908519+0000","last_active":"2024-05-11T01:16:20.908494+0000","last_peered":"2024-05-11T01:16:20.908494+0000","last_clean":"2024-05-11T01:16:20.908494+0000","last_became_active":"2024-05-11T01:13:56.576917+0000","last_became_peered":"2024-05-11T01:13:56.576917+0000","last_unstale":"2024-05-11T01:16:20.908494+0000","last_undegraded":"2024-05-11T01:16:20.908494+0000","last_fullsized":"2024-05-11T01:16:20.908494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:20.908407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:20.908407+0000","last_clean_scrub_stamp":"2024-05-11T01:16:20.908407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T13:00:13.278169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:27.726967+0000","last_change":"2024-05-11T01:16:27.726989+0000","last_active":"2024-05-11T01:16:27.726967+0000","last_peered":"2024-05-11T01:16:27.726967+0000","last_clean":"2024-05-11T01:16:27.726967+0000","last_became_active":"2024-05-11T01:13:57.577922+0000","last_became_peered":"2024-05-11T01:13:57.577922+0000","last_unstale":"2024-05-11T01:16:27.726967+0000","last_undegraded":"2024-05-11T01:16:27.726967+0000","last_fullsized":"2024-05-11T01:16:27.726967+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:27.726869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:27.726869+0000","last_clean_scrub_stamp":"2024-05-11T01:16:27.726869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:45:28.431249+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:18.092500+0000","last_change":"2024-05-11T01:16:18.092526+0000","last_active":"2024-05-11T01:16:18.092500+0000","last_peered":"2024-05-11T01:16:18.092500+0000","last_clean":"2024-05-11T01:16:18.092500+0000","last_became_active":"2024-05-11T01:13:56.573347+0000","last_became_peered":"2024-05-11T01:13:56.573347+0000","last_unstale":"2024-05-11T01:16:18.092500+0000","last_undegraded":"2024-05-11T01:16:18.092500+0000","last_fullsized":"2024-05-11T01:16:18.092500+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:18.092398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:18.092398+0000","last_clean_scrub_stamp":"2024-05-11T01:16:18.092398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T01:23:35.664034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:21.145471+0000","last_change":"2024-05-11T01:16:21.145494+0000","last_active":"2024-05-11T01:16:21.145471+0000","last_peered":"2024-05-11T01:16:21.145471+0000","last_clean":"2024-05-11T01:16:21.145471+0000","last_became_active":"2024-05-11T01:13:57.582398+0000","last_became_peered":"2024-05-11T01:13:57.582398+0000","last_unstale":"2024-05-11T01:16:21.145471+0000","last_undegraded":"2024-05-11T01:16:21.145471+0000","last_fullsized":"2024-05-11T01:16:21.145471+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:21.145343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:21.145343+0000","last_clean_scrub_stamp":"2024-05-11T01:16:21.145343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T11:19:12.264737+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:16.629879+0000","last_change":"2024-05-11T01:16:16.629930+0000","last_active":"2024-05-11T01:16:16.629879+0000","last_peered":"2024-05-11T01:16:16.629879+0000","last_clean":"2024-05-11T01:16:16.629879+0000","last_became_active":"2024-05-11T01:13:56.576756+0000","last_became_peered":"2024-05-11T01:13:56.576756+0000","last_unstale":"2024-05-11T01:16:16.629879+0000","last_undegraded":"2024-05-11T01:16:16.629879+0000","last_fullsized":"2024-05-11T01:16:16.629879+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:16.629788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:16.629788+0000","last_clean_scrub_stamp":"2024-05-11T01:16:16.629788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T08:35:17.462485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:21.077125+0000","last_change":"2024-05-11T01:16:21.077147+0000","last_active":"2024-05-11T01:16:21.077125+0000","last_peered":"2024-05-11T01:16:21.077125+0000","last_clean":"2024-05-11T01:16:21.077125+0000","last_became_active":"2024-05-11T01:13:57.575239+0000","last_became_peered":"2024-05-11T01:13:57.575239+0000","last_unstale":"2024-05-11T01:16:21.077125+0000","last_undegraded":"2024-05-11T01:16:21.077125+0000","last_fullsized":"2024-05-11T01:16:21.077125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:21.077036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:21.077036+0000","last_clean_scrub_stamp":"2024-05-11T01:16:21.077036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T03:45:52.345298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:19.077992+0000","last_change":"2024-05-11T01:16:19.078030+0000","last_active":"2024-05-11T01:16:19.077992+0000","last_peered":"2024-05-11T01:16:19.077992+0000","last_clean":"2024-05-11T01:16:19.077992+0000","last_became_active":"2024-05-11T01:13:56.575838+0000","last_became_peered":"2024-05-11T01:13:56.575838+0000","last_unstale":"2024-05-11T01:16:19.077992+0000","last_undegraded":"2024-05-11T01:16:19.077992+0000","last_fullsized":"2024-05-11T01:16:19.077992+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:19.077860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:19.077860+0000","last_clean_scrub_stamp":"2024-05-11T01:16:19.077860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T02:14:51.499607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:28.094580+0000","last_change":"2024-05-11T01:16:28.094626+0000","last_active":"2024-05-11T01:16:28.094580+0000","last_peered":"2024-05-11T01:16:28.094580+0000","last_clean":"2024-05-11T01:16:28.094580+0000","last_became_active":"2024-05-11T01:13:57.586986+0000","last_became_peered":"2024-05-11T01:13:57.586986+0000","last_unstale":"2024-05-11T01:16:28.094580+0000","last_undegraded":"2024-05-11T01:16:28.094580+0000","last_fullsized":"2024-05-11T01:16:28.094580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-11T01:16:28.094475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-11T01:16:28.094475+0000","last_clean_scrub_stamp":"2024-05-11T01:16:28.094475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:49:17.175411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"61'3","reported_seq":31,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:18.031357+0000","last_change":"2024-05-11T01:16:18.031407+0000","last_active":"2024-05-11T01:16:18.031357+0000","last_peered":"2024-05-11T01:16:18.031357+0000","last_clean":"2024-05-11T01:16:18.031357+0000","last_became_active":"2024-05-11T01:13:56.579637+0000","last_became_peered":"2024-05-11T01:13:56.579637+0000","last_unstale":"2024-05-11T01:16:18.031357+0000","last_undegraded":"2024-05-11T01:16:18.031357+0000","last_fullsized":"2024-05-11T01:16:18.031357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'3","last_scrub_stamp":"2024-05-11T01:16:18.031257+0000","last_deep_scrub":"61'3","last_deep_scrub_stamp":"2024-05-11T01:16:18.031257+0000","last_clean_scrub_stamp":"2024-05-11T01:16:18.031257+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T06:07:20.439243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"61'88","reported_seq":260,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-05-11T01:16:16.765449+0000","last_change":"2024-05-11T01:16:16.765498+0000","last_active":"2024-05-11T01:16:16.765449+0000","last_peered":"2024-05-11T01:16:16.765449+0000","last_clean":"2024-05-11T01:16:16.765449+0000","last_became_active":"2024-05-11T01:01:05.480632+0000","last_became_peered":"2024-05-11T01:01:05.480632+0000","last_unstale":"2024-05-11T01:16:16.765449+0000","last_undegraded":"2024-05-11T01:16:16.765449+0000","last_fullsized":"2024-05-11T01:16:16.765449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'88","last_scrub_stamp":"2024-05-11T01:16:16.765339+0000","last_deep_scrub":"61'88","last_deep_scrub_stamp":"2024-05-11T01:16:16.765339+0000","last_clean_scrub_stamp":"2024-05-11T01:16:16.765339+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-12T04:34:29.228962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3794,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1323008,"data_stored":932360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":733184,"data_stored":342574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54104,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317736,"statfs":{"total":96636764160,"available":96581361664,"internally_reserved":0,"allocated":737280,"data_stored":344898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40216,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331624,"statfs":{"total":96636764160,"available":96595582976,"internally_reserved":0,"allocated":737280,"data_stored":342540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":741376,"data_stored":344920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58256,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313584,"statfs":{"total":96636764160,"available":96577110016,"internally_reserved":0,"allocated":729088,"data_stored":341972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36628,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335212,"statfs":{"total":96636764160,"available":96599257088,"internally_reserved":0,"allocated":1323008,"data_stored":932304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-11T01:16:37.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-11T01:16:37.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.593+0000 7f4a7e338640 1 Processor -- start 2024-05-11T01:16:37.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.593+0000 7f4a7e338640 1 -- start start 2024-05-11T01:16:37.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a7e338640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4a78145b30 0x7f4a78160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a7e338640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a780b2bf0 0x7f4a780b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a7e338640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a78073ca0 con 0x7f4a780b3f60 2024-05-11T01:16:37.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a7e338640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4a780b3590 con 0x7f4a78145b30 2024-05-11T01:16:37.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a7e338640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4a780b4e20 con 0x7f4a780b2bf0 2024-05-11T01:16:37.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a77fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4a78145b30 0x7f4a78160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a7c8d5640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4a780b3f60 0x7f4a78072380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38774/0 (socket says 172.21.15.16:38774) 2024-05-11T01:16:37.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a7c8d5640 1 -- 172.21.15.16:0/128925355 learned_addr learned my addr 172.21.15.16:0/128925355 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:37.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a777fe640 1 --2- 172.21.15.16:0/128925355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a780b2bf0 0x7f4a780b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a77fff640 1 -- 172.21.15.16:0/128925355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a780b2bf0 msgr2=0x7f4a780b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-11T01:16:37.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a77fff640 1 --2- 172.21.15.16:0/128925355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a780b2bf0 0x7f4a780b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a77fff640 1 -- 172.21.15.16:0/128925355 >> v1:172.21.15.16:6789/0 conn(0x7f4a780b3f60 legacy=0x7f4a78072380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a77fff640 1 -- 172.21.15.16:0/128925355 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a780b4b40 con 0x7f4a78145b30 2024-05-11T01:16:37.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.594+0000 7f4a76ffd640 1 -- 172.21.15.16:0/128925355 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261879575 0 0) 0x7f4a70001490 con 0x7f4a780b3f60 2024-05-11T01:16:37.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.595+0000 7f4a77fff640 1 --2- 172.21.15.16:0/128925355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a78145b30 0x7f4a78160920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4a680097a0 tx=0x7f4a6802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d8668a6f09482d server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.595+0000 7f4a76ffd640 1 -- 172.21.15.16:0/128925355 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68037070 con 0x7f4a78145b30 2024-05-11T01:16:37.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.595+0000 7f4a76ffd640 1 -- 172.21.15.16:0/128925355 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a68032440 con 0x7f4a78145b30 2024-05-11T01:16:37.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.595+0000 7f4a76ffd640 1 -- 172.21.15.16:0/128925355 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68032810 con 0x7f4a78145b30 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.596+0000 7f4a7e338640 1 -- 172.21.15.16:0/128925355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a78145b30 msgr2=0x7f4a78160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.596+0000 7f4a7e338640 1 --2- 172.21.15.16:0/128925355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a78145b30 0x7f4a78160920 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4a680097a0 tx=0x7f4a6802a180 comp rx=0 tx=0).stop 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.596+0000 7f4a7e338640 1 -- 172.21.15.16:0/128925355 shutdown_connections 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.596+0000 7f4a7e338640 1 --2- 172.21.15.16:0/128925355 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a780b2bf0 0x7f4a780b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.596+0000 7f4a7e338640 1 --2- 172.21.15.16:0/128925355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a78145b30 0x7f4a78160920 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.596+0000 7f4a7e338640 1 -- 172.21.15.16:0/128925355 >> 172.21.15.16:0/128925355 conn(0x7f4a7806c3e0 msgr2=0x7f4a7806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.596+0000 7f4a7e338640 1 -- 172.21.15.16:0/128925355 shutdown_connections 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.596+0000 7f4a7e338640 1 -- 172.21.15.16:0/128925355 wait complete. 2024-05-11T01:16:37.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.597+0000 7f4a7e338640 1 Processor -- start 2024-05-11T01:16:37.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.597+0000 7f4a7e338640 1 -- start start 2024-05-11T01:16:37.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a7e338640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a780b2bf0 0x7f4a78132a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a7e338640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a780b3f60 0x7f4a78134940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a7e338640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a78145b30 0x7f4a78134e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a7e338640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4a78160400 con 0x7f4a780b2bf0 2024-05-11T01:16:37.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a7e338640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4a78160120 con 0x7f4a780b3f60 2024-05-11T01:16:37.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a7e338640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f4a780b43f0 con 0x7f4a78145b30 2024-05-11T01:16:37.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a780b2bf0 0x7f4a78132a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a780b2bf0 0x7f4a78132a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56544/0 (socket says 172.21.15.16:56544) 2024-05-11T01:16:37.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a77fff640 1 -- 172.21.15.16:0/1772553472 learned_addr learned my addr 172.21.15.16:0/1772553472 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:37.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a7c8d5640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a78145b30 0x7f4a78134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a777fe640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a780b3f60 0x7f4a78134940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a77fff640 1 -- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a78145b30 msgr2=0x7f4a78134e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a77fff640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a78145b30 0x7f4a78134e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a77fff640 1 -- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a780b3f60 msgr2=0x7f4a78134940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a77fff640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a780b3f60 0x7f4a78134940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.598+0000 7f4a77fff640 1 -- 172.21.15.16:0/1772553472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a781319c0 con 0x7f4a780b2bf0 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.599+0000 7f4a77fff640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a780b2bf0 0x7f4a78132a60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4a680098c0 tx=0x7f4a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.599+0000 7f4a74ff9640 1 -- 172.21.15.16:0/1772553472 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68037040 con 0x7f4a780b2bf0 2024-05-11T01:16:37.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.599+0000 7f4a74ff9640 1 -- 172.21.15.16:0/1772553472 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a68030500 con 0x7f4a780b2bf0 2024-05-11T01:16:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.599+0000 7f4a74ff9640 1 -- 172.21.15.16:0/1772553472 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a680308d0 con 0x7f4a780b2bf0 2024-05-11T01:16:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.599+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a78131ca0 con 0x7f4a780b2bf0 2024-05-11T01:16:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.599+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a78132260 con 0x7f4a780b2bf0 2024-05-11T01:16:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.600+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a7806a5b0 con 0x7f4a780b2bf0 2024-05-11T01:16:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.600+0000 7f4a74ff9640 1 -- 172.21.15.16:0/1772553472 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f4a68044020 con 0x7f4a780b2bf0 2024-05-11T01:16:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.601+0000 7f4a74ff9640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4a640762d0 0x7f4a64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.601+0000 7f4a74ff9640 1 -- 172.21.15.16:0/1772553472 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f4a680b79b0 con 0x7f4a780b2bf0 2024-05-11T01:16:37.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.601+0000 7f4a777fe640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4a640762d0 0x7f4a64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.602+0000 7f4a777fe640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4a640762d0 0x7f4a64078790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a780d2020 tx=0x7f4a6c009190 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.605+0000 7f4a74ff9640 1 -- 172.21.15.16:0/1772553472 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4a68080a70 con 0x7f4a780b2bf0 2024-05-11T01:16:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.796+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f4a7806cbf0 con 0x7f4a780b2bf0 2024-05-11T01:16:37.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.799+0000 7f4a74ff9640 1 -- 172.21.15.16:0/1772553472 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v17)=0 v17) ==== 123+0+0 (secure 0 0 0) 0x7f4a68084d70 con 0x7f4a780b2bf0 2024-05-11T01:16:37.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.800+0000 7f4a74ff9640 1 -- 172.21.15.16:0/1772553472 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4a680bd080 con 0x7f4a780b2bf0 2024-05-11T01:16:37.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4a640762d0 msgr2=0x7f4a64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4a640762d0 0x7f4a64078790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a780d2020 tx=0x7f4a6c009190 comp rx=0 tx=0).stop 2024-05-11T01:16:37.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a780b2bf0 msgr2=0x7f4a78132a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a780b2bf0 0x7f4a78132a60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4a680098c0 tx=0x7f4a680046c0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 shutdown_connections 2024-05-11T01:16:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f4a78145b30 0x7f4a78134e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f4a640762d0 0x7f4a64078790 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4a780b3f60 0x7f4a78134940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 --2- 172.21.15.16:0/1772553472 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a780b2bf0 0x7f4a78132a60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 >> 172.21.15.16:0/1772553472 conn(0x7f4a7806c3e0 msgr2=0x7f4a78144780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 shutdown_connections 2024-05-11T01:16:37.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.802+0000 7f4a7e338640 1 -- 172.21.15.16:0/1772553472 wait complete. 2024-05-11T01:16:37.812 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-11T01:16:37.812 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-11T01:16:37.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.917+0000 7f1642b51640 1 Processor -- start 2024-05-11T01:16:37.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.917+0000 7f1642b51640 1 -- start start 2024-05-11T01:16:37.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.918+0000 7f1642b51640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f163c0b4cf0 0x7f163c0d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.918+0000 7f1642b51640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f163c0d16e0 con 0x7f163c164010 2024-05-11T01:16:37.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.918+0000 7f1642b51640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f163c0d30c0 con 0x7f163c0d0d40 2024-05-11T01:16:37.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.918+0000 7f1642b51640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 -- 0x7f163c0d33a0 con 0x7f163c0b4cf0 2024-05-11T01:16:37.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.918+0000 7f163bfff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f163c164010 0x7f163c0b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38780/0 (socket says 172.21.15.16:38780) 2024-05-11T01:16:37.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.918+0000 7f163bfff640 1 -- 172.21.15.16:0/3628244807 learned_addr learned my addr 172.21.15.16:0/3628244807 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-05-11T01:16:37.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.918+0000 7f16408ed640 1 --2- 172.21.15.16:0/3628244807 >> v2:172.21.15.174:3300/0 conn(0x7f163c0b4cf0 0x7f163c0d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.919+0000 7f163b7fe640 1 -- 172.21.15.16:0/3628244807 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2267295788 0 0) 0x7f163c0d16e0 con 0x7f163c164010 2024-05-11T01:16:37.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.919+0000 7f163b7fe640 1 -- 172.21.15.16:0/3628244807 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1624003520 con 0x7f163c164010 2024-05-11T01:16:37.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.919+0000 7f16408ed640 1 -- 172.21.15.16:0/3628244807 >> v1:172.21.15.174:6789/0 conn(0x7f163c0d0d40 legacy=0x7f163c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.919+0000 7f16408ed640 1 -- 172.21.15.16:0/3628244807 >> v1:172.21.15.16:6789/0 conn(0x7f163c164010 legacy=0x7f163c0b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.919+0000 7f16408ed640 1 -- 172.21.15.16:0/3628244807 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163c0d3680 con 0x7f163c0b4cf0 2024-05-11T01:16:37.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f16408ed640 1 --2- 172.21.15.16:0/3628244807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 0x7f163c0d3ba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1634009d90 tx=0x7f163402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b6464356a74026 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f163b7fe640 1 -- 172.21.15.16:0/3628244807 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634007740 con 0x7f163c0b4cf0 2024-05-11T01:16:37.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f163b7fe640 1 -- 172.21.15.16:0/3628244807 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f16340078e0 con 0x7f163c0b4cf0 2024-05-11T01:16:37.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f163b7fe640 1 -- 172.21.15.16:0/3628244807 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634007c90 con 0x7f163c0b4cf0 2024-05-11T01:16:37.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f1642b51640 1 -- 172.21.15.16:0/3628244807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 msgr2=0x7f163c0d3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f1642b51640 1 --2- 172.21.15.16:0/3628244807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 0x7f163c0d3ba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1634009d90 tx=0x7f163402a6f0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f1642b51640 1 -- 172.21.15.16:0/3628244807 shutdown_connections 2024-05-11T01:16:37.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f1642b51640 1 --2- 172.21.15.16:0/3628244807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 0x7f163c0d3ba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f1642b51640 1 -- 172.21.15.16:0/3628244807 >> 172.21.15.16:0/3628244807 conn(0x7f163c0681c0 msgr2=0x7f163c0685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:37.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f1642b51640 1 -- 172.21.15.16:0/3628244807 shutdown_connections 2024-05-11T01:16:37.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.920+0000 7f1642b51640 1 -- 172.21.15.16:0/3628244807 wait complete. 2024-05-11T01:16:37.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.921+0000 7f1642b51640 1 Processor -- start 2024-05-11T01:16:37.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.922+0000 7f1642b51640 1 -- start start 2024-05-11T01:16:37.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.922+0000 7f1642b51640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 0x7f163c0b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.922+0000 7f1642b51640 1 --2- >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f163c0d0d40 0x7f163c1ea990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.922+0000 7f1642b51640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f163c164010 0x7f163c15fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.922+0000 7f1642b51640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f163c0d11d0 con 0x7f163c164010 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.922+0000 7f1642b51640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f163c15fa80 con 0x7f163c0b4cf0 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.922+0000 7f1642b51640 1 -- --> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] -- mon_getmap magic: 0 -- 0x7f163c0d1350 con 0x7f163c0d0d40 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.922+0000 7f16410ee640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f163c164010 0x7f163c15fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16410ee640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f163c164010 0x7f163c15fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56560/0 (socket says 172.21.15.16:56560) 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16410ee640 1 -- 172.21.15.16:0/132309293 learned_addr learned my addr 172.21.15.16:0/132309293 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16408ed640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 0x7f163c0b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f163bfff640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f163c0d0d40 0x7f163c1ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16410ee640 1 -- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f163c0d0d40 msgr2=0x7f163c1ea990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16410ee640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f163c0d0d40 0x7f163c1ea990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16410ee640 1 -- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 msgr2=0x7f163c0b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:37.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16410ee640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 0x7f163c0b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:37.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16410ee640 1 -- 172.21.15.16:0/132309293 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163c0b5d80 con 0x7f163c164010 2024-05-11T01:16:37.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16410ee640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f163c164010 0x7f163c15fee0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f162c00c3c0 tx=0x7f162c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16397fa640 1 -- 172.21.15.16:0/132309293 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c017070 con 0x7f163c164010 2024-05-11T01:16:37.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16397fa640 1 -- 172.21.15.16:0/132309293 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f162c0052d0 con 0x7f163c164010 2024-05-11T01:16:37.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f163c1608c0 con 0x7f163c164010 2024-05-11T01:16:37.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f16397fa640 1 -- 172.21.15.16:0/132309293 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c003830 con 0x7f163c164010 2024-05-11T01:16:37.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.923+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f163c0b6300 con 0x7f163c164010 2024-05-11T01:16:37.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.924+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f163c06a5b0 con 0x7f163c164010 2024-05-11T01:16:37.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.925+0000 7f16397fa640 1 -- 172.21.15.16:0/132309293 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 18) ==== 98201+0+0 (secure 0 0 0) 0x7f162c01a070 con 0x7f163c164010 2024-05-11T01:16:37.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.925+0000 7f16397fa640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f16280762d0 0x7f1628078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-11T01:16:37.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.926+0000 7f16397fa640 1 -- 172.21.15.16:0/132309293 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6131+0+0 (secure 0 0 0) 0x7f162c096aa0 con 0x7f163c164010 2024-05-11T01:16:37.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.926+0000 7f16408ed640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f16280762d0 0x7f1628078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-11T01:16:37.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.926+0000 7f16408ed640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f16280762d0 0x7f1628078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1634034000 tx=0x7f163402f000 comp rx=0 tx=0).ready entity=mgr.4874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-11T01:16:37.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:37.930+0000 7f16397fa640 1 -- 172.21.15.16:0/132309293 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f162c05fb60 con 0x7f163c164010 2024-05-11T01:16:38.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.157+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f163c0d07b0 con 0x7f163c164010 2024-05-11T01:16:38.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.158+0000 7f16397fa640 1 -- 172.21.15.16:0/132309293 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5184 (secure 0 0 0) 0x7f162c0681a0 con 0x7f163c164010 2024-05-11T01:16:38.157 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-05-11T01:16:38.158 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/2061855514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":2061855514},{"type":"v1","addr":"172.21.15.16:6835","nonce":2061855514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/1304273524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":1304273524},{"type":"v1","addr":"172.21.15.174:6836","nonce":1304273524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/878993880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":878993880},{"type":"v1","addr":"172.21.15.174:6837","nonce":878993880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-11T01:13:56.948645+0000","modified":"2024-05-11T01:13:59.949604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6834/3060746236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3060746236},{"type":"v1","addr":"172.21.15.16:6834","nonce":3060746236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5610,"qdb_cluster":[5610]},"id":3}]} 2024-05-11T01:16:38.158 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 25 2024-05-11T01:16:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f16280762d0 msgr2=0x7f1628078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f16280762d0 0x7f1628078790 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1634034000 tx=0x7f163402f000 comp rx=0 tx=0).stop 2024-05-11T01:16:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f163c164010 msgr2=0x7f163c15fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-11T01:16:38.159 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f163c164010 0x7f163c15fee0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f162c00c3c0 tx=0x7f162c00c880 comp rx=0 tx=0).stop 2024-05-11T01:16:38.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 shutdown_connections 2024-05-11T01:16:38.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f163c164010 0x7f163c15fee0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:38.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:3301/0,v1:172.21.15.174:6790/0] conn(0x7f163c0d0d40 0x7f163c1ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:38.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:6832/2049624093,v1:172.21.15.174:6833/2049624093] conn(0x7f16280762d0 0x7f1628078790 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:38.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 --2- 172.21.15.16:0/132309293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f163c0b4cf0 0x7f163c0b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-11T01:16:38.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 >> 172.21.15.16:0/132309293 conn(0x7f163c0681c0 msgr2=0x7f163c0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-11T01:16:38.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 shutdown_connections 2024-05-11T01:16:38.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-05-11T01:16:38.160+0000 7f1642b51640 1 -- 172.21.15.16:0/132309293 wait complete. 2024-05-11T01:16:38.170 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-11T01:16:38.170 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-11T01:16:38.170 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-11T01:16:38.171 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.180 INFO:tasks.ceph.mds.a:Stopped 2024-05-11T01:16:38.181 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-11T01:16:38.181 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.230 INFO:tasks.ceph.mds.c:Stopped 2024-05-11T01:16:38.230 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-11T01:16:38.230 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.242 INFO:tasks.ceph.mds.b:Stopped 2024-05-11T01:16:38.242 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-11T01:16:38.242 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.294 INFO:tasks.ceph.mds.d:Stopped 2024-05-11T01:16:38.294 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-11T01:16:38.295 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-11T01:16:38.295 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.325 INFO:tasks.ceph.osd.0:Stopped 2024-05-11T01:16:38.325 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-11T01:16:38.325 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.395 INFO:tasks.ceph.osd.1:Stopped 2024-05-11T01:16:38.395 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-11T01:16:38.395 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.464 INFO:tasks.ceph.osd.2:Stopped 2024-05-11T01:16:38.465 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-11T01:16:38.465 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.532 INFO:tasks.ceph.osd.3:Stopped 2024-05-11T01:16:38.532 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-11T01:16:38.532 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.573 INFO:tasks.ceph.osd.4:Stopped 2024-05-11T01:16:38.573 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-11T01:16:38.574 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.623 INFO:tasks.ceph.osd.5:Stopped 2024-05-11T01:16:38.623 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-11T01:16:38.623 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.659 INFO:tasks.ceph.osd.6:Stopped 2024-05-11T01:16:38.659 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-11T01:16:38.660 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.730 INFO:tasks.ceph.osd.7:Stopped 2024-05-11T01:16:38.730 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-11T01:16:38.731 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-11T01:16:38.731 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.757 INFO:tasks.ceph.mgr.y:Stopped 2024-05-11T01:16:38.757 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-11T01:16:38.757 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.801 INFO:tasks.ceph.mgr.x:Stopped 2024-05-11T01:16:38.802 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-11T01:16:38.802 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-11T01:16:38.802 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.813 INFO:tasks.ceph.mon.a:Stopped 2024-05-11T01:16:38.814 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-11T01:16:38.814 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.854 INFO:tasks.ceph.mon.b:Stopped 2024-05-11T01:16:38.855 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-11T01:16:38.855 INFO:teuthology.orchestra.run:waiting for 300 2024-05-11T01:16:38.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-11T01:16:38.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-11T01:16:38.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-11T01:16:38.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-11T01:16:38.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-11T01:16:38.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-11T01:16:38.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-11T01:16:38.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-11T01:16:38.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-11T01:16:38.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-11T01:16:38.908 INFO:tasks.ceph.mon.c:Stopped 2024-05-11T01:16:38.908 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-11T01:16:38.909 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-05-11T01:16:38.949 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:16:38.949 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-11T01:16:39.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:16:39.189 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-11T01:16:39.329 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:16:39.329 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-11T01:16:39.411 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:16:39.411 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-11T01:16:39.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:16:39.478 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-11T01:16:39.588 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:16:39.588 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-11T01:16:39.660 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:16:39.660 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-11T01:16:39.713 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:16:39.714 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-11T01:16:39.764 INFO:tasks.ceph:Archiving mon data... 2024-05-11T01:16:39.765 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/data/mon.a.tgz 2024-05-11T01:16:39.766 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-05-11T01:16:39.782 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.BcFzSq98qI 2024-05-11T01:16:39.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BcFzSq98qI 2024-05-11T01:16:39.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.BcFzSq98qI 2024-05-11T01:16:40.061 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.BcFzSq98qI is 634KB 2024-05-11T01:16:40.134 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.BcFzSq98qI 2024-05-11T01:16:40.150 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/data/mon.b.tgz 2024-05-11T01:16:40.150 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-05-11T01:16:40.168 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.TOAChwR9eg 2024-05-11T01:16:40.168 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TOAChwR9eg 2024-05-11T01:16:40.359 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.TOAChwR9eg 2024-05-11T01:16:40.443 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.TOAChwR9eg is 643KB 2024-05-11T01:16:40.544 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.TOAChwR9eg 2024-05-11T01:16:40.559 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/data/mon.c.tgz 2024-05-11T01:16:40.559 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-05-11T01:16:40.614 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.QlbLgTOySp 2024-05-11T01:16:40.615 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QlbLgTOySp 2024-05-11T01:16:40.785 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.QlbLgTOySp 2024-05-11T01:16:40.869 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.QlbLgTOySp is 643KB 2024-05-11T01:16:40.942 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.QlbLgTOySp 2024-05-11T01:16:40.957 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-11T01:16:40.957 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-11T01:16:40.960 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-11T01:16:41.044 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-11T01:16:41.077 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-11T01:16:41.077 INFO:tasks.ceph:Archiving crash dumps... 2024-05-11T01:16:41.079 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/remote/smithi016/crash 2024-05-11T01:16:41.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-11T01:16:41.113 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/remote/smithi174/crash 2024-05-11T01:16:41.114 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-11T01:16:41.140 INFO:tasks.ceph:Shutting down logrotate 2024-05-11T01:16:41.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:16:41.157 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-11T01:16:41.227 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-11T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-11T01:16:41.279 INFO:tasks.ceph:Compressing logs... 2024-05-11T01:16:41.279 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-11T01:16:41.297 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-11T01:16:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2024-05-11T01:16:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54538.log 2024-05-11T01:16:41.370 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42464.log 2024-05-11T01:16:41.370 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-11T01:16:41.370 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.3.42464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35581.log 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42464.log.gz 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42067.log 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.audit.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35581.log.gz 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.1.42067.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42067.log.gz 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-11T01:16:41.371 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-11T01:16:41.372 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-11T01:16:41.372 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-11T01:16:41.372 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mgr.x.log: 93.2% 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-11T01:16:41.372 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35490.log 2024-05-11T01:16:41.372 INFO:teuthology.orchestra.run.smithi174.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-05-11T01:16:41.372 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35621.log 2024-05-11T01:16:41.372 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35490.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-11T01:16:41.372 INFO:teuthology.orchestra.run.smithi174.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35490.log.gz/var/log/ceph/ceph-client.admin.35621.log: 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35621.log.gz 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35410.log 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35661.log 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35450.log 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35661.log: /var/log/ceph/ceph-client.admin.35410.log: 88.2% 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35410.log.gz 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35661.log.gz 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35701.log 2024-05-11T01:16:41.373 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35534.log 2024-05-11T01:16:41.374 INFO:teuthology.orchestra.run.smithi174.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35450.log.gz 2024-05-11T01:16:41.374 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.35701.log: -- /var/log/ceph/ceph-mds.d.log 2024-05-11T01:16:41.374 INFO:teuthology.orchestra.run.smithi174.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35701.log.gz 2024-05-11T01:16:41.374 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-client.admin.35534.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35534.log.gz 2024-05-11T01:16:41.374 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-11T01:16:41.374 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-11T01:16:41.456 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40544.log 2024-05-11T01:16:41.456 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46964.log: /var/log/ceph/ceph-client.admin.54538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45818.log 2024-05-11T01:16:41.456 INFO:teuthology.orchestra.run.smithi016.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2024-05-11T01:16:41.456 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54538.log.gz 2024-05-11T01:16:41.456 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47553.log 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40544.log.gz 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35352.log 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45818.log.gz/var/log/ceph/ceph-client.admin.47553.log: 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41159.log 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47553.log.gz 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45948.log 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr:gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.35352.log.gz -- 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/ceph-client.admin.44992.log 2024-05-11T01:16:41.457 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41159.log: /var/log/ceph/ceph-client.admin.45948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49431.log 2024-05-11T01:16:41.458 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41159.log.gz 2024-05-11T01:16:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44992.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45948.log.gz 2024-05-11T01:16:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42102.log 2024-05-11T01:16:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.49431.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44992.log.gz 2024-05-11T01:16:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45159.log 2024-05-11T01:16:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42102.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49431.log.gz 2024-05-11T01:16:41.458 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46032.log 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42102.log.gz 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53720.log 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45159.log.gz 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41555.log 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53720.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46032.log.gz 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41369.log 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53720.log.gz 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41768.log 2024-05-11T01:16:41.459 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41555.log.gz 2024-05-11T01:16:41.460 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55478.log 2024-05-11T01:16:41.460 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41768.log: 89.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.41369.log.gz 2024-05-11T01:16:41.460 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51272.log 2024-05-11T01:16:41.460 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41768.log.gz 2024-05-11T01:16:41.460 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52949.log 2024-05-11T01:16:41.460 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55478.log.gz 2024-05-11T01:16:41.460 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54326.log 2024-05-11T01:16:41.460 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51272.log.gz 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52949.log.gz 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53203.log 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54326.log.gz 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46905.log 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45535.log 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46905.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53203.log.gz 2024-05-11T01:16:41.461 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55336.log 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46905.log.gz 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.45535.log.gz 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45367.log 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54179.log 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55336.log.gz 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52629.log 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45367.log.gz 2024-05-11T01:16:41.462 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52503.log 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52629.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.54179.log.gz 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41767.log 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52629.log.gz 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52503.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52503.log.gz 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47637.log 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49125.log 2024-05-11T01:16:41.463 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41767.log.gz 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52334.log 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47637.log.gz 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.49125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52232.log 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49125.log.gz 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41071.log 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52232.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52334.log.gz 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42773.log 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52232.log.gz 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41453.log 2024-05-11T01:16:41.464 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41071.log.gz 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.42773.log: -- /var/log/ceph/ceph-client.admin.41776.log 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43856.log 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42773.log.gz 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41453.log.gz 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53384.log 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41776.log.gz 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.2.43856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53804.log 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43856.log.gz 2024-05-11T01:16:41.465 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47469.log 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53384.log.gz 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53804.log.gz 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46158.log 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44808.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47469.log.gz 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41285.log 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48265.log 2024-05-11T01:16:41.466 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44395.log 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48265.log: 88.3% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41285.log.gz 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46158.log.gz 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45639.log 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48265.log.gz 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42107.log 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44395.log: /var/log/ceph/ceph-client.admin.45639.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44395.log.gz 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.52851.log -- replaced with /var/log/ceph/ceph-client.admin.45639.log.gz 2024-05-11T01:16:41.467 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42107.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40987.log 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42107.log.gz 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40892.log 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40987.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52851.log.gz 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46412.log 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40987.log.gz 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42115.log 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40892.log: /var/log/ceph/ceph-client.0.46412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46491.log 2024-05-11T01:16:41.468 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46412.log.gz 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40892.log.gz 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47259.log 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42115.log.gz 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.46491.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46491.log.gz 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42731.log 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42451.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47259.log.gz 2024-05-11T01:16:41.469 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54790.log 2024-05-11T01:16:41.470 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2024-05-11T01:16:41.470 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42111.log 2024-05-11T01:16:41.470 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44158.log 2024-05-11T01:16:41.470 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42731.log.gz 2024-05-11T01:16:41.470 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42111.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54790.log.gz 2024-05-11T01:16:41.470 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2024-05-11T01:16:41.470 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42111.log.gz 2024-05-11T01:16:41.470 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45990.log 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44158.log.gz 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51798.log 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45990.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45990.log.gz 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48594.log 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51798.log.gz 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41773.log 2024-05-11T01:16:41.471 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48594.log.gz 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47200.log 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41773.log.gz 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50746.log 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46583.log: /var/log/ceph/ceph-client.admin.47200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53846.log 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.50746.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47200.log.gz 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42857.log 2024-05-11T01:16:41.472 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50746.log.gz 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47343.log 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41117.log 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42857.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53846.log.gz 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46224.log 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42857.log.gz 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41117.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47343.log.gz 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54748.log 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41117.log.gz 2024-05-11T01:16:41.473 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47023.log 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46224.log.gz 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52587.log 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54748.log: /var/log/ceph/ceph-client.admin.47023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41243.log 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54748.log.gz 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47023.log.gz 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52587.log.gz 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-11T01:16:41.474 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41243.log: /var/log/ceph/ceph-client.admin.44473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48830.log 2024-05-11T01:16:41.475 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41243.log.gz 2024-05-11T01:16:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.c.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-05-11T01:16:41.475 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48771.log 2024-05-11T01:16:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42449.log 2024-05-11T01:16:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48830.log: /var/log/ceph/ceph-client.admin.48771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42331.log 2024-05-11T01:16:41.477 INFO:teuthology.orchestra.run.smithi016.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48830.log.gz 2024-05-11T01:16:41.477 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48771.log.gz 2024-05-11T01:16:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48653.log 2024-05-11T01:16:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54664.log 2024-05-11T01:16:41.477 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42449.log.gz 2024-05-11T01:16:41.477 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42331.log: /var/log/ceph/ceph-client.admin.48653.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48653.log.gz 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41029.log 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54664.log.gz 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.41029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45493.log 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41029.log.gz 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52419.log 2024-05-11T01:16:41.478 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.45493.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51009.log 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46074.log 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45493.log.gz 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52419.log.gz 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45451.log 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51009.log.gz 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52377.log 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46074.log.gz 2024-05-11T01:16:41.479 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.45451.log: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52377.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45451.log.gz 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48712.log 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52377.log.gz 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42114.log 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48712.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48712.log.gz 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54622.log 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42114.log: /var/log/ceph/ceph-client.admin.47385.log 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53762.log 2024-05-11T01:16:41.480 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42114.log.gz 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54622.log.gz 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43417.log 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47385.log.gz 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52713.log 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53762.log.gz 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.43417.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54580.log 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.0.43417.log.gz 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46846.log 2024-05-11T01:16:41.481 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52011.log 2024-05-11T01:16:41.482 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52713.log.gz 2024-05-11T01:16:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54580.log: /var/log/ceph/ceph-client.admin.46846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42647.log 2024-05-11T01:16:41.482 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54580.log.gz 2024-05-11T01:16:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52011.log: -- replaced with /var/log/ceph/ceph-client.admin.46846.log.gz 2024-05-11T01:16:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49957.log 2024-05-11T01:16:41.482 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52011.log.gz 2024-05-11T01:16:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.42647.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53342.log 2024-05-11T01:16:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.49957.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42647.log.gz 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49957.log.gz 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42450.log 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53342.log: /var/log/ceph/ceph-client.admin.45323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44850.log 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42450.log: 88.5% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz -- replaced with /var/log/ceph/ceph-client.admin.53342.log.gz 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42450.log.gz 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42112.log 2024-05-11T01:16:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44850.log: gzip -5 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44850.log.gz 2024-05-11T01:16:41.484 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53678.log 2024-05-11T01:16:41.484 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44934.log 2024-05-11T01:16:41.484 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42112.log.gz 2024-05-11T01:16:41.484 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2024-05-11T01:16:41.484 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53678.log.gz 2024-05-11T01:16:41.484 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44724.log 2024-05-11T01:16:41.484 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44934.log.gz 2024-05-11T01:16:41.484 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44242.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-11T01:16:41.485 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2024-05-11T01:16:41.485 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44724.log: gzip -5 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44724.log.gz 2024-05-11T01:16:41.485 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42108.log 2024-05-11T01:16:41.485 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53254.log 2024-05-11T01:16:41.485 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2024-05-11T01:16:41.485 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42108.log.gz 2024-05-11T01:16:41.485 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41495.log 2024-05-11T01:16:41.486 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47427.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53254.log.gz 2024-05-11T01:16:41.486 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2024-05-11T01:16:41.486 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.486 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53552.log 2024-05-11T01:16:41.486 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45281.log: /var/log/ceph/ceph-client.admin.41495.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41495.log.gz 2024-05-11T01:16:41.486 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2024-05-11T01:16:41.486 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53468.log 2024-05-11T01:16:41.486 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53552.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-11T01:16:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2024-05-11T01:16:41.487 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53552.log.gz 2024-05-11T01:16:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2024-05-11T01:16:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44116.log 2024-05-11T01:16:41.487 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53468.log.gz/var/log/ceph/ceph-client.admin.47679.log: 2024-05-11T01:16:41.487 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 2024-05-11T01:16:41.487 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2024-05-11T01:16:41.487 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/ceph-client.admin.42448.log 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44116.log: gzip -5 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44116.log.gz 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42941.log 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54916.log 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42448.log.gz 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52461.log 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52190.log 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr: 91.0%/var/log/ceph/ceph-client.admin.54916.log: -- replaced with /var/log/ceph/ceph-client.admin.42941.log.gz 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52461.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54916.log.gzgzip -5 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52461.log.gz 2024-05-11T01:16:41.488 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55210.log 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52190.log: gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52190.log.gz 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr: -- /var/log/ceph/ceph-client.admin.43990.log 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55210.log.gz 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55168.log 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43990.log.gz 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44200.log 2024-05-11T01:16:41.489 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz 2024-05-11T01:16:41.490 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53426.log 2024-05-11T01:16:41.490 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55168.log.gz 2024-05-11T01:16:41.490 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44200.log: gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44200.log.gz 2024-05-11T01:16:41.490 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55000.log 2024-05-11T01:16:41.490 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41775.log 2024-05-11T01:16:41.490 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53426.log.gz 2024-05-11T01:16:41.490 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55294.log 2024-05-11T01:16:41.490 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55000.log.gz 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49007.log 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41775.log: /var/log/ceph/ceph-client.admin.55294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52274.log 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.49007.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55294.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41775.log.gz 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49007.log.gz 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53912.log 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5/var/log/ceph/ceph-client.admin.52274.log: --verbose -- /var/log/ceph/ceph-client.admin.53594.log 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53912.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52274.log.gz 2024-05-11T01:16:41.491 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43079.log 2024-05-11T01:16:41.492 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53912.log.gz 2024-05-11T01:16:41.492 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47301.log 2024-05-11T01:16:41.492 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-05-11T01:16:41.492 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3%/var/log/ceph/ceph-client.admin.43079.log: -- replaced with /var/log/ceph/ceph-client.admin.53594.log.gz 2024-05-11T01:16:41.492 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47301.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43079.log.gzgzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.55084.log 2024-05-11T01:16:41.492 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47301.log.gz 2024-05-11T01:16:41.492 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.492 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41201.log 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35717.log 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55084.log.gz 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53636.log 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41201.log.gz 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49694.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35717.log.gz 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55438.log 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53636.log.gz 2024-05-11T01:16:41.493 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.494 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.49694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48181.log 2024-05-11T01:16:41.494 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49694.log.gz 2024-05-11T01:16:41.494 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55438.log: gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55438.log.gz 2024-05-11T01:16:41.494 INFO:teuthology.orchestra.run.smithi016.stderr: -- /var/log/ceph/ceph-client.admin.45683.log 2024-05-11T01:16:41.494 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50483.log 2024-05-11T01:16:41.494 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48181.log.gz 2024-05-11T01:16:41.494 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42689.log 2024-05-11T01:16:41.494 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45683.log.gz 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.50483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45079.log 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50483.log.gz/var/log/ceph/ceph-client.admin.42689.log: 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42815.log 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42689.log.gz 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45864.log 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45079.log: /var/log/ceph/ceph-client.admin.42815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46116.log 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45864.log: 88.0% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45079.log.gz 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42815.log.gz 2024-05-11T01:16:41.495 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45864.log.gz 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54706.log 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55126.log 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3%/var/log/ceph/ceph-client.admin.54706.log: -- replaced with /var/log/ceph/ceph-client.admin.46116.log.gz 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45906.log 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54706.log.gz/var/log/ceph/ceph-client.admin.55126.log: 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55126.log.gz 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40936.log/var/log/ceph/ceph-client.admin.45906.log: 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49066.log 2024-05-11T01:16:41.496 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45906.log.gz 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gz 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54874.log 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40936.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.47082.log 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40936.log.gz 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54874.log: /var/log/ceph/ceph-client.admin.49066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54874.log.gz 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49066.log.gz/var/log/ceph/ceph-client.admin.47082.log: 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47082.log.gz 2024-05-11T01:16:41.497 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55252.log 2024-05-11T01:16:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/ceph-client.admin.42447.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46641.log 2024-05-11T01:16:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55252.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2024-05-11T01:16:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53030.log 2024-05-11T01:16:41.498 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55252.log.gz 2024-05-11T01:16:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53159.log 2024-05-11T01:16:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47595.log 2024-05-11T01:16:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53030.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46641.log.gz 2024-05-11T01:16:41.498 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50220.log 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53030.log.gz 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53159.log.gz 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55378.log 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47595.log.gz 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.50220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40806.log 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50220.log.gz 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55378.log: /var/log/ceph/ceph-client.admin.40806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54832.log 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2%/var/log/ceph/ceph-client.admin.47141.log: -- replaced with /var/log/ceph/ceph-client.admin.55378.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40806.log.gz 2024-05-11T01:16:41.499 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45577.log 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1%/var/log/ceph/ceph-client.admin.44032.log: -- replaced with /var/log/ceph/ceph-client.admin.54832.log.gz 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45776.log 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42446.log 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45577.log: /var/log/ceph/ceph-client.admin.45776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45409.log 2024-05-11T01:16:41.500 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45577.log.gz 2024-05-11T01:16:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42446.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45776.log.gz 2024-05-11T01:16:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52755.log 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2024-05-11T01:16:41.501 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45037.log 2024-05-11T01:16:41.501 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2024-05-11T01:16:41.501 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-05-11T01:16:41.501 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52755.log.gz 2024-05-11T01:16:41.502 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44074.log 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45037.log.gz 2024-05-11T01:16:41.502 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.502 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-05-11T01:16:41.502 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.502 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44074.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44074.log.gz 2024-05-11T01:16:41.502 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41779.log 2024-05-11T01:16:41.502 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2024-05-11T01:16:41.502 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz/var/log/ceph/ceph-client.admin.41779.log: 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41779.log.gz 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44640.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/ceph-client.admin.47511.log 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.43552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48889.log 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.47511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54100.log 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47511.log.gz 2024-05-11T01:16:41.503 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44892.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48889.log.gz 2024-05-11T01:16:41.504 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.54100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54100.log.gz 2024-05-11T01:16:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53072.log 2024-05-11T01:16:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5/var/log/ceph/ceph-client.admin.44892.log: --verbose -- /var/log/ceph/ceph-client.admin.48451.log 2024-05-11T01:16:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53072.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44892.log.gz 2024-05-11T01:16:41.504 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45734.log 2024-05-11T01:16:41.504 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53072.log.gz 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42899.log 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.45734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40642.log 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48451.log.gz 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42899.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45734.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42899.log.gz 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54958.log 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40642.log: /var/log/ceph/ceph-client.admin.48391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42110.log 2024-05-11T01:16:41.505 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.54958.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40642.log.gz 2024-05-11T01:16:41.506 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-05-11T01:16:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54958.log.gz 2024-05-11T01:16:41.506 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41597.log 2024-05-11T01:16:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42110.log: gzip -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42110.log.gz 2024-05-11T01:16:41.506 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44682.log 2024-05-11T01:16:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52148.log 2024-05-11T01:16:41.506 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41597.log.gz 2024-05-11T01:16:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44682.log.gz 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52671.log 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53114.log 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8%/var/log/ceph/ceph-client.admin.46717.log: -- replaced with /var/log/ceph/ceph-client.admin.52148.log.gz 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52671.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52064.log 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52671.log.gz 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53114.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-11T01:16:41.507 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9%/var/log/ceph/ceph-client.admin.52064.log: -- replaced with /var/log/ceph/ceph-client.admin.53114.log.gz 2024-05-11T01:16:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41771.log 2024-05-11T01:16:41.508 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52064.log.gz 2024-05-11T01:16:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48493.log 2024-05-11T01:16:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.41771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41411.log 2024-05-11T01:16:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48493.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41771.log.gz 2024-05-11T01:16:41.508 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52545.log 2024-05-11T01:16:41.508 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48493.log.gz 2024-05-11T01:16:41.508 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.41411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53510.log 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4%/var/log/ceph/ceph-client.admin.52545.log: -- replaced with /var/log/ceph/ceph-client.admin.41411.log.gz 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52545.log.gz 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55520.log 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.53510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51535.log 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55520.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53510.log.gz 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53296.log 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55520.log.gz 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51535.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29309.log 2024-05-11T01:16:41.509 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2%/var/log/ceph/ceph-client.admin.53296.log: -- replaced with /var/log/ceph/ceph-client.admin.51535.log.gz 2024-05-11T01:16:41.510 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42330.log 2024-05-11T01:16:41.510 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53296.log.gz 2024-05-11T01:16:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.29309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2024-05-11T01:16:41.510 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29309.log.gz 2024-05-11T01:16:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.42330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2024-05-11T01:16:41.510 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7%/var/log/ceph/ceph-client.admin.45239.log: -- replaced with /var/log/ceph/ceph-client.admin.42330.log.gz 2024-05-11T01:16:41.510 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2024-05-11T01:16:41.510 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51917.log 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52106.log 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.51917.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49167.log 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51917.log.gz 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.52106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52106.log.gz/var/log/ceph/ceph-client.admin.49167.log: 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49167.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48535.log 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:41.511 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.44563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46533.log 2024-05-11T01:16:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.48535.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2024-05-11T01:16:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41327.log 2024-05-11T01:16:41.512 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48535.log.gz 2024-05-11T01:16:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.46533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55042.log 2024-05-11T01:16:41.512 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7%/var/log/ceph/ceph-client.admin.41327.log: -- replaced with /var/log/ceph/ceph-client.admin.46533.log.gz 2024-05-11T01:16:41.512 INFO:teuthology.orchestra.run.smithi016.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41327.log.gzgzip 2024-05-11T01:16:41.512 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40848.log 2024-05-11T01:16:41.512 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.55042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40764.log 2024-05-11T01:16:41.513 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40848.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55042.log.gz 2024-05-11T01:16:41.513 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35614.log 2024-05-11T01:16:41.513 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40848.log.gz 2024-05-11T01:16:41.513 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.40764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40764.log.gz/var/log/ceph/ceph-client.admin.35614.log: 2024-05-11T01:16:41.513 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35614.log.gz 2024-05-11T01:16:41.628 INFO:teuthology.orchestra.run.smithi174.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-11T01:16:41.722 INFO:teuthology.orchestra.run.smithi174.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-11T01:16:41.723 INFO:teuthology.orchestra.run.smithi174.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-11T01:16:41.918 INFO:teuthology.orchestra.run.smithi016.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-11T01:16:41.923 INFO:teuthology.orchestra.run.smithi016.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-11T01:16:41.977 INFO:teuthology.orchestra.run.smithi174.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-11T01:16:42.028 INFO:teuthology.orchestra.run.smithi174.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-11T01:16:42.064 INFO:teuthology.orchestra.run.smithi174.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-11T01:16:42.128 INFO:teuthology.orchestra.run.smithi016.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-11T01:16:42.315 INFO:teuthology.orchestra.run.smithi016.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-11T01:16:42.421 INFO:teuthology.orchestra.run.smithi016.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-11T01:16:42.474 INFO:teuthology.orchestra.run.smithi174.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-11T01:16:42.476 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-05-11T01:16:42.476 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m1.142s 2024-05-11T01:16:42.476 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m4.051s 2024-05-11T01:16:42.476 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.175s 2024-05-11T01:16:43.167 INFO:teuthology.orchestra.run.smithi016.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-11T01:16:43.169 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-05-11T01:16:43.169 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m1.858s 2024-05-11T01:16:43.169 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m5.669s 2024-05-11T01:16:43.169 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m0.342s 2024-05-11T01:16:43.170 INFO:tasks.ceph:Archiving logs... 2024-05-11T01:16:43.170 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/remote/smithi016/log 2024-05-11T01:16:43.171 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-11T01:16:43.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-11T01:16:43.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-11T01:16:43.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-11T01:16:43.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-11T01:16:43.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-11T01:16:43.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-11T01:16:43.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-11T01:16:43.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-11T01:16:43.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-11T01:16:43.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-11T01:16:44.067 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/remote/smithi174/log 2024-05-11T01:16:44.068 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-11T01:16:44.604 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-11T01:16:44.614 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-11T01:16:44.614 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-11T01:16:44.617 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-11T01:16:44.695 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-11T01:16:44.705 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-11T01:16:44.705 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-11T01:16:44.709 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-11T01:16:44.724 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-05-11T01:16:44.725 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-05-11T01:16:44.729 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-11T01:16:44.729 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-05-11T01:16:44.730 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv01.front.sepia.ceph.com 3 6 377 59 +1041us[+1034us] +/- 67ms 2024-05-11T01:16:44.730 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 126 -580us[ -602us] +/- 72ms 2024-05-11T01:16:44.730 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 126 -523us[ -545us] +/- 80ms 2024-05-11T01:16:44.730 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T01:16:44.731 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-11T01:16:44.732 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-05-11T01:16:44.732 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv01.front.sepia.ceph.com 3 6 377 62 +1002us[+1015us] +/- 67ms 2024-05-11T01:16:44.732 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 58 -613us[ -613us] +/- 73ms 2024-05-11T01:16:44.732 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -535us[ -535us] +/- 61ms 2024-05-11T01:16:44.732 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-11T01:16:44.732 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-11T01:16:44.742 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-11T01:16:44.742 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-11T01:16:44.751 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-11T01:16:44.848 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-11T01:16:44.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-11T01:16:44.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:16:44.948 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-11T01:16:44.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:16:44.978 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-11T01:16:44.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-11T01:16:44.997 INFO:teuthology.task.internal:Duration was 1347.272210 seconds 2024-05-11T01:16:44.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-11T01:16:45.007 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-11T01:16:45.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-11T01:16:45.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-11T01:16:45.049 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-11T01:16:45.059 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-11T01:16:45.473 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-11T01:16:45.473 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-05-11T01:16:45.474 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-11T01:16:45.536 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-05-11T01:16:45.537 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-11T01:16:45.565 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-11T01:16:45.566 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-11T01:16:45.579 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-11T01:16:45.634 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-11T01:16:45.634 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-11T01:16:45.647 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-11T01:16:45.777 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-11T01:16:45.788 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-11T01:16:45.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-11T01:16:45.814 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-11T01:16:45.838 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-11T01:16:45.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-11T01:16:45.856 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-11T01:16:45.878 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-05-11T01:16:45.902 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-05-11T01:16:45.915 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-11T01:16:45.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:16:45.947 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-11T01:16:45.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-11T01:16:45.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-11T01:16:45.985 INFO:teuthology.task.internal:Transferring archived files... 2024-05-11T01:16:45.985 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/remote/smithi016 2024-05-11T01:16:45.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-11T01:16:46.021 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036/remote/smithi174 2024-05-11T01:16:46.021 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-11T01:16:46.053 INFO:teuthology.task.internal:Removing archive directory... 2024-05-11T01:16:46.053 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-11T01:16:46.058 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-11T01:16:46.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-11T01:16:46.115 INFO:teuthology.task.internal:Not uploading archives. 2024-05-11T01:16:46.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-11T01:16:46.124 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-11T01:16:46.124 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-11T01:16:46.126 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-11T01:16:46.139 INFO:teuthology.orchestra.run.smithi016.stdout: 265931 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 11 01:16 /home/ubuntu/cephtest 2024-05-11T01:16:46.158 INFO:teuthology.orchestra.run.smithi174.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 11 01:16 /home/ubuntu/cephtest 2024-05-11T01:16:46.159 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-11T01:16:46.170 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-11T01:16:46.189 INFO:teuthology.nuke:Checking targets against current locks 2024-05-11T01:16:46.213 DEBUG:teuthology.nuke:shortname: smithi016 2024-05-11T01:16:46.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-11T01:16:46.235 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-11 00:45:03.740363', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrl1ef1mykH3JmopPQYUOHANK2FNT2VPlDanLPwS/38zsUIJPpWIQCNfJVThPWaml25/0XDRt8fa1qi5pfFTAM='} 2024-05-11T01:16:46.242 DEBUG:teuthology.nuke:shortname: smithi174 2024-05-11T01:16:46.243 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-11T01:16:46.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-05-11_00:39:26-fs-wip-mchangir-mgr-snap_schedule-correctly-fetch-mds_max_snaps_per_dir-from-mds-distro-default-smithi/7702036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-11 00:45:03.738910', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIR8r7mTzb9ZSsVOoWptUVmB++iCaQVMToqhneGELl0ckVN8qjpy7L0LrTOHG+H6fUc+dqfX80AglV2eKpDbwmc='} 2024-05-11T01:16:46.283 INFO:teuthology.orchestra.console.smithi016:Power off 2024-05-11T01:16:46.283 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-11T01:16:46.365 INFO:teuthology.orchestra.console.smithi174:Power off 2024-05-11T01:16:46.365 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-11T01:16:46.378 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-05-11T01:16:46.379 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-11T01:16:46.388 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-05-11T01:16:46.388 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-11T01:16:46.401 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-05-11T01:16:46.410 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-05-11T01:16:50.402 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-11T01:16:50.410 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-11T01:16:50.512 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-05-11T01:16:50.521 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-05-11T01:16:54.514 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-11T01:16:54.523 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-11T01:16:54.625 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-05-11T01:16:54.632 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-05-11T01:16:54.726 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-05-11T01:16:54.733 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-05-11T01:16:54.838 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule} duration: 1347.2722098827362 failure_reason: 'Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a1b35ae711fa4db3ab7cf7c0a18f22fd status: fail success: false 2024-05-11T01:16:54.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-11T01:16:54.907 INFO:teuthology.run:FAIL